Regular Price: £480 Batch Price: From £480 📅 View Dates & Prices Group Booking Discount: From £300 per person 🧮 Calculate & Book 1-to-1 Training: £600 📋 Booking Request Form Course Overview Data Engineering with Python & SQL is a practical 12-hour instructor-led course designed to introduce learners to the core skills and workflows used to collect, transform, validate, store and deliver data for analytics and business applications. Participants will use Python and SQL to work with files, APIs and relational databases, build ETL and ELT processes, clean and transform data, automate repeatable data workflows and apply data quality checks. The course focuses on practical data engineering rather than advanced big-data platforms, making it an accessible progression for learners who already have basic Python and SQL skills. Through hands-on exercises and an end-to-end project, learners will build a complete data pipeline that extracts data from multiple sources, transforms and validates it, loads it into a database and prepares it for reporting or further analysis. Requirements Participants should have basic knowledge of both Python programming and SQL before joining this course. Learners should be comfortable with Python concepts such as variables, conditions, loops, functions, lists and dictionaries, and with SQL concepts such as SELECT, WHERE, GROUP BY and basic joins. Previous experience with data engineering, cloud platforms, Apache Spark or workflow orchestration tools is not required. We highly recommend you complete the following course(s) before attending the Data Engineering with Python & SQL course: Python Programming for Beginners SQL for Beginners You may also complete the following course(s) before attending the Data Engineering with Python & SQL course but they are not mandatory: Python Intermediate to Advanced SQL Intermediate to Advanced Data Analysis with Python Course Content Introduction to Data Engineering What Data Engineering is Role of a Data Engineer Data Engineers vs Data Analysts vs Data Scientists Understanding data sources, pipelines and destinations Batch processing vs real-time processing Structured, semi-structured and unstructured data Understanding ETL and ELT Overview of modern data architectures Working with Data Sources using Python Reading CSV and text files Working with JSON data Reading Excel files Connecting to APIs Sending HTTP requests Processing API responses Handling missing or unexpected source data Combining data from multiple sources Data Transformation with Python Using Pandas for data transformation Selecting and filtering data Renaming and creating columns Converting data types Handling missing values Finding and removing duplicates Cleaning text and date values Grouping and aggregating data Merging and joining datasets Creating reusable transformation functions SQL for Data Engineering Using SQL within data pipelines Creating staging and destination tables Inserting and updating data Transforming data using SQL Joining related tables Grouping and aggregating data Using subqueries and Common Table Expressions (CTEs) Understanding primary and foreign keys Designing tables for analytical workloads Connecting Python & SQL Databases Connecting Python to a relational database Executing SQL queries from Python Reading database data into Pandas DataFrames Writing transformed data back to a database Using parameters safely in SQL queries Managing database connections Understanding transactions and commits Building reusable database functions Building ETL & ELT Pipelines Understanding the stages of a data pipeline Extracting data from files, APIs and databases Transforming and standardising data Loading data into destination tables Understanding staging areas Designing repeatable pipeline steps Working with incremental data loads Understanding full loads vs incremental loads Creating a simple end-to-end ETL pipeline with Python and SQL Data Quality, Validation & Error Handling Why data quality matters Checking required columns and data types Identifying missing and invalid values Checking duplicates Validating ranges and business rules Handling failed records Using Python exceptions with try and except Creating useful pipeline logs Designing reliable and recoverable data workflows Automating & Managing Data Pipelines Turning scripts into repeatable workflows Separating configuration from program code Using environment variables for configuration Organising a data engineering project Scheduling Python data pipelines Understanding pipeline dependencies Introduction to orchestration concepts Monitoring successful and failed pipeline runs Practical Data Engineering Project Extract data from multiple sources Read data from an API or file source Clean and transform data using Python Validate data quality Create destination tables using SQL Load processed data into a relational database Create analytical SQL queries Add logging and error handling Run the complete data pipeline Prepare the final data for reporting or analysis Course Dates, Prices & Enrolment All Training Physical Classes Virtual Classes UTC British Time (UK, Ireland, Iceland) Central European Time (France, Germany, Sweden) Eastern European Time (Finland, Cyprus) Eastern Time (New York, Toronto, Montreal) Central Time (Chicago, Houston, Winnipeg) Mountain Time (Calgary, Denver, Edmonton) Mountain Time (Phoenix) Pacific Time (Los Angeles, Seattle, Vancouver) Singapore Time Arabic Standard Time (Qatar, Saudi Arabia) Gulf Standard Time (UAE, Oman) Australian Eastern Time (Sydney, Melbourne) Australian Central Time (Adelaide) Western Australia Time (Perth) New Zealand Time China Standard Time (China, Taiwan, Hong Kong) Scroll right for more details There is no date for this course at this moment. Please complete the BOOKING REQUEST FORM below or come back to this page again later. Training venue: Unit 15, Boardman House, 64 Broadway, Stratford, London E15 1NT, United Kingdom Price Calculator & Booking Request Form Calculate prices for Corporate, 1-on-1 or group training and request a booking. Do you have a special training requirement or unable to find any suitable training date? Please complete and submit the booking request form, if you want to: book a course on different dates book for a group of delegates book corporate training book a customised training book a one-on-one training The price person is less when you book a course for more people. You can find the price per person and the total cost by changing the values of the training hours and the number of people below: How many hours? How many people? Total Cost Price per person Preferred Dates and Times Any other information