Data & AnalyticsIntermediate

Modern Data Engineering

Design scalable data pipelines, transform raw data with dbt and SQL, and orchestrate automated ETL/ELT workflows.

Interactive Live CohortProject-basedComprehensive

What you’ll learn

  • Model dimensional data warehouses with modern SQL schemas
  • Write modular and tested data transformations with dbt
  • Orchestrate scheduled pipelines and data quality checks with Airflow
  • Handle batch and streaming ingestion architectures

Build as you learn

An end-to-end analytical data warehouse & orchestration pipeline. A practical deliverable to help connect the course concepts.

Course curriculum

Module 1: Data Engineering Foundations & Data Warehousing
  • Modern Data Stack architecture and ETL vs. ELT paradigms
  • Cloud data warehouse foundations (BigQuery, Snowflake)
  • Data modeling: Star Schema, Snowflake Schema, and One Big Table
Module 2: Advanced SQL & Dimensional Modeling
  • Advanced SQL for analytical pipelines (window functions, CTEs)
  • Data ingestion patterns: batch, micro-batch, and CDC concepts
  • Designing robust raw and staging layers
Module 3: Transformations & Testing with dbt
  • Data build tool (dbt) project setup and configuration
  • Writing modular transformations, models, and snapshots
  • Automating data quality tests, documentation, and schema assertions
Module 4: Pipeline Orchestraction with Apache Airflow
  • Orchestration concepts with Apache Airflow
  • Writing Directed Acyclic Graphs (DAGs) in Python
  • Task dependencies, retry policies, backfills, and alerting
Module 5: Data Lakes, Storage & Streaming Concepts
  • Data lakes, Parquet file format, and table formats (Iceberg/Delta)
  • Data governance, lineage tracking, and access control
  • Performance optimization and cost management in analytical queries
Module 6: Capstone: End-to-End Analytics Warehouse Pipeline
  • Designing a real-world multi-source analytics pipeline
  • Automating extraction, dbt transformations, and Airflow orchestration
  • Delivering production-ready dashboards and monitoring data health

Prerequisites

Familiarity with SQL and basic Python programming.

Keep exploring