← Learn
Learn · Data engineering

Warehouses and pipelines

Seven lessons on getting data into a warehouse and keeping it right: warehouses and operational databases, ETL and ELT, staging layers, transformation models with tests, orchestration and scheduling, jobs you can safely rerun and backfill, and data quality checks. Real tools like dbt and Airflow are named as examples, but the ideas work with any of them, and the SQL runs in the page.

More info

How it works

Each lesson is a short read with real queries and what they return, then practice questions. Some have you write a query: it runs as you type on a small shop database in your browser (SQLite), shows what it returns, and is marked right as soon as it returns the same rows as the answer. Any query that gets there counts, so there’s more than one right way. Some questions practise one idea and ask you to use it, like a JOIN or a window function. You can try again as often as you like; “Show the result to aim for” shows the rows you’re after, and after two misses there’s a button to show a query that works.

What do I need to know first?

SQL: Querying data first, or being at home with joins, GROUP BY and window functions. No particular tool needed.

The other AI and data engineering courses

Where is my progress saved? In this browser, like the rest of the site. Nothing to sign up for.