Fall in Love with Data Transformation: DBT as Your Weapon
summary
Hands‑on demo installs DBT with Poetry, connects to Snowflake (or DuckDB locally), loads sample tables and runs transformations that create prep and prod layers; the demo loads 50 million orders into a tutorial schema, builds seven models plus one seed, and runs about 15 tests. It shows materializations (tables, views, incremental loads), reusable macros (a simple CTE pattern), auto‑generated HTML docs and lineage, and that DBT build stops on test failure so the pipeline fails fast; the examples execute successfully.
AI-written summary · about
chapters (15)
- 0:00Introduction to DBT
- 1:50Agenda overview
- 8:12Installing DBT with Poetry
- 14:22Sample data and project setup
- 22:39Project structure and seeds
- 27:21Model configuration
- 33:21Documentation and schema YAML
- 42:57Q&A and break
- 59:08Generating DBT docs
- 1:05:53Macros for reusability
- 1:13:18Running and testing models
- 1:23:18Advanced data quality
- 1:31:59Automation and scaling
- 1:37:43Switching databases
- 1:40:35Q&A session and final thoughts
related talks
49mdbt: A Software Engineering Approach To The Analytics Workflow
55mThe ELT pattern in action with DBT and SQLMesh
51mFrom SQLi Hammer to Full-fledged Software Engineer
05mDump the Ducktape: Unblocking data pipelines at scale in healthcare using
39mBuilding a Modern Data Warehouse Without Breaking the Bank
21mSnowflake and dbt -- Our Journey to the Cloud
28mHow Open Source Enables Innovation A Case Study with dbt and Lightdash
23mDelivering Modern Data Stacks With dbt to Operationalise Analytics