From SQLi Hammer to Full-fledged Software Engineer
summary
Introduces dbt (data build tool) as an open-source way to move from ad-hoc SQL scripting to software-engineering practices for cloud data transformations (targeting BigQuery users). Covers dbt’s core features for managing and delivering reliable data, writing maintainable regression tests for transformations, and using SQL together with Jinja to control transformation scripts.
AI-written summary · about
chapters (11)
- 0:00Introduction
- 3:39What is dbt and how it works
- 17:26Real dbt use case
- 21:16Setup and first models
- 28:18Parallel query execution
- 31:51Variables and macros in dbt
- 35:48Execution optimization
- 37:35Partial model runs
- 43:10Data transform testing
- 47:50Documentation generation
- 50:17Summary and contact
related talks
49mdbt: A Software Engineering Approach To The Analytics Workflow
39mWhat if SQL was back in fashion?
01h 42mFall in Love with Data Transformation: DBT as Your Weapon
55mThe ELT pattern in action with DBT and SQLMesh
23mDelivering Modern Data Stacks With dbt to Operationalise Analytics
01h 28mA Guide to the Modern Data Stack
28mHow Open Source Enables Innovation A Case Study with dbt and Lightdash
38mThe Rise & Downfall of the Data Engineer REVISITED