Data Plumbing 101 - ETL Pipelines for Everyday Projects
summary
Claims a concrete setup that turns dozens of brittle scripts into a traceable pipeline, reducing a tangled “17 import scripts” workflow to managed tasks. Implements an actual library Ozelot that glues Luigi and SQLAlchemy to provide an ORM base, database session handling, Luigi task classes and an ORM target marker for task completion. Shows a running ETL pipeline, a reproducible relational data model and a small interactive dashboard built on the imported data.
AI-written summary · about
chapters (6)
related talks
32mBuilding Your First Data Pipelines
38mBuilding Data Pipelines in Python
24mLuigi & Data Pipelines
38mBuilding Data Pipelines in Python
44mCreating Python Data Pipelines in the Cloud
29mYou Have A Data Lake, Now What?
16mBeyond ETL: Revolutionizing Data Engineering Workflows
36mPython and ETL Schemas: The essential pivot for Artificial Intelligence