Component Based Data Warehouse And ML Development – New World Order Or Marketing Hype?
summary
Argues that component-based development is already practical: ETL/ELT pipelines, DBT SQL models, Looker semantic layers and Azure Data Factory/Dataplex integrations all check into Git with CI/CD and run in containers on Kubernetes; data catalogs plus a business glossary and global identifiers turn reusable data products into Lego-like components; internal marketplaces publish products so teams reuse 70–80% of needed pieces; orchestration across best-of-breed tools and a center of enablement are the critical organizational pieces.
AI-written summary · about
chapters (6)
related talks
41mModern Data Architectures – What They Are and How to Implement?
42mBuilding Tomorrow's Warehouse Today: Modern Data Warehouse Modelling Insights
36mIntroducing Data Mesh A Paradigm Shift In Analytical Data Management Architecture
54mBehind the Hype - Architecture Trends in Data
47mModern Data Architecture: Breaking the Big Data Monolith
01h 01mModern Data Warehousing Strategy
24mMake data central feature
50mMasterclass: Building a data stack in 2021