Data Lake House in the Cloud: The Azure Solutions
summary
Claim: a single Azure environment replaces separate lake and warehouse by combining storage, MPP SQL, serverless SQL and Spark for ingestion, transformation and reporting. Implementation uses Synapse Analytics with a dedicated SQL pool, serverless SQL, Apache Spark, Azure Data Factory pipelines, and Power BI dataflows. Demo workspace named mountain range reads two blob stores, creates external tables/views over New York taxi and Microsoft public data, runs joined queries and shows holiday traffic drops — the queries execute and return expected results.
AI-written summary · about
chapters (11)
- 0:00Intro
- 0:52Single Source of Tools
- 2:24Big Data
- 8:03Data Lake
- 11:18Data House
- 13:55Selection Analytics
- 18:54Power BI
- 24:34Spread
- 26:28Import
- 28:00Data Lake House
- 30:08Genetic Analysis
related talks
58mAzure Data Lake & Synapse Server less Architecture
21mWhy the Lakehouse?
50mZero to Lakehouse in Microsoft Fabric
53mAzure Synapse Analytics: Evolving Azure SQL Data Warehouse
24mREDLake Azure - Enterprise Data Lake and Business Satellites
51mHow to Build a Modern Data Lakehouse?
54mAn introduction to Azure Synapse Analytics!
44mWhat's the Best Big Data Architecture for You?