What's New and Cool in Azure Synapse Analytics
summary
Latest Synapse updates show concrete, usable changes: a TTL-managed integration runtime cuts copy-activity queuing by keeping compute alive for five minutes; a SAP CDC connector uses mapping data flows to stream real CDC; Spark 3.3 with Delta 2.1 adds Delta time travel and OPTIMIZE+Z‑order (example: reads drop from ~1.2GB to 160MB); serverless SQL gains Delta read preview; dedicated pools add multi-column distribution and multi-column shuffle to slash shuffles; a distribution advisor suggests keys; synapse.ml wires OpenAI into ETL to emit JSON cleans; Data Explorer’s scan() process mining and Power BI direct-query optimizations round out the list.
AI-written summary · about
chapters (15)
- 0:00Introduction and overview
- 3:14Data integration updates
- 7:55SAP CDC connector demo
- 9:40Data engineering with Spark 3.3
- 12:09Delta Lake time travel demo
- 15:42Z-order indexing for Delta tables
- 17:51Data warehousing improvements
- 21:03Multi-column distribution in dedicated SQL
- 24:15Distribution advisor tool
- 25:44Data science with Synapse ML
- 27:32OpenAI integration demo
- 33:37Observational analytics with KQL
- 36:31KQL scan function for process mining
- 38:17Power BI and Synapse integration
- 41:27Summary and resources
related talks
54mAn introduction to Azure Synapse Analytics!
53mAzure Synapse Analytics: Evolving Azure SQL Data Warehouse
55mAzure SQL database, Azure Synapse Analytics, Azure Databricks?
19mNever ETL again, thanks to Synapse Link. Really?
24mSynapse Analytics
49mAzure Synapse Analytics
46mThe Ultimate Jigsaw - Architecting Azure Synapse Analytics
54mOLAP on the Cloud with Azure Databricks and Azure Synapse