Solving the world's toughest problems
summary
Databricks presents concrete fixes: Delta Lake is an open format that adds ACID transactions and a commit log so lakes handle updates, deletes and avoid the tiny‑files metadata explosion; a single command converts Parquet tables and Z-ordering speeds point queries on multi‑billion row tables. MLflow provides experiment tracking, reproducible projects and model packaging plus a model registry for versioning and deployment. Community scale shows impact with 800,000 downloads/month and hundreds of contributors.
AI-written summary · about
chapters (10)
- 0:00Introduction and speaker background
- 2:09The promise and challenges of data
- 8:37Introducing Delta Lake
- 19:00Delta Lake features and benefits
- 26:10Delta Lake architecture and use cases
- 30:53MLflow for machine learning operations
- 35:09MLflow components and tracking
- 38:47MLflow model registry
- 42:10Customers solving tough problems
- 44:00Closing and Q&A
related talks
58mBuild reliable data lakes with Delta Lake & Databricks
39mDelta Lake: Diving into Data Lakes Without the Downsides
28mLakehouse Architecture with Delta Lake and Databricks
45mSimplify your ETL with Databricks Delta Lake
31mDelta Lake: Open Source Reliability and Quality for Data Lakes
21mBuilding Data Integration Services In Real Time
33mThe Pace of Innovation in Delta Lake
54mThe Future of Data Science/ML at Scale: A Look at MLflow, Delta Lake + Lakehouse