Elevate your data and AI governance with Databricks Data Intelligence Platform
summary
Demo shows an end-to-end predictive maintenance pipeline built on Databricks Unity Catalog: raw files (S3 volumes) ingested to Delta tables, registered feature tables in the Feature Store, AutoML training, and models registered and served via a serverless REST endpoint that writes to inference tables for monitoring. Lakehouse Federation exposes external sources (Redshift, Postgres) under the same unified permission model, automatic table/column/file lineage appears in system tables, and Delta Sharing plus tag-based row/column masking handle secure sharing, auditing, and cost allocation.
AI-written summary · about
chapters (6)
- 0:00Introduction to governance
- 1:05Governance challenges
- 6:16Data engineering pipeline
- 14:56Data science and ML workflows
- 27:17BI and data access control
- 38:18Admin governance and audit
related talks
34mOverview of the Databricks Platform
22mReliable data engineering made easy
18mDatabricks drives predictive maintenance, grid optimization with analytics
14mTony Baer, dbinsight & Doug Henschen, Constellation Research | Databricks Data + AI Summit 2023
26mJoel Minnick, Databricks | Databricks Data + AI Summit 2024
17mHow will AI transform your data platform?
43mAnalyzing Big Data in Azure cloud using Spark and Databricks
02mDatabricks at GoDataFest 2019