Discovering the value of a cloud data platform
summary
Discover moves petabytes from Teradata (6,000 production tables) into an S3 data lake and standardizes payloads to Avro then S3 → Snowflake via Avro; a universal data loader and OpenShift containers run Spark, H2O and an Air9 product that containerizes models for CI/CD deployment. Migration uncovers 12 Well‑Architected gaps, supports tens of millions of daily transactions, replaces portions of 40,000 Ab Initio jobs a day, and yields faster model training, scalable batch and emerging streaming pipelines that are productionized but still evolving.
AI-written summary · about
chapters (12)
- 0:00Introduction and survey findings
- 3:54Why cloud for competitive advantage
- 11:11Executing the cloud data platform
- 20:21Migration strategy and workforce changes
- 23:283CM framework for cloud data
- 28:16Challenges beyond technology
- 31:48AWS architecture and scalability
- 35:44Machine learning and data science enablement
- 41:40Responsible AI and model governance
- 43:05Next steps for real-time analytics
- 47:58Lessons learned and future advice
- 53:14Q&A session
related talks
31mA Journey of Migrating Data Platform from Data Center to Cloud
24mA Single Data Platform for All of Your Workloads
27mModernize Your Data Warehouse
29mGrowing insights through hybrid data architectures
31mData Mesh & Data Vault
31mFrom Raw Data to Real Impact: Lessons from Real-World Transformations
59mHow Siemens & Petco drive enterprise transformation with data & AI
41mOn Data: Sky above, sand below, peace within