Transactional data lakes for your analytical workloads

on YouTube ↗41m

" summary

Shows how to build petabyte-scale transactional data lakes on Amazon S3 using open-table formats Apache Hudi, Apache Iceberg and Delta Lake to support CDC, streaming and GDPR-style compliance. Covers using these formats on AWS to simplify data pipeline management and enforce data governance for analytical workloads.

AI-written summary · about

" chapters (6)

1. 0:00Start
2. 3:15Amazon S3: Your storage foundation for data lakes
3. 5:39Table Formats-Challenges with hive HIVE TABLE FORMAT
4. 26:19The challenge of concurrency
5. 27:16Concurrency with Iceberg
6. 29:38Table update strategies

" related talks

• 51mSolving the challenges of adding transactional support to Data LakesLuís Gerardo Baeza, Diego Ortiz · AWS Summit Bogotá 2022
• 25mBuild open format data lakehouseSatish Mane, Rajeev Jahswal · Conf42 Cloud Native 2023
• 01h 03mReinvente su estrategia de datos con Lagos de Datos TransaccionalesJavier Quiroz, Santiago Abarca · AWS Summit Mexico City 2022
• 45mThe Data Lakehouse: A tech talk for everyone who loves dataFrank Munz · Voxxed Days Ticino 2023
• 34mData Lakehouse: Who, Why and HowMilos Solujic · DSC Europe 23
• 26mArchitecting real-time transactional data lakeMasudur Rahaman Sayem · AWS Summit Sydney 2025
• 22mThe Who, What, and Why of Data Lake Table FormatsAndrew Madson · Commit Your Code 2024
• 19mBuilding modern data lakes on Amazon S3Sean White · AWS Pi Week 2021