Reinvente su estrategia de datos con Lagos de Datos Transaccionales
summary
Shows how a Transactional Data Lake on S3 plus an ACID storage layer (Apache Hudi / Iceberg / Delta Lake) and real‑time ingestion (Kinesis, Kafka, AWS DMS) preserves CDC, deletes, time‑travel and concurrent writes while keeping queryability. Combines that lake with Redshift Serverless using automatic table optimization, materialized‑view query‑rewrite and auto scaling. A customer proof cuts a 7‑hour daily ETL to 30 minutes and turns ad‑hoc queries from minutes into seconds on 800M daily rows (25B/month test), so the architecture demonstrably works.
AI-written summary · about
chapters (9)
- 0:00Introduction
- 1:23Modern data lake strategy
- 6:07Current data lake challenges
- 13:47Transactional management frameworks
- 27:22Delta Lake vs Data Warehouse
- 33:10Redshift Serverless features
- 45:41Redshift automation
- 54:46Demo: materialized views
- 1:02:39Summary
related talks
41mTransactional data lakes for your analytical workloads
51mSolving the challenges of adding transactional support to Data Lakes
45mThe Data Lakehouse: A tech talk for everyone who loves data
43mManaging a Data Lake on AWS
11mBreaking Data Silos: Enterprise Data Management
26mArchitecting real-time transactional data lake
28mTurn Data Into Insights
37mBuild a Modern Data Platform on AWS