Streamhouse Architecture with Flink and Paimon

on YouTube ↗42m

" summary

Claims a workable streaming lakehouse built with Flink + Apache Paimon + Flink CDC, not just hype: Paimon is a table format tuned for streaming with upserts and time travel and S3-backed snapshots, Flink runs continuous SQL/dataflow and uses a Paimon connector for reads/writes, and Flink CDC streams RDBMS changes with a snapshot→incremental transition. The demo builds a continuous airline join and aggregation that runs in production-style mode, preserves exactly-once semantics, and aims for lower cost than always-online Kafka systems.

AI-written summary · about

" chapters (8)

1. 0:00Streamhouse architecture intro
2. 1:45Flink overview and capabilities
3. 7:28Paimon table format
4. 16:20Flink CDC for databases
5. 20:56Flink Paimon CDC integration
6. 27:41Streamhouse use case with Flink SQL
7. 33:18Key takeaways
8. 33:41Q&A

" related talks

• 40mThe Seven Deadly Sins of StreamingGiannis Polyzos · Big Data Conference Europe 2025
• 43mHail Hydrate! From Stream to Lake Using Open SourceTimothy J Spann · Open Source Summit + Embedded Linux Conference + OSPOCon 2021
• 01h 01mApache Fluss: A Streaming Storage for Real-Time LakehouseJark Wu · Future Data Systems Seminar Series (Fall 2025)
• 51mStream Processing Smackdown: Kafka Streams vs. Apache FlinkViktor Gamov · Voxxed Days Ticino 2025
• 42mStream Processing with Apache FlinkTugdual Grall · DevFest Toulouse 2017
• 23mBetter, Faster, Stronger Streaming: Your First Dive into Flink SQLCaito Scherr · Berlin Buzzwords 2021
• 31mFrom Warehouse to Lakehouse: Data at RestJan Kamieth · bit summit 2025
• 39mFaster Analytics for Fast Data with Apache Pinot and Flink SQLChinmay Soman · Berlin Buzzwords 2021