Rethinking Status Quo: Open Source and the Cloud Data Warehouse
summary
Argues that combining open-source ClickHouse with cloud storage and streaming unbundles the old cloud data warehouse model, enabling low-latency, user-facing analytics; cites a real customer doing realtime fraud analysis on card transactions and emphasizes ClickHouse features like materialized views and projections to serve high-concurrency queries. Claims this hybrid pattern—batch offline systems plus streaming and an OLAP store—is both simpler and more cost-effective than oversized proprietary warehouses; warns against short-horizon “toy duck syndrome” and urges separate storage and compute.
AI-written summary · about
chapters (8)
- 0:00Introduction
- 3:53What is ClickHouse
- 8:13Cloud data warehouse evolution
- 10:41Real-time architecture with ClickHouse
- 17:46Real-time and user experience
- 21:22Scalability in data systems
- 23:27Strategy and toy duck syndrome
- 26:44Region-specific user experiences
related talks
32mHow open source is re-shaping the cloud data warehouse landscape
40mUnbundling of the Cloud Data Warehouse: Open Source Databases and Data Lakes
40mTo Warehouse or to Lakehouse? And How Do Various Open Source Project Compare?
41mOn Data: Sky above, sand below, peace within
17mBuilding Real-Time Data Lake with ClickHouse
33mThe advent of the open data lake
05mThe Future of Data Warehousing
28mThe architecture behind modern cloud data warehouses