The Open Source Analytic Universe, Version 2022
summary
Open Source analytics now shows concrete shifts: ClickHouse powers many cloud services and forks, Altinity runs altinity.cloud as an early managed ClickHouse platform, and some deployments ingest 3 million rows/sec (≈250 billion rows/day, a trillion every four days) with instances reaching ~30 TB. Work focuses on near‑real‑time transfer from MySQL into analytic stores using a Kafka sync connector, growth of open table formats (Delta Lake, Iceberg) and Databricks Photon, and rising HTAP merges row and column stores into single engines.
AI-written summary · about
chapters (6)
- 0:00Introduction
- 1:41RealTime Analytics
- 5:55Transactions to Analytics
- 10:15Object Storage
- 15:19PostgreSQL
- 18:10Predictions
related talks
40mUnbundling of the Cloud Data Warehouse: Open Source Databases and Data Lakes
32mHow open source is re-shaping the cloud data warehouse landscape
28mColumnstore Revolution
34mCatalogs, Iceberg, and Delta: Building the Foundation for Lakehouse Analytics
27mFast DIY O11y with OpenSrc Analytics & Visualization
56mWelcome & State of Open Source Databases
05mClickhouse & Goldsky: CryptoHouse
17mBuilding Real-Time Data Lake with ClickHouse