How to Survive a One-Year Sprint and Migrate to ClickHouse

on YouTube ↗51m

" summary

A presentation about migrating a product or startup from existing analytics storage to ClickHouse, describing practical challenges encountered during a year-long sprint and how the team approached the migration. It covers ClickHouse as the chosen analytics database, operational and integration problems that arise in real-world companies, and the applied solutions and lessons learned.

AI-written summary · about

" chapters (15)

1. 0:00Introduction
2. 4:23PostgreSQL problems and solution search
3. 5:00First ClickHouse tests
4. 6:02Integration pitfalls
5. 8:10Solution with Kafka and Kafka Engine
6. 10:20Operational pitfalls
7. 13:34Materialized views
8. 17:32Slow query problems
9. 20:29Query and load limits
10. 22:36Codec optimization
11. 27:36Performance settings
12. 31:09Data updates and partitions
13. 33:44Release preparation
14. 36:54Summary and recommendations
15. 38:00Q&A

" related talks

• 49mSolving real business cases with ClickHouseDmitriy Cherobaev · Saint HighLoad++ 2025
• 59mEffective Use of ClickHouseAleksey Milovidov · HighLoad++ 2017
• 30mReplicating Data from MySQL to ClickHouseVladislav Klimenko, Valeriy Panov · HighLoad++ Siberia 2018
• 51mTheory and practice of using ClickHouse in real applicationsAleksandr Zaytsev · Backend Conf 2018
• 47mClickHouse Without Pain: Our Experience Refactoring a Legacy Cluster and the Impact of Shard GroupsM.Filimonov · Saint HighLoad++ 2025
• 42mBuilding an Analytic Extension to MySQL with ClickHouse® and Open SourceVadim Tkachenko, Kanthi Subramanian · OSA Con 2022
• 51mWhat You Need to Know About ClickHouse ArchitectureAleksey Zatelepin · РИТ++ 2017
• 26mO11y in One: Exploring ClickHouse as a Unified Telemetry DatabaseJosh Lee · SREday London 2025 Q3