Build a High Performance Remote Storage for Prometheus with Unlimited Time Series
Talkat KubeCon + CloudNativeCon + Open Source Summit China 2023 · on Wednesday, 2023-09-27· at 13:55· 3夹层 3M1会议室 | 3M Room 3M1·
summary
Describes a remote storage design for Prometheus that handles high-dimensional/high-cardinality labels by splitting labels into two types: target labels (from prometheus-server) and app labels (from application code). Target labels are encoded into a single column while app labels are flattened into separate columns using ClickHouse’s columnar storage, yielding performance comparable to VictoriaMetrics and up to ~10× faster on large-series queries, and enabling effectively unlimited time series.
AI-written summary · about
related talks
06mLightning Talk
31mHow ClickHouse® Inspired Us to Build a High Performance Time Series Database
17mHow Prometheus indexes Data and Why You Should Care
46mPrometheus as a Time Series Database
36mDoing Things Prometheus Can’t Do with Prometheus
28mIntegrating Long-Term Storage with Prometheus [A]
01h 19mIntro + Deep Dive: Prometheus
25mUnbreakable Prometheus: Leveraging Limits for Consistent Monitoring