Precision Over Proliferation: SRE Approach for Leaner, Smarter and Data-Driven..
summary
Claims a 40%+ reduction in metrics cost by building a metrics management framework: a Dollar per Query efficiency metric and usage dashboards, a quota system, and control-plane hooks. Implements an on-demand client/server toggle that yields ~8% cardinality drop in dev, a batch-metrics pipeline storing older data in cheap block storage and loading into Grafana on request, quarterly stale-metric audits that cut ~16%, and a POC that removed ~66% of a team’s cardinality — all reported as successful.
AI-written summary · about
chapters (16)
- 0:00Introduction
- 1:20Observability pillars
- 2:25Observability costs rising
- 3:27Metrics and cardinality
- 6:35Metrics framework at Rubrik
- 9:27Query efficiency metric
- 10:51Metrics dashboard explained
- 15:25Proof of concept
- 16:28Enforcing quotas
- 18:34On-demand metrics
- 20:50Batch metrics
- 24:13Removing unused metrics
- 26:40Results and 40% reduction
- 27:42Implementation steps
- 29:29Precision over proliferation
- 31:14Q&A
related talks
16mShrinking the Observability Bill
28mHow to reduce expenses on monitoring with VictoriaMetrics
26mImproving How We Observe Our Observability Data: Techniques for SREs
22mLook Ma, No Metrics: A Quest Towards Extracting SLOs
23mDesigning for High-cardinality Metrics
24mNew approach to metrics observability for the cloud era
01h 01mFinding Metrics that matter and using them safely
48mMetrics All the Way: Data Driven Operations