Connecting Thanos to the Outer Rim via Query API
summary
Thanos adds a new QueryAPI that pushes down PromQL fragments so queries run closer to data using distributed query execution, reducing latency in tests by up to 10x. A lightweight, open source Thanos PromQL connector (a few hundred lines) proxies Thanos to PromQL endpoints like Google Managed Prometheus (Cloud Monarch) so a global sum or rate can combine GMP and local Prometheus results; quantiles still require centralization, and external labels control fanout.
AI-written summary · about
chapters (23)
- 0:00Intro
- 0:20Filips Introduction
- 0:40Mahmoud Amin Introduction
- 1:04What is Thanos
- 2:12Open Source Projects
- 2:57fragmentation
- 4:21Thanos Federation
- 4:59Query fragments
- 6:02Cloud Providers
- 6:48Distributed Query Execution
- 7:01Physical Partitioning
- 8:47Logical Partitioning
- 9:38Impact on Latency
- 10:16Interoperability
- 10:50Whats next
- 11:29Google Cloud Managed Prometheus
- 12:01Thanos Prometheus Connector
- 12:36What is required
- 12:47Credentials
- 13:07View
- 13:43Demo
- 17:46Conclusion
- 18:28Questions
related talks
39mAbsorbing Thanos Infinite Powers for Multi-Cluster Telemetry
36mRunning the Observability As a Service For Your Teams With Thanos
26mPrometheus That Scales
27mThanos: Highly Available, Pluggable, Long Term Metric Storage for Everyone!
30mDistributing PromQL for Fast and Efficient Kubernetes Fleet Monitor...
33mStory of Correlation: Integrating Thanos Metrics with Observabi...
32mAdopting Thanos Gradually Across All of LastPass Infrastructures
15mScaling Observability Stack for AIOPS