The dashboard won’t load! Tales from a Super Bowl WarZoom
summary
A real-time observability platform called Visor ingests raw CDN and origin logs, uses a replay tool Dirt to simulate load (18 million concurrents in two minutes) and supports Super Bowl LV with 5.7 million viewers. Dashboards fail when concurrent queries plus ingest make database cost grow exponentially, prompting a leader/follower DB split, a query killer, sampling (safe at ~80%) and parsing CMCD into CDN logs via CMCD to avoid expensive joint queries and capture 100% of problematic requests.
AI-written summary · about
chapters (8)
- 0:00Intro
- 0:54What is Visor
- 2:05The Problem
- 5:28Sampling
- 6:46Data Sources
- 9:23CMD
- 10:31Request Tracing
- 12:08Data Challenges
related talks
12mUnlocking the Secrets of Client Data
23mAutomatically Making Dashboards Load 100X Faster
01h 41mDatadog DASH 2019 Keynote
47mMonitoring at Scale: Intuitive Dashboard Design
33m100% Visibility
41mScaling Observability: From Chaos to Clarity with Open Source Tools
28mResolving Outages Faster With Better Debugging Strategies
24mDevOps. Monitoring Databases. On-Premise and Cloud environments