Chaos Genius: Open Sourcing Outlier Detection and Root Cause Analysis
summary
An open source analytics engine that runs hundreds of ML models across thousands of dimensions, connects to Redshift Snowflake BigQuery plus Shopify Facebook Google Ads, and supports dbt metric layers. It detects multivariate anomalies (example: a cloud-cost spike traced to AWS Lambda in eu-central-1), offers drilldown root-cause by subgroup combinations, ships alerting to Slack/email, and already runs in 25+ countries and on customers with over 100M rows/day.
AI-written summary · about
chapters (5)
- 0:00Start
- 0:20Background
- 2:24The Curse of Dimensionality
- 5:50The Technical Challenges
- 8:04Success Stories
related talks
30mBetter data quality with ML & visualization
52mDevil in the Haystack
01h 21mBuilding a ML Model Observability pipeline
23mAnalyzing Operational Data at Scale Using ML at Intuit
34mML-Bound Anomaly Detection: Experiences Beyond Commodity Observability
38mAnomaly detection in the cloud: how to detect issues in data [...]
18mCross-Industry Anomaly Detection Solutions with R and Shiny
24mHunting Criminals with Hybrid Analytics