State of the crates.io
summary
Crates.io now hits 95th under 100ms and 99th under 150ms, runs a 24/7 on‑call rotation, and fixes real outages: a 30s timeout traced to DB lock contention and resolved by changing to per‑row transactions and adding indexes that drop a 14s query to ~2ms. Bot crawlers drove intermittent 6s page loads until IP/user‑agent blocking and a materialized view for recent downloads reduced load. Planned changes include backgrounding GitHub index updates, moving uploads to S3 via cargo, and formal load testing.
AI-written summary · about
chapters (9)
- 0:00Intro
- 3:10Speed
- 3:59Monitoring
- 5:20Incidents
- 12:50Performance Problems
- 14:11Bots
- 17:53Crate Uploads
- 23:00My Project
- 32:04Communication
related talks
54mInterview
29mReady, steady, crash!
31mHow We Went From Two Major Outages to 99.98% Reliability in 6 Months
24mUnlocking CI Performance in the Age of Agentic Development
50mCrate security in 2025
35mStress Testing as a Culture
56mGetting all the 99.99(9) you always wanted
19mKeeping High-Traffic Systems Running When Things Go Wrong