The Evolution of Twitter's Edge
summary
Twitter runs Envoy at the edge for 100% of requests, handling hundreds of billions per day, replacing a bespoke proxy (TSA) with roughly 2x throughput and better latency. An internal Scala control plane serves xDS, custom C++ filters add Twitter metrics and a global connection hash, and contributions include per-connection rate limiting (cuts TFE tail latency ~20%) and TLS fingerprinting for bot detection; TLS 1.3 adoption drops handshake time ~38% and home-timeline refresh latency ≈30%.
AI-written summary · about
chapters (9)
- 0:00Introduction
- 1:54Availability and Reliability
- 4:40Pre2014
- 9:22Envoy
- 12:46T3 Proxy
- 14:51Control Plane
- 18:08TLS 13 Performance
- 19:01Bot Mitigation
- 23:14Whats Next
related talks
42mScaling to Billions of Real-time Recommendations Daily
41mInside Twitter's Realtime Delivery of Tweets for Enterprise Customers
22mThe Open Source Technology Behind a Tweet
22mRebuilding Twitter’s public API
27mFixing Twitter: Improving the Per
26mRunning Envoy at the Edge
42mPowering 100+ million daily users
06mInterview
