The Meta Thrift Journey: O (100 Billion QPS) Moved
summary
Thrift at Meta handles roughly 100 billion QPS and the team unifies multiple custom RPC frameworks into one fork (FB Thrift) so thousands of machines move from bespoke RPC to Thrift at up to 28 billion QPS with no visible client changes. Codegen adds a fast-path optimization that speeds deserialization by ~25%. A new Thrift customization feature lets platforms supply custom types like cache TTLs and generates a Delta representation for wire-efficient updates, and these features are deployed and used to cut network and maintenance cost.
AI-written summary · about
chapters (9)
- 0:00Start
- 1:34What is Thrift
- 7:38Thrift Serialization
- 13:13Customer Story (Alice & Bob)
- 14:51Solution: Thrift Customization
- 15:01Thrift Customization: Cost of Unification
- 15:34Thrift Customization Example
- 16:34Customer Story (Lisa)
- 17:55Delta Representation Example
related talks
40mPerformance Improvements
39mTransactor Performance Theory & Practice
54mHigh Performance Financial Service Integration
36mThe Journey to Achieve 1000x TPS for a Real-World Core Banking Application on TiDB
14mRETH & Ethereum Resilience
45mAn update on Khepri adoption in RabbitMQ
26mReimagine Real-time
15mTake Out the TraChe: Maximizing (Tra)nsactional Ca(che) Hit Rate