Improving performance of RPCs with envoy
summary
Wikimedia adds Envoy sidecars to terminate TLS and hold persistent connections so PHP workers stop creating a fresh TLS session per request, and measures show big wins: a cross‑DC PHP benchmark goes from about 720 rps without TLS to 1050 rps when PHP calls localhost Envoy, session‑store pod CPU drops from 2.5→0.7 CPUs, and latency buckets shift with far fewer >10 ms tails. Operational fixes include limiting requests per connection to 1000, tuning Envoy idle timeout to 4.5s vs server 5s, and using iptables for transparent routing.
AI-written summary · about
chapters (5)
related talks
21mMaking Envoy Resilient to Sudden Increases in Load
10mLightning Talk: Envoy @ Netflix
42mAccelerating Envoy with the Linux Kernel
34mIntro: Envoy
37mEnvoy Internals Deep Dive
25mScaling Up, One Network Bottleneck at a Time
27mEnvoy - Overview and Update: Senior Envoy Maintainer
21mLightning Talk: Integrating Envoy with DPDK-based virtual networks