From 15,000 Database Connections to under 100—A Tech Debt Tale
summary
Company reduces MySQL connections from 15,000 database connections to under 100 by replacing per-hypervisor polling with a regional event router, rewriting the single-threaded Perl scheduler into a concurrent Go scheduler v2, and fronting the events table with an API proxy called harpoon that switches from DB polling to Redis/RMQ-style queues and workers. Work completes by mid‑2018 and the new pipeline substantially lowers load and outage frequency.
AI-written summary · about
chapters (5)
related talks
24mFrom Expensive Queries to Smart Caching: A DBA’s Guide for Rails
37mScale MySQL beyond limits with ProxySQL
22mFrom Firefighting to Proactive Work: ...
29mScaling Rails to 2M MySQL requests per second
41mUsing Databases to Pull Your Application Weight
26mOperationalizing 19 years of infrastructure via MySQL-as-a-Service
39mHow we sped up MySQL Handler Socket ninefold
53mMySQL DevOps