Gophers riding Elephants
summary
Builds two Go tools: PG Detective parses multi‑GB pcap files with the go‑packet library to correlate Postgres parse packets and responses, finds a 1:1000 query:response packet ratio and a 105 MB/s outbound spike caused by ActiveRecord schema lookups across forked workers; Go replaces a slow Python prototype and processes captures fast enough in production. DB Duke runs as a daemon using goroutines, channels and explicit error handling to manage ~30 weekly restores with state‑machine retries and timeouts, and it works reliably.
AI-written summary · about
chapters (6)
- 0:00Start
- 2:36Why Go with Postgres?
- 12:45Performance Reliability Ease of Use
- 20:02Introducing: Resque
- 22:59A tool for making restores of Postgres databases manageable and fault tolerant.
- 23:50Fault Tolerance Treat restores as a state machine and recover from failure states
