Frying Squirrels and Unspun Gyros
summary
Industry belief in five-9s reliability is false; data centers fail for odd reasons—fry and squirrels knocked out half a site, an FM200 fire-suppression dump happened during soldering, HVAC anomalies drove temperatures to 130°F, and UPS problems account for 29% of unplanned outages. Yahoo deploys across 29 data centers and practices live failovers, shifting millions of users during peak hours to validate geo failover rather than brittle local redundancy, and finds everyday-tested automation and culture beat airplane-into-building DR.
AI-written summary · about
chapters (14)
- 0:00Introduction to BCP
- 0:36Data center risks
- 1:03Fire suppression issues
- 1:47HVAC failures
- 3:05Physical disasters
- 4:21Backup system failures
- 5:35UPS infrastructure challenges
- 6:50Technological weaknesses
- 7:46Rethinking redundancy
- 8:28Handling severe disasters
- 9:32Cloud infrastructure risks
- 10:37Strategic HA planning
- 12:11Live testing and validation
- 13:14Conclusion and best practices
