Bowerbirds of Technology: Architecture and Operations at Less-Than-Facebook Scale
summary
Argues against copying Google scale solutions and gives concrete tradeoffs: Uber builds an append-only sparse 3D hashmap (Bigtable-like) and sacrifices joins, flexible queries, and developer familiarity; Amazon’s service mandate spawns AWS but increases pager escalation and forces service discovery; many companies keep Django monoliths or relational DBs and hit 20,000 writes/sec with full ACID. Recommends choosing mature, well-supported tools, test backups and failover across fault domains, keep an external status page, follow OWASP, and practice incident communication.
AI-written summary · about
chapters (41)
- 0:00Start
- 2:19ZIPF DISTRIBUTION
- 3:25ABSURDLY HIGH THROUGHPUT AND STORAGE DEMANDS
- 3:45(NEAR-)UNLIMITED RESOURCES
- 4:24LINEARLY ADD CAPACITY BY ADDING MORE SERVERS
- 4:37EVENT NOTIFICATIONS (TRIGGERS)
- 5:00APPEND-ONLY SPARSE THREE-DIMENSIONAL PERSISTENT HASH MAP, VERY SIMILAR TO GOOGLE'S BIGTABLE
- 5:33NEW ABSTRACTIONS
- 5:47EVENTUAL CONSISTENCY
- 6:00FLEXIBLE QUERIES
- 6:17DEVELOPER FAMILIARITY
- 6:36AMAZON AND SERVICE ARCHITECTURE
- 7:10All teams will henceforth expose their data and functionality through service interfaces.
- 8:17AMAZON LEARNED SOME THINGS
- 8:40monitoring and QA are the same thing...
- 9:12MASSIVELY SCALABLE INFRASTRUCTURE COSTS DEVELOPER TIME.
- 9:35GOOGLE WASN'T GOOGLE OVERNIGHT...
- 11:05EXPONENTIAL GROWTH FEELS SLOW AT FIRST
- 11:42ITERATE ITERATE ITERATE
- 12:10USER TRUST ABOVE ALL ELSE
- 12:20FAST, EASY DEVELOPMENT
- 12:32QUIET ON-CALL
- 13:40EMPOWERMENT AND AUTOMATION
- 14:10AVAILABILITY AND SCALABILITY
- 14:48LET'S BE BOWERBIRDS!
- 16:29MAINTAINERSHIP
- 17:28STABILITY
- 17:46PROJECT ECOSYSTEM
- 18:19OUT OF THE BOX
- 18:44DOCUMENTATION
- 21:01REASONABLE GOALS
- 22:23SURVIVING FAILURE
- 22:33CUSTOMER EMPATHY
- 23:17SET EXPECTATIONS
- 23:34(OVER) COMMUNICATE
- 24:09GITLAB DATABASE FAILURE
- 24:50MEASURE SUPPORT PERFORMANCE
- 25:13DISASTER RECOVERY
- 25:42FAULT TOLERANCE HAS COSTS
- 26:01SECURITY
- 27:03DON'T CHECK CREDENTIALS INTO GIT
related talks
30mBowerbirds of Technology: Architecture and Teams at Less-than-Google Scale
38mThe Dark Side of Scale
01h 02mTools for simplified large scale systems
31mRadical Ideas Enterprises Can Learn From The Cloud
31mBuilding World Class Ops Teams
14mGrowing pains: Scaling and re-architecting systems under fire
27mTradeoffs on the road to Observability
47mPlatform Team Structures and Concerns