The Real Black Friday aka How To Scale an Unscalable Service

on YouTube ↗28m

" summary

A Ruby on Rails marketing analytics app that sends 7 billion emails/month hits massive timeouts on Black Friday: two web servers, a 5‑minute request timeout, and an automation client firing 2,000 long‑running requests/day block the UI. Emergency fixes increase timeout and add a unique request constraint to stop duplicates, then Puppet‑managed servers replace manual infra, processes split into web vs background workers, and features roll out via dark launches with monitoring — the changes stop the outages and survive the season.

AI-written summary · about

" chapters (7)

1. 0:00Introduction
2. 3:35QualityMarcoms and email marketing
3. 7:10Pre-Black Friday system state
4. 9:21Hotfix phase during crisis
5. 17:43Infrastructure fixes
6. 22:59Code refactoring and dark launches
7. 26:55Key takeaways and conclusion

" related talks

• 37mScaling Rails for Black Friday and Cyber MondayChristian Joudrey · RailsConf 2015
• 35mSurviving Black Friday: Tales from an e-Commerce EngineerAaron Suggs · PAYMENTSfn 2019
• 44mIntroduction to application scalingLiam Wiltshire · PHP UK Conference 2017
• 41mHow Shopify Scales RailsJohn Duff · Big Ruby 2013
• 35mHow to Survive Black Friday: Preparing e‑commerce for Peak SeasonYurii Panaiotov · Highload fwdays'25
• 31mA Rails performance guidebook: from 0 to 1B requests/dayCristian Planas · RubyConf TH 2022
• 42mBlack Friday Brilliance: Managing a Billion Transactions with Tech, Tactics, and TeamworkJ.Coleman · Voxxed Days Thessaloniki 2025
• 31mA RAILS PERFORMANCE GUIDEBOOKCristian Planas · Euruko 2023