Chaos Engineering at Citi Bank

on YouTube ↗08m

" summary

Converts L2 production support into an SRE/citability engineering team and adopts chaos engineering as a core discipline, running monthly production game days with Ansible one‑touch failover to exercise a full datacenter outage and measure thresholds — example: 100 TPS over 30 minutes with a high‑CPU attack invoked at the 10‑minute mark — holds quarterly Wheels of Misfortune role‑plays for incidents and cyber scenarios, integrates Gremlin with OpenShift, uses Chaos Monkey for random instance kills and an in‑house AP Army, and captures automated measurements while working toward automated normalization.

AI-written summary · about

" related talks

• 41mClear the ring for Chaos Engineering at Vertrieb Deutsche Bahn!Maik Figura, Oliver Kracht · Build Stuff 2020
• 18mChaos Engineering: Break It On PurposeMorgan Carter · BSides London 2021
• 52mGetting started with Chaos EngineeringPaul Stack · NDC Sydney 2018
• 57mChaos Engineering PrimerSergiu Bodiu · Voxxed Days Singapore 2017
• 27mChaos Engineering: The Path to ReliabilityKolton Andrus · Chaos Conf 2020
• 48mChaos Engineering: The Path to ReliabilityKolton Andrus · Agile India 2020
• 14mBenefiting from chaos engineering at Capital One (PRT026)Kyle Smith · AWS re:Invent 2022
• 36mChaos EngineeringNikhil Barthwal · Agile India 2018