Beware the Bot Armies! Protecting RTC User Experience Using Simulations
summary
Meta describes two simulation systems: Newton deterministic simulated clock compresses time by replacing real clocks and task queues so a 10‑minute call can run in ~1 minute while seeded RNGs make packet loss and delays reproducible; Collagen real clients real networks runs thousands of real-time bots across real networks and hardware to exercise full stack. Teams run 5k–20k calls, simulate 50–70 participant meetings, catch an infrequent deadlock, and use source‑code bisect over aggregated metrics to pinpoint regressions.
AI-written summary · about
chapters (13)
- 0:00Intro
- 1:06How did you get to be here
- 2:36Why simulate
- 8:06Newton
- 12:13Benefits of Newton
- 12:51Authoring
- 14:28UI
- 15:53Challenges
- 17:36Keys to Success
- 19:13Large Calls
- 20:00Collagen Monitor
- 20:52Source Code Bisector
- 23:00What we learned
related talks
01h 00mRock ‘Em Sock ‘Em Robots: Bot Swatting Like the Pros
15mREAL: Emulating Control Plane at Simulator’s Cost
26mSimulant in Anger
36mSimulating the Chaos of Real-World Networks for Resilient Applications
40mTesting Distributed Systems w/ Deterministic Simulation
45mAutomated Tests in World of Tanks: bots-net to Test Quality
48mWho’s in control: Human or Machine?
17mChaos Testing for Chatbots: Simulating Customers to Evaluate AI Agents