Matt van Deventer, Trade Me | Splunk .conf2013
summary
Trade Me runs two active‑active New Zealand data centers (Auckland and Wellington) serving about 70 million page impressions and 700,000 visitors per day with 50 developers and 19 infra staff, 40% mobile traffic, and twice‑daily production deploys. Splunk starts as a syslog replacement and evolves into production analytics using the db_connect app to join SQL Server data with web and image logs, helping debug a 300M image catalog (7 uploads/sec, 10k image requests/sec) and mitigate the largest DDoS; value comes from real-time searches.
AI-written summary · about
chapters (14)
- 0:00Introduction and welcome
- 1:14Trade Me's origin story
- 3:20Community and reputation system
- 4:45Infrastructure and scale
- 6:10Splunk journey and adoption
- 8:18Why Splunk excites users
- 9:42Ease of Splunk implementation
- 10:45Mobile growth and future
- 11:48Security and Splunk's role
- 12:31SQL vs NoSQL debate
- 13:55Redis and real-time data
- 14:39Enterprise cloud limitations
- 15:42Splunk in security and threat response
- 16:24Splunk 6 and future plans
