Log Story Short: Chopping Through Forests Of Data
summary
Monitoring developer error logs yields real vulnerabilities not just noise — a year-long program at Wix parses 5,000 microservices and ~130 TB of logs with a cheap pre‑processor and a vendor‑neutral internal lightweight rule engine that flags stack traces and runtime exceptions. Results: many critical bugs found in production, SQLi alerts convert to real vuln ~24% of the time, SSDI alerts are ~100% actionable, ingestion runs at tens of terabytes per day and the system materially reduces blind spots without heavy licensing costs.
AI-written summary · about
chapters (11)
- 0:00Introduction to log security
- 2:14Analyzing application errors
- 4:36Log architecture and flow
- 7:11Identifying attack signatures
- 12:38Detection methodology demo
- 15:53Benefits and limitations
- 18:22Lessons learned at scale
- 22:05Tooling and false positives
- 24:24Impact and detection success
- 27:21Future goals and collaboration
- 30:41Conclusion and Q&A
related talks
45mWix’s layered security strategy to discover & protect sensitive data
33mFrom Chaos to Calm: Vulnerability Management for a Dynamic, Sprawling Technology Estate
12mUnlocking the Secrets of Client Data
16mPerformance improvements: exposing hidden security fixes in Open Source
53mWhere The Wild Things Are: The State Of Open Source Supply Chain Risk Management In Three Stories
43mThe Dangers of Being Overly-Paranoid
47mReal Time Vulnerability Alerting
46mLearning security monitoring through failure