~/talk

AI's Bitter Lesson for SOCs: Let Machines Be Machines

Talkat BSidesSF 2025 · 2025-04-26..04-27· [security, large-language-models]
links:none on file
links:none on file
slides:none on file

Anthropic experiments show that letting models "cook" rather than rigidly imitating analyst workflows finds novel strategies and scales: a prototype investigation platform called Clue (Claude Links Useful Evidence) is built in just over three months using Claude, Cloud Code, MCP tools, a query tool, external memory and simple storage buckets, it generates triage reports and full investigation transcripts (demos finish in ~2.5 minutes), batches handle 100x low-confidence signals, and costs run about per-alert cost $0.20–$1.

AI-written summary · about

  1. 0:00Introduction to talk
  2. 1:09Current state of SOCs
  3. 4:00The bitter lesson explained
  4. 6:30Applying bitter lesson to SOCs
  5. 8:55Tooling requirements for AI integration
  6. 10:18Leveraging coding assistants
  7. 13:52Tools and MCP servers
  8. 15:36External memory for models
  9. 17:45Building collaborative triage platform
  10. 19:32Introducing Clue system
  11. 22:27Prompt design and tools
  12. 24:17Investigation process details
  13. 26:48Verification and transparency
  14. 27:31Batch processing and meta analysis
  15. 29:41Investigative UI demo
  16. 33:08Future applications and goals
  17. 34:10Encouragement to experiment
  18. 35:13Q&A session
~/search
type to search 6,249 conferences, 138,987 speakers and 185,172 talks
~/help
cmdctrl k
search every conference, speaker and series
/
focus the filter search
h
home
c
conferences
s
speakers
e
series
t
light / dark — the status bar button does the same
?
this help
esc
close this, then clear every filter — or just the search, while you are typing in it

Ignored while you are typing. Pages without a filter rail have no search to focus.