~/talk

AI Assisted Decision Making of Security Review Needs for New Features

Talkat Black Hat USA 2023 · 2023-08-05..08-10· [security, developer-experience]
links:none on file
links:none on file
slides:none on file

Claim: natural language processing plus deep learning reliably flags which new features need security review. Implementation uses Apache Spark and Spark NLP, builds 300‑dimension word embeddings from project Jira/PRD text, compresses to a fixed 1,000‑word input and feeds a convolutional network. Early TF models hit 63–71% (ensemble 78%); the final model (clairo) reaches about 98% accuracy on ~700 test items and flags ~119 of ~800 features for review.

AI-written summary · about

  1. 0:00Introduction
  2. 1:09Security review bottlenecks in agile
  3. 3:35Security review decisions as automation
  4. 5:22Engineering vs spoken English
  5. 7:06Machine learning basics for classification
  6. 10:37First security review classifier attempt
  7. 15:35Term frequency and neural limits
  8. 16:37Unsupervised learning and conv nets
  9. 18:45Clo and Spark NLP implementation
  10. 24:46Model evaluation 98% accuracy
  11. 25:49Deploying model for real-world use
  12. 29:43Key takeaways and future of AI
  13. 31:06Q&A
~/search
type to search 6,249 conferences, 138,987 speakers and 185,172 talks
~/help
cmdctrl k
search every conference, speaker and series
/
focus the filter search
h
home
c
conferences
s
speakers
e
series
t
light / dark — the status bar button does the same
?
this help
esc
close this, then clear every filter — or just the search, while you are typing in it

Ignored while you are typing. Pages without a filter rail have no search to focus.