Assessing Vendor AI Claims like a Data Scientist, Even if You Aren't One
summary
Practical methods for non-data-scientists to evaluate vendor AI claims by examining concrete elements: the sources and quality of training data, machine-learning evaluation techniques, level of scientific openness, how vendors disclose and test weaknesses, and the overall detection architectures they use. Examples focus on what to look for so buyers can distinguish well-founded AI solutions from marketing hype.
AI-written summary · about
related talks
49mHype and Reality: How to Evaluate AI/ML in Cybersecurity
50mIs AI right for me?
26mHow can I trust you AI and the leap of faith
39mDefensible Application Security for the Artificial Intelligence Era
50mRealities & Misconceptions about Enterprise Applications of AI/ML and Data
21mAlgorithms at Scale: Raising Awareness on Latent Inequities in Our Data
31mSecuring the Future: Navigating AI Vulnerabilities and Evolving Security Practices
27mHow can we use AI to bring new value to the business