Consolidation in Benchmarking, Optimization, and Ecosystem Collaboration for AI ASICs
Talkat KubeCon + CloudNativeCon + Open Source Summit China 2023 · on Wednesday, 2023-09-27· at 15:50· 3层 307会议室| 3F Room 307·
summary
ByteMLPerf is a benchmarking and evaluation toolkit ByteDance built to simplify adopting AI ASICs by IT teams. It integrates compilation as a first-class API, aligns models and runtimes to real-world use cases, and exposes a wide set of metrics so benchmarking, optimization, and reproducible evaluation across software and hardware can be done consistently. The compilation backend focuses on extracting maximum performance per model to better leverage ASIC capabilities.
AI-written summary · about
related talks
29mBenchmarking GenAI Like a Pro: Scaling Experiments, Predicting Performance, and Keeping Your Sanity
16mBenchmarks Are Memes: How What We Measure Shapes AI—and Us
23mThe Art & Science of Benchmarking Agents
14mAI That Moves Business. Cloud That Scales
21mAhead of the Plasticity Curve: AI, Biology and Technology
17mAI That Powers Experiences
22mAI @Scale
32mBuilding Once, Running Everywhere: The Future of Portable AI Applications