Audio and Video Testing Fundamentals
summary
Testing team runs 150 people across 50+ black box setups including a mobile bus and multidevice rigs, feeds video through an OBS virtual camera with ArUco markers to align frames, and measures VMAF plus a neural net predictor VQTDL alongside POLQA/WAV‑style audio scores. Tests inject 300 kbps limits that cause freezes and pixelation, capture end to end video and audio delay, log CPU/GPU/RAM and battery, and produce time series, API results and slide deck benchmarks.
AI-written summary · about
chapters (15)
- 0:00Introduction to AV testing
- 1:36AV testing benchmarking
- 2:20AV testing services and apps
- 4:32Types of AV quality tests
- 8:26Testing on real devices
- 10:35AV testing process
- 13:50Test setup configurations
- 17:22Video quality metrics
- 23:50Audio quality metrics
- 26:40Network performance analysis
- 29:09Network control simulations
- 31:16Test scenarios and setups
- 33:08Reporting formats
- 35:55Live demo of results
- 41:57Q&A
related talks
39mAutomating Audio Tests? Sounds Good!
19mTesting things that don't want to be tested: A game streaming story
34mTesting Live Video Streams At Scale
39mYou're Testing WHAT?
27mBehind the Curtains: A/B Tests in Video Land
10mThe Colorful Truth of Automated Tests
38mVR Testing - The Testing Trinity
46mEval-First QA Agents: Testing Streaming Platforms