In a Perfect World: Why Media Sources Are a Hassle

on YouTube ↗31m

" summary

Media Source Extensions (MSE) promise adaptive web video but practical workarounds matter: fragmented MP4s and HLS transmuxing expose a recurring gap in buffered ranges that stalls playback; client-side attempts to synthesize silent AAC frames and to encode H.264 in JS fail or are impractical; a pragmatic gap skipper that seeks over tiny gaps proves surprisingly effective; use Chrome media-internals and a file-inspection tool (thumbcoil) to debug MP4/TS serialization and blacklist incompatible renditions to avoid decoder errors.

AI-written summary · about

" chapters (7)

1. 0:00Introduction to MSE
2. 2:11Why use Media Source
3. 6:07Solving continuity issues
4. 10:09Debugging playback
5. 13:22File inspection tools
6. 16:52Error handling strategies
7. 22:14Q&A session

" related talks

• 43mMedia Source ExtensionsJeff Tapper · FITC Web Unleashed 2014
• 50m“The Upside Down” of the web, VideoMáté Nádasdi · jsDay 2018
• 10mA default HLS player for Chrome (and why I hate the robustness principle)Ted Meyer · Demuxed 2025
• 58mModern & secure adaptive streaming on the WebKatarzyna Dusza · CPH DevFest 2024
• 41m“The Upside Down” Of The Web: Video technologiesMáté Nádasdi · Craft Conference 2019
• 30mOther browser APIs that are going to change video on the webSteve Heffernan · Demuxed 2015
• 45mModern & secure adaptive streaming on the WebKatarzyna Dusza · Voxxed Days Trieste 2024
• 11mNon-Standard Codecs With Standard WebRTCBryan Meissner · Demuxed 2019