SceneSkim: Searching and Browsing Movies Using Synchronized Captions, Scripts and ...
summary
SceneSkim links closed captions, scripts and Wikipedia plot summaries so users can click text to jump to exact movie moments; it scrapes 800 scripts, aligns audio to caption words with a median error of 0.06 seconds, aligns script lines to captions via word-level edit distance matching 81% of caption lines, and links plot-sentence segments to script segments using TF-IDF cosine scoring with accuracy around 53–56%. Evaluations with film scholars find it speeds real queries (e.g., verifying Luke’s costume changes, measuring lightsaber screen time) and supports usable browsing.
AI-written summary · about
chapters (7)
- 0:00Start
- 1:05CHAPTERS
- 6:10Captions to audio alignment Captions
- 8:57Script to captions alignment
- 11:07Plot summary to script alignment
- 13:25Queries from film studies users
- 14:01Related work
related talks
14mRescribe: Authoring and Automatically Editing Audio Descriptions
15mBechdel.io: How We Used JavaScript To Help Make Film More Inclusive
17mStoryPrint: an interactive visualization of stories
41mThe F#orce Awakens
32m"You may also like"
12mCoSight: Exploring Viewer Contributions to Online Video Accessibility Through Descriptive Commenting
21mQuickCut: An Interactive Tool for Editing Narrated Video
20mKnowledge Scout: From Talks and Slides to Smart Summaries