Rewind capture format on IG Stories
summary
Built pinned stickers that follow tracked regions in video using a native C++ region tracking C++ lib from Facebook applied machine learning, decoding frames with MediaExtractor/MediaCodec and pulling pixels via GL readPixels bottleneck so tracking runs in background. Feature is gated to API level 18+ gate for reliability. Rewind (reverse) is implemented as a pre‑capture format by stacking frames, overlapping reverse encoding with forward recording, stitching short reversed clips with FF Concat, and reversing 16‑bit PCM audio in memory.
AI-written summary · about
chapters (5)
- 0:00Introduction to creative tools
- 2:28Sticker pinning feature
- 10:17Region tracking implementation
- 17:29Rewind format creation
- 22:22Conclusion and Q&A
related talks
47mRewind and Resolve: A deep dive into building Session Replay for Android
43mWhen MediaProjection Isn't Enough
18mBe Kind, Rewind
38mCrafting delightful Camera & Media experiences
43mHigh performance video editing for the mobile web
20mView-Dependent Video Textures for 360° Video
23mCreating Videos Programmatically in React
26mThe art of programmatic videos with Rust