iPhone Facial Capture with Unreal Engine
summary
Live Link Face on iPhone uses the TrueDepth front camera and ARKit to stream frame-accurate blendshape and head data into Unreal Engine over Live Link, demonstrated working live with Unreal 4.25; recordings produce a per-frame CSV plus a frame‑accurate QuickTime reference with embedded timecode, transferable via AirDrop. It multicasts to multiple machines for low-latency multi‑user workflows, supports NTP or hardware sync via Tentacle Sync over Bluetooth, and accepts remote commands for slate/take and record via OSC using tools like Switchboard.
AI-written summary · about
chapters (18)
- 0:00Introduction
- 2:55Plugins
- 4:07Main Screen
- 8:47Network targets
- 12:30NTP
- 13:23Technical Sync
- 15:05OSC
- 17:12Blend Shape
- 17:50Take Recorder
- 18:28Overlay
- 19:14Reference Video
- 19:37Manual Recording
- 20:55Take Browser
- 22:00iOS Activity View
- 22:36Example Take
- 23:23Example Recording
- 25:10Grand Finale
- 26:53Switchboard
related talks
38mVirtual Production in UE4
43mInto the Deep – or what would the 80s have done with depth sensing technology?
47mIn-Camera VFX with UE4
11mLaunch by Reface
12mConnected by Wonder: When Physical and Virtual Worlds Collide
15mCinematic Lighting with Emotion
09mReal Stories Using Unreal
27mFireside Chat With deadmau5 | Exploring Music's New Digital Reality