UE4 Pixel Streaming
summary
Unreal Engine includes a Pixel Streaming Plugin (shipping in 4.21) that encodes the UE4 backbuffer with NVIDIA NVENC to H.264, sends video/audio via WebRTC, and uses a node.js signaling server plus optional STUN/TURN. It claims interactive latency under 100 ms (local ~50 ms) and supports up to 4K 60 FPS if GPU allows; audio uses Opus and inputs/JSON messages travel back over a WebRTC data channel. Current limits: Windows + NVIDIA only, proxy is separate, and multi-user input contention is unresolved.
AI-written summary · about
chapters (16)
- 0:00Intro
- 0:15What is Pixel Streaming
- 1:04Pixel Streaming in UE4
- 2:04Benefits
- 3:32Example Use Cases
- 5:25Technologies
- 7:43Components
- 9:19Connections
- 16:24Bandwidth Adaptation
- 18:19Input
- 19:46Customization
- 21:56Custom HTML
- 23:28Custom JavaScript
- 25:48Limitations
- 27:13Potential Improvements
- 30:40Further Information
related talks
10m4.26 Presentation
19mCloud Streaming in Metaverse
27mFireside Chat With deadmau5 | Exploring Music's New Digital Reality
46mMixing the Real and Unreal: The Future of XR in UE4
17mHolographic Video Calling
36mReal-Time Control of Special Effects Hardware Through Unreal Engine
18mPeer-to-peer Syncing and Live Editing of Shared Virtual 3D Spaces
12mHolographic video calling