Holographic Telepresence with Hololens

on YouTube ↗40m

" summary

A working prototype streams RGB/depth and audio from one or two to three Kinects into Unity and pushes a live voxel video texture to a Microsoft HoloLens over the Windows Mixed Reality stack to create a person-sized hologram in near‑field. The build uses Unity scripts and built‑in gesture/look recognition, shows real-time positional alignment, but suffers limited HoloLens field of view, occasional tracking drift and intermittent demo failures during the live call.

AI-written summary · about

" chapters (10)

1. 0:00Introduction to holographic telepresence
2. 6:15Holograms in mixed reality
3. 9:37Augmented reality hardware overview
4. 14:22Microsoft Mixed Reality platform
5. 17:48Limitations of HoloLens
6. 20:28Live hologram demo
7. 22:19Unity prototype development
8. 27:38Windows Mixed Reality tools
9. 30:37Live telepresence call demo
10. 34:46Challenges and future outlook

" related talks

• 27mHoloportation: Virtual 3D Teleportation in Real-timeAdarsh Kowdle, Pushmeet Kohli, Vivek Pradeep, David Kim, Sarah Mennicken, Sean Fanello, Shahram Izadi, Cem Keskin, Christoph Rhemann, Sergio Orts-Escolano, Wayne Chang, Yury Degtyarev, Philip L Davidson, Sameh Khamis, Mingsong Dou, Vladimir Tankovich, Charles Loop, Qin Cai, Philip A Chou, Julien Valentin, Shenlong Wang, Sing Bing Kang, Yuliya Lutchyn · UIST 2016
• 01h 01mHolographic Programming – Exploring the HoloLensLars Klint · NDC Sydney 2016
• 50mDeveloping for Mixed Reality with HoloLensRafał Legiędź · Build Stuff 2017
• 55mHolo world - Create your first HoloLens app with UnityJimmy Engström · NDC Sydney 2018
• 22mBlood, Sweat and HololensAndrei Cravtov · Games Gathering Bratislava 2022
• 46mHoloLens 301: Advanced Mixed Reality Development and Best PracticesRene Shulte · Oredev 2017
• 01h 05mChasing holograms - the future of HoloLens developmentScott Leaman · NDC Oslo 2019
• 01h 00mReal World HoloLens Mixed Reality Development with Unity - Be Part of the FutureRene Schulte · NDC Oslo 2016