When your Twin is Digital. And in 3D
summary
Walks through concrete builds: a Unity scene desert simulator with a physics-driven tumbleweed, a custom Apollo cockpit simulator, and a physical RC vessel instrumented with an ESP32 and gyros. Connects sensors over MQTT and WebSockets to Azure IoT Hub, Kafka and an event-driven Dolittle backend, retrains models in the cloud and pushes updates for on-edge inference. Uses Unity3D for real-time rendering and HoloLens for mixed reality; the boat demo partly fails on stage but the architecture and ML-informed trim predictions are real.
AI-written summary · about
chapters (6)
- 0:00Introduction to digital twins
- 2:31Defining digital twin systems
- 9:42Background and personal projects
- 15:25Building a desert simulator
- 34:41Real-world vessel case study
- 46:17Modern interaction models
related talks
30mDigital twins for sustainability
23mFuture of User Interaction: Mixed Reality, AI and IoT
46mShift Right Into the Metaverse With Digital Twin Testing
28mThe Next Phase of IoT - Information and Visualization with Digital Twins
33mMixed Reality for Social Good
01h 00mReal World HoloLens Mixed Reality Development with Unity - Be Part of the Future
41mVirtual-Physical Environment Manipulation System based on ROS
01h 01mSpatial Computing with Azure Mixed Reality, Digital Twins and HoloLens 2