Coding a drone using .NET & ChatGPT AI and flying it in mixed reality
summary
Build uses Unity 3D, .NET 8, MRTK and a UDP client-server stack to send Tello command strings and read state and video; ChatGPT generates and iterates the C# UDP code while Azure AI contributes higher-level drone behaviors. The project implements SDK mode, continuous receive loop to handle UDP packet loss, a hand-driven HoloLens UI, and a live demo that successfully flies a DJI Tello (video feed and a flip) in Alexanderplatz. UDP client-server commands ChatGPT-assisted C# UDP script Tello drone flown from HoloLens at Alexanderplatz
AI-written summary · about
chapters (6)
- 0:00Intro
- 1:39Tools and project introduction
- 8:48What is mixed reality and HoloLens
- 15:54Building the project
- 27:00Project demo
- 28:45Outro
related talks
52mFlying services with a drone
48mFlying services with a drone
18mGridDrones: A Self-Levitating Physical Voxel Lattice for Interactive 3D Surface Deformations
08mHow to control drones with your mind: The Black Swan BCI headset
45m(Deep) Learning to Fly
45mTutorial: Building a Drone, From Scratch
21mVisualizing robot minds, and other fun stuff
16mThird-Person Piloting: Increasing Situational Awareness using a Spatially Coupled Second Drone