Bringing real-time 3D to mobile at SpaceX
summary
SpaceX ships a Starlink app that uses Expo, react‑native, three.js and react‑three-fiber plus TensorFlow.js on-device to deliver real-time 3D features for over 3 million users and a 6,000‑satellite network. The app implements a Skyscanner obstruction map by scanning camera frames, running a trained model on-device, converting the output to a 3D texture and masking by terminal FOV. It also renders a 3D network topology canvas with live beam coloring, actuated dish tilt, smooth camera orbit transitions and a working Mars mode Easter egg.
AI-written summary · about
chapters (11)
- 0:00Introduction to SpaceX
- 1:40Starlink overview
- 3:00Technical challenges
- 4:25Skyscanner tool
- 5:37Building Skyscanner
- 7:25Designing the 3D app
- 9:41Engaging UI features
- 11:01Implementation details
- 12:52Seamless navigation
- 14:29Camera controls
- 17:30Lessons and future work
related talks
27m3D graphics in React & React Native using React-three-fiber
10m3D Experiences in React Native With Expo-GL
26mUsing lit APIs to make dope games with Expo
22mBuild 3d experiences using Jetpack XR
20m3D and Canvas-Based Animations with Reanimated
33mReact360 - 2D to 3D- 22mBuild 3d experiences using Jetpack XR
37mThe JPEG of 3D: Bringing 3D scenes and objects into your 2D Android app with glTF