Bringing 3D Content to your iOS Application
summary
Creates usable 3D assets from phone photos using Photogrammetry API or on-device capture with Object Capture, requiring roughly 30–40 photos and a Mac M‑series or iOS 17 pipeline, then converts and bakes textures into USDZ/USDC with base color, metallic and normal maps; warns about axis and origin mismatches, recommends SceneKit for backward compatibility or RealityKit (iOS 18) for SwiftUI/AR, shows dynamic PBR materials, remote model loading, particle emitters and camera controls, and notes hand tracking is not available on iOS.
AI-written summary · about
chapters (11)
- 0:003D content in iOS apps
- 1:06Challenges with 3D assets
- 3:58Preparing 3D assets
- 7:323D models with photogrammetry
- 13:03Textures materials and formats
- 14:29SceneKit vs RealityKit
- 15:54RealityKit 3D content
- 18:47Interactivity with gestures
- 20:533D in AR experiences
- 22:00Recap and conclusion
- 23:28Q&A
related talks
23mBring life to your iOS Application with 3D content using RealityKit
37miOS 11 and ARKit at a glance
18mUpdate Your Reality with Vision and ARKit
53mAugmented Reality - ARKit framework showcase
32mARKit: Augmented Reality Made Simple
37mThe JPEG of 3D: Bringing 3D scenes and objects into your 2D Android app with glTF
53mThe Application of Apple Vision Pro Spatial Computing in Social Aspects
36miOS to visionOS: How to prepare your app for the future