Building an AI-Powered Personal Companion Mobile App
summary
Builds a working cross‑platform food allergy assistant with .NET MAUI that sends chat and multimodal requests to models deployed in Microsoft/Azure Foundry, uses Microsoft Extensions AI as the chat client abstraction, and swaps between cloud and local runtimes (ONNX/Apple Intelligence). The demo wires geolocation, MediaPicker, plugin.maui.audio for voice, and an audio transcription model (Whisper/OpenAI) plus image attachments to extract menu text and flag sesame risk — it runs on Windows and Android and produces actionable allergy warnings.
AI-written summary · about
chapters (15)
- 0:00Introduction
- 3:30Building AI companion app
- 14:20What is .NET MAUI
- 16:02.NET AI integration
- 23:01Demo: Food allergy assistant
- 31:11Code: Text AI interaction
- 36:04Demo: Voice AI interaction
- 40:19Code: Voice input processing
- 43:05Demo: Image AI interaction
- 46:17Code: Image analysis for allergens
- 50:50Local AI models and data
- 51:52Microsoft Extensions AI for MAUI
- 54:40Advanced AI: Exporting functions
- 57:50Future of AI in mobile apps
- 58:32Closing remarks
related talks
47mBoost Your Mobile Apps with Machine Learning and NativeScript
34mBuilding mobile applications with .NET Xamarin
01h 03mZero to Mobile Hero - Intro to Xamarin and Visual Studio Team Services
01h 16mBuilding Mobile and Desktop Apps with VS and .NET MAUI
49mPanel Discussion: AI in Mobile QA - What Actually Works Today?
37mGet started building mobile & desktop apps with .NET
19mHow I Learned React Native with AI
01h 00mReal-Time Connected Apps with .NET MAUI, Blazor and SignalR