Don't Let the LLM Drive
summary
Ace is a production voice tutor that runs full lessons reliably by moving control out of the LLM into a harness that enforces a small state machine and validates every step. The system uses state machine: intro, teach, check, grade, advance, wrap and swaps a heavyweight Opus 4.7 Cloud for Haiku 4.5 rather than Opus 4.7 Cloud to cut cost latency and still meet quality. The harness ignores skipped steps, checks completion signals, and logs failures for recovery; lesson runtime is seven minutes. Ace voice tutor in production
AI-written summary · about
related talks
17mBuilding Effective Voice Agents
19mLLM codegen fails and how to stop 'em
27mThe Lean LLM development playbook
29mLLM-Based Development
01h 39mMastering LLMs: From Prompt Engineering to Agentic AI
47mOwn Your LLM: Running Generative and Agentic AI Locally
35mEvaluating LLM systems: the nuts and bolts
01h 28mStoopid Questions - about learning, teaching and AI