We Kept Rebuilding Our AI Agent. Here's What Survived
summary
An in-product agent called Alex evolves from a 2023 prototype with ~50% hallucination to a single agent by June 2026 using only custom harness code (no agent framework), moving the plan into the harness, enforcing an explicit finish call, treating large tool outputs as files and truncating JSON with JQ, and replacing 10 specialists by on-demand skills; a single 8,000-character memory file per user outperforms vectors and graphs, Sonar 4.5 serves as default, and production sessions become living tests.
AI-written summary · about
chapters (13)
- 0:00Intro
- 0:53Agents all the way down
- 2:56What Alex does
- 4:15Timeline: 2023 to 2026
- 6:19Who owns the plan?
- 8:33What ends a turn?
- 9:44Memory: treat big results like files
- 12:10One small file beat a knowledge graph
- 13:33Specialists vs. one agent
- 14:13The newest model isn't always best
- 15:28Production sessions as tests
- 17:46What still needs a human
- 18:31What survived every rebuild
