Building AI Apps That Don't Break: Architecture Lessons from HappyFox
summary
HappyFox describes concrete engineering choices: a production AI suite (chatbot, copilot chat, writing assistant, ticket summary, KB draft) used by ~12,000 customers and built to preserve factuality and speed. Architecture moves from simple RAG to an agentic multi-agent workflow that decomposes tasks, uses smaller models (switched to Claude 3 / 3.5 Haiku from Sonnet/Opus) to cut latency and cost, adds metadata-based search during ingestion to avoid wrong retrievals, and implements prompt caching, role-based tool access, and redaction/anonymization for PII.
AI-written summary · about
