Integrated AI and Enterprise Intelligence with LLMs and RAG
summary
Small-company audit software integrates a self-hosted LLM plus RAG so data never leaves customer infrastructure, using self-hosted Llama 8B (customer 70B option) and RAG with Chroma embeddings. The system auto-ingests PDFs/Word/Excel, builds searchable racks, and generates structured audit work programs in seconds with 60–70% accuracy proposals so auditors edit rather than start from scratch. Admin UI enforces role-based data access and compliance. Real deployment: 600 auditors × 15–20 audits each, and a corpus of ~43,000 Word, ~990,000 PDF, ~120,000 Excel files.
AI-written summary · about
chapters (9)
- 0:00Integrated AI in enterprise
- 1:56AI hype fading needs
- 3:47Enterprise Intelligence for auditors
- 5:12LLM integration use cases
- 10:57Live demo: AI audit proposals
- 14:15Transparent chat interface
- 16:09AI platform features
- 18:58Compliance and data security
- 19:45AI platform multi-use
related talks
40mRolling out Enterprise AI: Tools, Insights, & Team Empowerment
29mThe Future of AI Assistants
39mAgentic RAG Platform for AI-Assisted Workflows
10mKeynote: Unlocking Corporate Data with Retrieval-Augmented Generation
40mPractical Lessons from Deploying AI Assistants Based on LLMs
32mCybersecurity meets Generative AI: Automating Your Compliance...
11mBuilding easily deployable RAG applications with Llamastack
18mLLMs and GenAI: A Guide to Building Your Own RAG Model for Document Interaction