SecureAI: A Scalable, Secure, and Compliant AI Solution
summary
SecureAI is an on‑prem GenAI stack that ingests IMAP, files and buckets, pipelines data with Apache NiFi, stores vector embeddings in OpenSearch + vector embeddings, and runs local LLM inference via Helix/AMA. Front end is React + TypeScript with novice/pro/admin views. Retrieval‑Augmented Generation, context‑aware index switching and tool triggers power demos that successfully pulled unpaid invoices and candidate CVs. Team builds processors and claims a big quality jump from last year’s ~33% hit rate to a production system.
AI-written summary · about
chapters (7)
- 0:00Introduction and team
- 3:33Problem and mission
- 7:45Secure AI overview
- 9:55Frontend demo
- 12:33Backend architecture
- 20:38Full system demo
- 26:47Q&A and conclusion
related talks
18mHow to protect generative AI models using GenAI Secure
29mOpen Source Sovereign AI: Building Enterprise GenAI Platforms for Control & Comp...
09mGen AI for regulated industries
40mBuilding secure and efficient AI solutions in Azure with Partners
49mSpring AI: Seamlessly Integrating AI into Your Enterprise Java Applications
02h 35mBringing GenAI to the Modern Enterprise. A production use-case. In Serverless Java!
22mAI
28mAI for Everything After Code