Kathleen Walker, Elastic & Sujith Joseph, Cisco Systems | Google Cloud Next 2023
summary
Elastic ships a pre-trained semantic model so teams can get semantic search without training, and Elastic acts as an intermediary to send only authorized context to LLMs. Cisco migrates enterprise search to Elastic on GCP with Spark-based connectors, GCS, GKE, Dataflow and regional Kubernetes indexes, tuning inference with Triton for low latency. The platform handles ~50 million documents, uses RAG, chunking and question-generation, and goes live after six months from POC to production.
AI-written summary · about
