~/talk

Advanced RAG with Azure AI Search - top questions answered

Talkat Microsoft Build 2024 · 2024-05-21..05-23· [machine-learning]
links:none on file
links:none on file
links:none on file
links:none on file
name:K P Rao
links:none on file
links:none on file
slides:none on file

Azure AI Search shows concrete steps for RAG: new 6–12× SKU capacity lets single SKUs handle far larger workloads, vector quantization cuts vector storage by ~90% while retaining about 90% accuracy, and production deployments hit mid‑millions requests/day (OpenAI use shows 7–8 digit transaction scales). The demo is a patient-facing Tellis chatbot built with Azure Blob/OneLake ingestion, vector search + hybrid semantic ranker fusion, integrated vectorization (preview) and Langfuse observability, and it returns grounded, multilingual answers with citations.

AI-written summary · about

  1. 0:00Introduction to Azure AI
  2. 2:13What is Azure AI Search
  3. 4:45The importance of RAG
  4. 9:18Latest AI search features
  5. 12:36Scaling rag applications
  6. 15:31Improving search accuracy
  7. 18:08Data ingestion and pipeline
  8. 23:03Live healthcare chatbot demo
  9. 28:29Advanced demo functionality
  10. 36:22RAG architecture best practices
  11. 41:50Observability and conclusion
~/search
type to search 6,249 conferences, 138,987 speakers and 185,172 talks
~/help
cmdctrl k
search every conference, speaker and series
/
focus the filter search
h
home
c
conferences
s
speakers
e
series
t
light / dark — the status bar button does the same
?
this help
esc
close this, then clear every filter — or just the search, while you are typing in it

Ignored while you are typing. Pages without a filter rail have no search to focus.