~/talk

Building generative AI–enriched applications with AWS & MongoDB Atlas

Talkat AWS re:Invent 2023 · 2023-11-27..12-01· [large-language-models, databases]
name:Ben Flast
links:none on file
links:none on file
slides:none on file

MongoDB Atlas demonstrates a practical RAG pipeline using Atlas Vector Search plus integrations with LlamaIndex, LangChain and Semantic Kernel, exposing a $vectorSearch stage, numCandidates tuning and an HNSW index to trade recall for millisecond latency (authors recommend ~10–20:1 candidates:limit). Change streams keep indexes synced, Atlas manages hosting across 100+ regions, and dedicated Search Nodes (2–32, memory-optimized) separate search from OLTP so large vector indexes fit in memory and perform at scale.

AI-written summary · about

  1. 0:00Introduction to vector search
  2. 1:14Fundamentals of vectors
  3. 8:07Evolution of embedding models
  4. 9:36Implementing Atlas search
  5. 14:24Retrieval augmented generation
  6. 17:44Architecture and challenges
  7. 21:03Scaling with search nodes
~/search
type to search 6,249 conferences, 138,987 speakers and 185,172 talks
~/help
cmdctrl k
search every conference, speaker and series
/
focus the filter search
h
home
c
conferences
s
speakers
e
series
t
light / dark — the status bar button does the same
?
this help
esc
close this, then clear every filter — or just the search, while you are typing in it

Ignored while you are typing. Pages without a filter rail have no search to focus.