~/talk

How to Decipher User Uncertainty with GenAI and Vector Search

Talkat hayaData 2024 · on Tuesday, 2024-09-24· [ai-assisted-development]

Shows how BERT and GPT embeddings plus vector indexes turn vague queries into semantic matches, not keyword hits, and compares distance metrics (Euclidean, cosine, Manhattan, dot product) by use case. Describes a concrete build: a serverless function returning 5 of 35 blog posts in ~1–2s using a vector index hosted on a free 10 GB tier and RAG to reduce hallucination. Notes a production example: Sherlock: 50 ms fraud detection for 12M users.

AI-written summary · about

  1. 0:00Introduction and setup
  2. 2:14Problem with traditional search
  3. 5:06What are vector embeddings
  4. 8:14Neural networks and embeddings
  5. 11:30Vector search and closeness
  6. 13:18Measuring vector similarity
  7. 17:10When to use vector search
  8. 20:04Chatbots and hallucinations
  9. 21:31Retrieval augmented generation
  10. 22:34Use cases for vector search
  11. 23:42Real-time fraud detection
  12. 25:10Example with personal blog
  13. 28:20Building your own demo
  14. 29:02Book announcement and closing
~/search
type to search 6,249 conferences, 138,987 speakers and 185,172 talks
~/help
cmdctrl k
search every conference, speaker and series
/
focus the filter search
h
home
c
conferences
s
speakers
e
series
t
light / dark — the status bar button does the same
?
this help
esc
close this, then clear every filter — or just the search, while you are typing in it

Ignored while you are typing. Pages without a filter rail have no search to focus.