~/talk

RAG Q and A with Bedrock and Astra - Who died in Romeo and Juliet?

Talkat Cassandra Summit 2023 · on Tuesday, 2023-12-12· [ai-assisted-development, databases]
slides:none on file

Builds a working RAG pipeline that loads 321 lines (one line per document) from Act 5 Scene 3 into a vector store and answers “who died” using embeddings and an LLM. Uses Amazon Bedrock (Titan embeddings for vectors, then Anthropic Claude for completion) with DataStax AstraDB as a real‑time Cassandra vector database, LangChain/Casio glue, and a Jupyter notebook. Demo succeeds; model choice changes answers, and internal tests claim up to 18x (and ~4x) performance gains versus competitors.

AI-written summary · about

  1. 0:00RAG with Bedrock and Astra
  2. 1:46Amazon Bedrock and Astra
  3. 3:59Vector databases in RAG
  4. 6:49Building RAG demo steps
  5. 8:56Python environment setup
  6. 11:55Astra and AWS credentials
  7. 13:12Vector store for Shakespeare
  8. 15:51Prompt design for answers
  9. 17:17RAG query and results
  10. 18:41Q&A Astra and Cassandra 5.0
  11. 20:50Astra DB benefits
  12. 24:33Astra DB vs vector DBs
  13. 26:00Vector and non-vector tables
  14. 28:18RAG accuracy challenges
  15. 29:23Closing and resources
~/search
type to search 6,249 conferences, 138,987 speakers and 185,172 talks
~/help
cmdctrl k
search every conference, speaker and series
/
focus the filter search
h
home
c
conferences
s
speakers
e
series
t
light / dark — the status bar button does the same
?
this help
esc
close this, then clear every filter — or just the search, while you are typing in it

Ignored while you are typing. Pages without a filter rail have no search to focus.