~/talk

Using Postgres + OpenAI to power your AI Recommendation...

Talkat RailsConf 2024 · 2024-05-07..05-09· [databases, large-language-models]
links:none on file
slides:none on file

Claims Postgres alone can run a recommendation engine by storing and querying OpenAI embeddings and avoiding a separate vector DB. Uses Rails + ActiveRecord to call OpenAI embeddings and persist vectors into Postgres + pgvector, performs cosine/ANN search inside the database, and returns low-latency (subsecond) recommendations. Shows a working prototype deployed with batching, client-side and DB caching, index tuning, partitioning and read-replica strategies for scale, and reports cost and latency advantages versus adding an external vector service.

AI-written summary · about

  1. 0:00Introduction
  2. 13:08Setting up Postgres
  3. 24:46Integrating OpenAI
  4. 37:27Building recommendations
  5. 44:20Q&A and closing
~/search
type to search 6,249 conferences, 138,987 speakers and 185,172 talks
~/help
cmdctrl k
search every conference, speaker and series
/
focus the filter search
h
home
c
conferences
s
speakers
e
series
t
light / dark — the status bar button does the same
?
this help
esc
close this, then clear every filter — or just the search, while you are typing in it

Ignored while you are typing. Pages without a filter rail have no search to focus.