~/talk

Mastering PrivateGPT: Tailoring GenAI for your unique applications

on YouTube 58m
Talkat ODSC East 2023 · 2023-05-09..05-11· [large-language-models, ai-assisted-development]

speakers

name:Iván Martínez Toro
links:none on file
name:Daniel Gallego Vico
links:none on file

resources

video:https://youtu.be/fpS86IlxK5o
slides:none on file

summary

PrivateGPT is an open‑source GenAI framework with ~52k GitHub stars, ~55 contributors and a ~4k Discord community that ships a usable API, a PrivateGPT Python SDK, a Gradio UI and an in‑docs playground. It supports local LLMs (llama.cpp, Llama 3 8B), remote providers like the AMA provider or SageMaker, per‑page document IDs for ingestion, vector storage in Postgres and runtime switching via settings.yaml profiles. The system works end‑to‑end; CPUs are painfully slow but GPU/SageMaker setups return fast, source‑linked answers.

AI-written summary · about

chapters (6)

  1. 0:00Intro
  2. 3:53Module 1: Exploring Private GPT’s API & Python SDK
  3. 19:25Questions about the APT & SDK
  4. 22:46Module 2: Configure PrivateGPT for diverse setups
  5. 36:30Questions about configurability?
  6. 37:59Module 3: Bring your own RAG

related talks

~/search
type to search 6,249 conferences, 138,987 speakers and 185,172 talks
~/help
cmdctrl k
search every conference, speaker and series
/
focus the filter search
h
home
c
conferences
s
speakers
e
series
t
light / dark — the status bar button does the same
?
this help
esc
close this, then clear every filter — or just the search, while you are typing in it

Ignored while you are typing. Pages without a filter rail have no search to focus.