~/talk

AI Lab Recipes: Cooking up AI Applications on your Laptop

Talkat DevConf.US 2024 · 2024-08-14..08-16· [ai-assisted-development, open-source]
links:none on file
slides:none on file

Open-source GitHub repo ai-lab-recipes packages containerized AI apps so a developer can spin up a local code generation assistant in two commands using the podman AI lab desktop extension. It treats the model as a microservice (UBI images, model mounted by volume), runs llama.cpp/Mistral-style models locally (no cloud), and demos show chatbot and RAG workflows working on CPU (130,000 Hugging Face LM options curated). GPU-on-Mac support is experimental but available.

AI-written summary · about

  1. 0:00AI Lab Recipes intro
  2. 3:19Open-source AI models rise
  3. 7:50Run AI locally why
  4. 11:21Design principles
  5. 14:16Core architecture
  6. 19:11Demo setup overview
  7. 22:24Deploy chatbot with Podman
  8. 25:39Developing AI recipes
  9. 30:38RAG demo with documents
  10. 32:04Summary and call to action
  11. 32:35Q&A: Remote servers & Kubernetes
  12. 34:29Q&A: Adding AI apps
  13. 35:55Q&A: Model server APIs
~/search
type to search 6,249 conferences, 138,987 speakers and 185,172 talks
~/help
cmdctrl k
search every conference, speaker and series
/
focus the filter search
h
home
c
conferences
s
speakers
e
series
t
light / dark — the status bar button does the same
?
this help
esc
close this, then clear every filter — or just the search, while you are typing in it

Ignored while you are typing. Pages without a filter rail have no search to focus.