AI Lab Recipes: Cooking up AI Applications on your Laptop
summary
Open-source GitHub repo ai-lab-recipes packages containerized AI apps so a developer can spin up a local code generation assistant in two commands using the podman AI lab desktop extension. It treats the model as a microservice (UBI images, model mounted by volume), runs llama.cpp/Mistral-style models locally (no cloud), and demos show chatbot and RAG workflows working on CPU (130,000 Hugging Face LM options curated). GPU-on-Mac support is experimental but available.
AI-written summary · about
chapters (13)
- 0:00AI Lab Recipes intro
- 3:19Open-source AI models rise
- 7:50Run AI locally why
- 11:21Design principles
- 14:16Core architecture
- 19:11Demo setup overview
- 22:24Deploy chatbot with Podman
- 25:39Developing AI recipes
- 30:38RAG demo with documents
- 32:04Summary and call to action
- 32:35Q&A: Remote servers & Kubernetes
- 34:29Q&A: Adding AI apps
- 35:55Q&A: Model server APIs
related talks
29mPodman AI Lab: For developers to build AI Applications with LLMs running locally
26mWelcome to the AI Jungle! Now What?
45mWelcome to the AI jungle! Now what?
35mFrom InstructLab and Podman AI Lab to OpenShift AI: Simplifying LLM workflows
35mRamaLama: Running AI Models in Containers.
46mThe AI-Powered Developer
30mDeveloper Productivity for GenAI Apps
07mKeynote: Accelerating GenAI Adoption with Containers: Unleashing AI/ML Development...
