~/talk

Gain full control of your apps with Open-Source AI

Talkat dotAI 2024 · 2024-10-17..10-18· [large-language-models, open-source]
slides:none on file

Claim: smaller open-source models often outcompete larger proprietary ones when distilled, fine-tuned and served with modern tooling. Evidence: Zier 7B hits top benchmarks despite 7B size; Hugging Face hosts ~140k text‑generation models and >1M total models; community labeling projects add 10k–22k examples with hundreds of contributors. Tools and results: Transformers + PEFT + quant libraries like bitsandbytes and GPTQ/AWQ plus text-generation-inference enable quantized, merged, edge-deployable models that actually run and cut inference cost.

AI-written summary · about

  1. 0:00Open source AI importance
  2. 3:11Data quality vs model size
  3. 8:13Open source AI models
  4. 11:21Open-source progress examples
  5. 13:52Control and privacy with AI
  6. 16:21AI model deployment tools
  7. 19:56Fine-tuning with Transformers
  8. 22:10Parameter-efficient fine-tuning
  9. 23:34Quantization and optimization
  10. 24:38Let's build together
~/search
type to search 6,249 conferences, 138,987 speakers and 185,172 talks
~/help
cmdctrl k
search every conference, speaker and series
/
focus the filter search
h
home
c
conferences
s
speakers
e
series
t
light / dark — the status bar button does the same
?
this help
esc
close this, then clear every filter — or just the search, while you are typing in it

Ignored while you are typing. Pages without a filter rail have no search to focus.