~/talk

Distributing big AI models in mobile apps

Talkat droidcon San Francisco 2024 · 2024-06-06..06-07· [large-language-models]
links:none on file
slides:none on file

SwiftKey is a billion‑download keyboard that keeps the APK small (20 MB download / 55 MB installed) while adding AI by choosing between cloud and on‑device models. Generative features like sticker and image generation run in the cloud (uses Deli 3), trading latency and cost for unlimited model size and easy updates. Language packs live on a server and download at runtime to avoid bloating installs — there are 700 languages with packs of 2–20 MB, managed per‑user and updated separately.

AI-written summary · about

  1. 0:00AI models in mobile apps
  2. 3:54Cloud vs on-device AI
  3. 9:36SwiftKey cloud AI features
  4. 11:50On-device AI models advantages and trade-offs
  5. 15:42Cloud vs on-device choice
  6. 17:49Gemini Nano for on-device
  7. 19:17Integrating models directly
  8. 21:45Optional AI model features
  9. 23:57User-specific model downloads
  10. 26:10Runtime model downloads
  11. 28:37Language packs and typing AI
  12. 31:08On-device AI rules
  13. 32:12Closing and Q&A
~/search
type to search 6,249 conferences, 138,987 speakers and 185,172 talks
~/help
cmdctrl k
search every conference, speaker and series
/
focus the filter search
h
home
c
conferences
s
speakers
e
series
t
light / dark — the status bar button does the same
?
this help
esc
close this, then clear every filter — or just the search, while you are typing in it

Ignored while you are typing. Pages without a filter rail have no search to focus.