Keynote: Accelerating AI/ML Development with Open Source Software
Talkat Cassandra Summit 2023 · on Wednesday, 2023-12-13· at 09:15· Grand Ballroom BC (Concourse Exhibit Level)·
summary
AWS claims two concrete strategies: product integrations that package open source for secure, scalable use, and direct contributions to projects. Examples include Jupyter Scheduler — an extensible jobs backend with immutable notebook snapshots and SageMaker support — and Jupyter AI — magic commands, a collaborative chat UI, slash commands (learn/ask/generate) that index local files and support local models and LangChain plumbing. A new PyTorch S3 connector (Rust core, Python wrapper) ships at reInvent and yields up to 40% faster data loads and checkpoint IO.
AI-written summary · about
chapters (10)
- 0:00Introduction
- 1:03Customer challenges with AI/ML
- 2:29AWS strategies for open source
- 3:31AWS contributions to PyTorch
- 4:16Jupyter Scheduler for notebooks
- 6:42Jupyter AI for generative AI
- 10:14Jupyter AI commands
- 13:24AWS contributions to LangChain
- 14:29PyTorch S3 connector
- 15:53Conclusion on open source value
related talks
16mKeynote: Accelerating AI/ML Development with Open Source Software
11mKeynote: Open Source Stack Empowers the AI Era
13mKeynote : The Open Source AI Alliance
18mAI Owes its Rebirth to Open Source and the Cloud
01h 05mKeynote: Builders Day
16mKeynote: An Open-Source Stack for AI Compute: Kubernetes + Ray + PyTorch + vLLM
13mEngineer your company’s future with AI: Use open source tools on AWS
16mKeynote: Marin: An Open Lab for Frontier AI