Cosmic Database Powering OpenAI’s ChatGPT
summary
Azure Cosmos DB claims to power OpenAI ChatGPT with a planet‑scale, multi‑model store that serves 11 billion daily transactions across 40,000 physical shards with requests served under 10 ms per request. It embeds a DISN-based vector index so vectors and JSON documents live together, supports hybrid vector+SQL filtering, and offers change‑feed hooks, Python/Gradio demoed a shopping assistant, semantic caching, Azure OpenAI plugins, serverless instances under $2 to start, and a free tier (1,000 RUs, 125 GB).
AI-written summary · about
chapters (10)
- 0:00Introduction to Azure Cosmos DB
- 2:18Modern apps and AI needs
- 3:23Evolution of data management
- 5:50Azure Cosmos DB overview
- 8:19High availability and reliability
- 9:24Cosmos DB for AI applications
- 10:26ChatGPT and Cosmos DB scale
- 12:14Vector search in Cosmos DB
- 14:23Demo: AI e-commerce assistant
- 17:34Getting started with Cosmos DB
related talks
12mBuilding Generative AI Apps with Azure Cosmos DB
03h 12mAzure Cosmos DB Conf 2024
20mBuilding AI Applications with Azure Cosmos DB JavaScript SDK
50mHow to design and build AI applications with vector search using Azure OpenAI & Azure Cosmos DB
46mPower AI apps and develop rich experiences with Azure SQL Database
01h 16mAzure SQL ❤️ Open AI
18mUnleash AI Power in Your Software: Exploring Azure OpenAI Service
39mDisrupt and Grow with Microsoft Azure AI