~/talk

Unleash the Potential of APIs with Azure API Management

Talkat Microsoft Build 2024 · 2024-05-21..05-23· [api-design, large-language-models]
links:none on file
links:none on file
linkedin:scottsemyan
slides:none on file

Live demos show Azure API Management adding a Token Metric policy that logs token usage to Application Insights, a Token Limit that enforces per-subscription tokens-per-minute, and a load balancer + circuit breaker that fails from low-latency PTU to pay-as-you-go with retries (no lost requests). A Semantic Caching preview uses Redis+vector search to drop response time from ~2.5s to ~100ms for similar prompts. The new API Center provides a searchable inventory, CLI/VS Code registration, and API analysis with lint rules and Copilot quick fixes.

AI-written summary · about

  1. 0:00Introduction
  2. 0:31Azure API Management Overview
  3. 2:12GenAI and Azure OpenAI
  4. 3:40Scaling Intelligent Apps
  5. 5:30Token Tracking and Metrics
  6. 6:30Load Balancing and Security
  7. 7:35Subscription Management
  8. 8:34Token Limiting Policy
  9. 9:29Semantic Caching Preview
  10. 10:32GenAI Features Demo
  11. 20:09Resources and Next Steps
  12. 20:47Introduction to API Center
  13. 22:25API Center Key Challenges
  14. 23:58API Center Developer Demo
  15. 28:00API Center Admin Features
  16. 30:46API Analysis and Fixes
  17. 36:13Summary and Resources
  18. 37:55Question and Answer Session
~/search
type to search 6,249 conferences, 138,987 speakers and 185,172 talks
~/help
cmdctrl k
search every conference, speaker and series
/
focus the filter search
h
home
c
conferences
s
speakers
e
series
t
light / dark — the status bar button does the same
?
this help
esc
close this, then clear every filter — or just the search, while you are typing in it

Ignored while you are typing. Pages without a filter rail have no search to focus.