~/talk

Governance Suite for Scalable AI Platforms

Talkat Ray Summit 2024 · 2024-09-30..10-02· [developer-experience, security]
links:none on file
name:Allen Yin
links:none on file
slides:none on file

Anyscale’s Governance Suite claims to give platforms concrete controls for security, cost, observability and automation: organization/cloud/project/resource RBAC, cross‑account roles and workload identity (no network ingress required), and clusters secured by default. Cost controls include budgets, resource quotas (example: 12 A100 per researcher) and detailed usage logs plus tagging. Observability ships per‑cloud Grafana with persisted logs and a Vector observability pipeline to forward metrics. Automation exposes APIs, job queues, zero‑downtime upgrades and surge deployments; it supports AWS, GCP and Azure AKS and can manage open‑source Ray.

AI-written summary · about

  1. 0:00Introduction to governance suite
  2. 1:05Security and permissions best practices
  3. 10:03Cost management and governance tools
  4. 15:06Observability and integration features
  5. 18:59Automation for scalable AI
  6. 21:46Summary and closing remarks
  7. 22:07Q&A session
~/search
type to search 6,249 conferences, 138,987 speakers and 185,172 talks
~/help
cmdctrl k
search every conference, speaker and series
/
focus the filter search
h
home
c
conferences
s
speakers
e
series
t
light / dark — the status bar button does the same
?
this help
esc
close this, then clear every filter — or just the search, while you are typing in it

Ignored while you are typing. Pages without a filter rail have no search to focus.