~/talk

8 Million Tasks Daily: Driving Efficiency in Multi-Tenant Data Platforms at Ho...

on YouTube 25m
Talkat KubeCon + CloudNativeCon + OpenInfra Summit + PyTorch Conference China 2026 · 2026-09-07..09-09· [kubernetes, distributed-systems]

speakers

name:J. Sun
links:none on file
name:S. Tian
links:none on file

resources

video:https://youtu.be/Q5q0zjInjcc
slides:none on file

summary

Horizon Robotics reworked its data platform to run 8 million short-lived tasks per day by replacing per-workflow agents with a centralized Argo Workflows Agent Service, cutting infrastructure and CPU use. They also refactored metadata and reduced VolcanoJob size to fix an Informer-induced bottleneck (bringing sync latency from 4 minutes to 10 seconds) and used Kueue plus Volcano to implement elastic quotas and handle preemption for multi-tenant stability.

AI-written summary · about

related talks

~/search
type to search 6,249 conferences, 138,987 speakers and 185,172 talks
~/help
cmdctrl k
search every conference, speaker and series
/
focus the filter search
h
home
c
conferences
s
speakers
e
series
t
light / dark — the status bar button does the same
?
this help
esc
close this, then clear every filter — or just the search, while you are typing in it

Ignored while you are typing. Pages without a filter rail have no search to focus.