~/talk

No Provisioned Concurrency: Fast RDMA-codesigned Remote Fork for Serverless Computing

on YouTube 16m
Talkat OSDI 2023 · 2023-07-10..07-12· [serverless, networking]

speakers

name:Xingda Wei
links:none on file
name:Fangming Lu
links:none on file
name:Tianxia Wang
links:none on file
name:Jinyu Gu
links:none on file
name:Yuhan Yang
links:none on file
name:Rong Chen
links:none on file
name:Haibo Chen
x:HaiboChen

resources

video:https://youtu.be/ivM9FCqyYPw
slides:none on file

summary

MITOSIS implements an OS primitive called remote fork that co-designs Linux kernel behavior with RDMA to let a machine read parent pages on demand and avoid checkpointing or full state transfer. It launches a container in ~5 ms cold, forks over 10,000 containers across machines within one second, and reduces function tail latency by 89% while cutting memory usage versus cached instances. Integrated with FN, it enables no provisioned concurrency and accelerates serverless state transfer, improving workflow runtime by 86%.

AI-written summary · about

chapters (10)

  1. 0:00Mitosis and remote Fork
  2. 1:28Slow container starts
  3. 3:14No provisioned concurrency
  4. 5:46Existing Fork limits
  5. 6:52Remote Fork challenges
  6. 8:17RDMA co-design for Fork
  7. 10:48Mitosis benefits
  8. 11:32Auto scaling with Mitosis
  9. 13:19Fast state transfer
  10. 14:45Implementation and conclusion

related talks

~/search
type to search 6,249 conferences, 138,987 speakers and 185,172 talks
~/help
cmdctrl k
search every conference, speaker and series
/
focus the filter search
h
home
c
conferences
s
speakers
e
series
t
light / dark — the status bar button does the same
?
this help
esc
close this, then clear every filter — or just the search, while you are typing in it

Ignored while you are typing. Pages without a filter rail have no search to focus.