Toward Lighter Containers for the Edge

on YouTube ↗12m

" summary

Edge deployment splits each container into an app image and a long‑running service container that holds heavy runtimes (TensorFlow, CUDA) so app images shrink from gigabytes to megabytes and avoid shipping hundreds of MBs or GBs on demand. A prototype called Pocket uses a shared backend plus lightweight IPC (Pocket-ssh) and shows footprint growth ~50% slower than monolithic containers as instances rise, eliminates the ~4s cold startup (2s manager + 2s TF import) and yields lower average latency.

AI-written summary · about

" chapters (9)

1. 0:00Intro
2. 0:49Challenges in Edge Computing
3. 2:50Slow Launch Time
4. 4:11Alternative approach: Checkpoint/Restore
5. 4:47Alternative approach: Single long-running monolithic container
6. 7:38Execution Model / Programming Model
7. 8:53Experimental Setup
8. 10:23Pocket allows for lightweight application containers Lightweight communication mechanism is necessary
9. 10:58Summary of Contributions