Building 1300 Container Images in 4 Minutes
summary
Claim: Bazel pipelines build 1300+ images in about four minutes by never materializing layers to disk. Implementation uses Bazel with remote_download_minimal, a BES backend that reads per-image JSON image descriptors from the remote cache, downloads only new layer blobs, deduplicates downloads and in‑flight uploads across images, and pushes manifests to registries. Result: avoids pulling ~1.7 TB per build (previously many builds duplicated >12 TB), fits Bazel output in RAM, and replaces bulky rules into a streamlined rules_docker pipeline.
AI-written summary · about
chapters (7)
- 0:00Introduction
- 0:20What are container images
- 2:19Container push rule
- 3:16Build event service
- 5:39Container image construction
- 7:36Docker optimizations
- 9:46Outro
related talks
36mUsing Bazel for Fast, Correct Docker Deployments
58mOptions Galore to Get from Source Code to Container
40mStreamlining Kubernetes Application CI/CD with Bazel
49mJava Container Mastery: Optimizing Images Across Build Tools
30mSpeeding Up Analysis Pipelines with Remote Container Images
25mBuilding Docker Images Without Docker
01h 01mIntroduction to Bazel
18mFusing Bazel