Remote Output Service - How not to have your bytes and eat them too
summary
Bazel’s remote_output_service offloads remote downloads to an external process that fetches outputs on demand instead of forcing bazel to download terabytes. The companion, bb-clientd, is a FUSE-based daemon that mounts a FUSE virtual filesystem so outputs appear with correct size and hash before bytes are fetched, and it snapshots small output descriptors for archiving. It deduplicates across workspaces, enforces a fixed local cache size with eviction, is upstreamed as an accepted proposal, and the server is at buildbar/bclientd.
AI-written summary · about
related talks
22mLIVE Q&A #3
21mRemote TCP Connection Offload and Applications
16mElectrode: Accelerating Distributed Protocols with eBPF
31mThe Future of Service Meshes: Sidecarless or eBPF?
28mCeph RBD Integration with DPUs
17mBackdraft: a Lossless Virtual Switch that Prevents the Slow Receiver Problem
17mSBB: Eliminating Centralized Bottlenecks in Userspace Network Runtime
17mFisc: A Large-scale Cloud-native-oriented File System