Our Adventure building a massively scalable mixed C++ and Rust remote compiler cloud
summary
Tipi.build runs remote C++ (and some Rust) builds on Docker Swarm and multicloud machines, claiming 500-core build hosts and caching that shrinks many 10 GB build trees down to ~100 MB snapshots. Tooling includes Address/UB/Memory sanitizers to run many instrumented builds in parallel, a Rust-based content-addressable snapshot compressor (elfChecker/FS checker), cxx.rs for C++<->Rust bindings, a WebAssembly Vault that encrypts Git tokens in the browser, Postgres JSONB storage, and a C++ web framework with auto-generated OpenAPI docs; production service shows months-long uptime.
AI-written summary · about
chapters (13)
- 0:00Remote C++ builds at TP
- 3:41Remote builds for safety and speed
- 9:19C++ for scalable web services
- 12:09Monoliths vs microservices
- 16:42C++ web service with O framework
- 21:21Docker Swarm and cloud build
- 24:21Secure GitHub tokens with WASM
- 29:26C++ databases without ORM
- 33:22Crash handling in C++
- 36:35Introducing Rust to C++
- 39:00Caching and reproducible builds
- 42:53Mixing C++ and Rust
- 49:02Summary and call to action
related talks
30mThe Bitter and the Sweet of Running a Planet-Scale Build &...
01h 00mCompiler Explorer: Behind The Scenes
11mRemote execution with 100 to 100,000 CPUs
01h 31mBazel
24mFaster Builds With Remote Execution and Caching
46mBuilding and Packaging Modern C++
21mSupercharge your builds with Bazel
37mDockerising and deploying a full stack Rust + WASM web app