Bringing the power of Envoy extensibility to Go and Rust developers
summary
Built On Envoy (BOE) provides a CLI, scaffolding and a catalog so Go and Rust developers can fetch or compile dynamic modules locally, launch Envoy proxying api.openai.com, and run a chat completion decoder that publishes llm.model_name metadata. Demo shows scaffolding a Go/Rust HTTP filter that reads that metadata and returns a 403 for GPT-4-O blocked requests. Extensions ship as OCI artifacts, support XProc/network/UDP, and claim lower-latency than Wasm though no benchmark numbers are given.
AI-written summary · about
chapters (6)
- 0:00Built on Envoy project
- 1:02BOE CLI and extensions demo
- 4:12Scaffolding custom module
- 8:26Building local extensions
- 10:55Extensions in production
- 13:02Q&A
related talks
30mBuilding idiomatic Envoy SDKs for Rust and Go
26mBeyond Wasm: How Dynamic Modules Let You Extend Envoy Proxy in Go, Rust, or…
52mEnable all your infrastructure’s power with Rust & Wasm
29mRust: Embedded, Async, All the Way
21mExtending the horizons of R with Rust
31mPorting Turborepo From Go To Rust
46mAdopting Rust by gracefully oxidising web applications
57mMoly - A pure Rust Explorer for Open Source LLMs