Observe with Rust: OpenTelemetry and Tremor
Talkat KubeCon + CloudNativeCon North America 2021 · on Wednesday, 2021-10-13· at 16:30· Room 403 AB + Online·
summary
Tremor (Rust) handles Wayfair peak load of about 5 GB/s during Cyber Five and replaces a 100-node Logstash fleet, cutting ingest costs from $40k to <$1k per month (≈40x reduction). It runs as a sidecar or dedicated processor to rate-limit, pattern-match, transform and route unstructured logs into OpenTelemetry-compatible traces/metrics via the OT Collector, using HTTP/Kafka on-ramps and off-ramps to protect back ends and reduce collector compute.
AI-written summary · about
chapters (4)
- 0:00Introduction and context
- 2:19Understanding Tremor
- 11:02Exploring OpenTelemetry
- 23:17Integrating Tremor and Otel
related talks
27mIngesting 6.5 Tb of Telemetry Data Daily Through Open Telemetry Protocol and Collectors
41mResilient Observability at the Retail Edge: A Lightweight, Scalable, and...
24mUnlocking Advanced Processing Capabilities with OpenTelemetry
41mScaling Observability: From Chaos to Clarity with Open Source Tools
01h 03mOpenTelemetry in a Brownfield World
26mDistributed Tracing: All the Warning Signs Were Out There!!!
34mReliable OpenTelemetry at Scale: No Queue, No Problem
25mObservability at the Edge: Instrumenting WebAssembly with OpenTelemetry