Multi-tenant Logging with Opentelemetry Collector
Talkat ContainerCon @ Open Source Summit Europe 2024 · on Tuesday, 2024-09-17· at 11:55· Room 0.14 (Level 0)·
summary
Claim: a new open source project Telemetry Controller uses the OpenTelemetry Collector to make multi‑tenant Kubernetes logging manageable. It converts collectors, tenants, subscriptions and outputs into Kubernetes CRs, runs collectors as daemonsets with tenant selectors, and ships parsed nginx logs to OpenObserve on minikube. It prevents noisy neighbor failures by isolating pipelines, reduces repeated config and backpressure risks, and the live demo shows it working end to end.
AI-written summary · about
chapters (15)
- 0:00Introduction
- 1:26Kubernetes logging challenges
- 4:17OpenTelemetry protocol benefits
- 10:17Multi-tenancy in logging
- 15:55Traditional logging problems
- 17:21Telemetry Controller intro
- 21:01Live demo setup
- 23:15Custom resources
- 26:08Tenant subscriptions
- 28:16Output config
- 31:07Controller purpose
- 32:34Demo log aggregation
- 35:04Future log sources
- 36:31Monitoring pipeline
- 38:16Q&A
related talks
40mMulti-tenant Logging with Opentelemetry Collector
26mTurn the Volume Down on Noisy Neighbors!
34mKubernetes Observability with OpenTelemetry
28mImplementing Observability in Kubernetes
32mDesign Observability Solution for Multi-Tenancy Environment
47mWhat Is This OpenTelemetry Thing?
09mOpenTelemetry or OpenTeleMessy?
46mObservability Ecosystem in Kubernetes