Lightning Talk: Flexible Logging Pipelines with Fluentd and Kubernetes
summary
Kubernetes nodes run Fluentd as a daemonset and pods emit logs; the talk shows developers put pod annotations with grok patterns and routing targets (Elasticsearch, etc.) into their pod specs, a small watcher called qkn reads the API, renders a dynamic Fluentd config via templates (Go templates), and reloads td-agent so each team can get custom parsing and outputs without cluster-operator redeploys — demonstrated at scale (example: ~20 teams) and tested routing to Elasticsearch.
AI-written summary · about
chapters (8)
- 0:00Introduction
- 0:49Shared cluster
- 1:19Common solutions
- 2:28Getting started
- 3:17Template language
- 3:40QCN
- 4:10Final Output
- 4:20Conclusion
related talks
05mLightning Talk: What I Wish I’d Known about Fluentd with Kubernetes - Bryan Boreham, Weaveworks
09mLightning Talk: Fluentd at Scale; Keys to successful Logging Syndication
34mGetting Started With Logging in Kubernetes
34mFluentd: A Complete Logging Ecosystem for Kubernetes
05m⚡Lightning Talk: Learning Kubernetes From Logs: Building a Foundation for Future…
34mFluentd: A Complete Logging Ecosystem for Kubernetes
37mGetting Started with Logging in Kubernetes - Eduardo Silva, Treasure Data
39mMaking Logs Work for you with Fluentd