Kubernetes and Logging: Do It Right
Talkat KubeCon + CloudNativeCon North America 2020 Virtual · on Thursday, 2020-11-19· at 16:50· Intrado Virtual Event Platform,·
summary
Fluent Bit is a small C-based logging agent that runs as a daemon set on each node, reads /var/log/containers, enriches logs by querying the Kubernetes API for labels/annotations, and ships to outputs like Elasticsearch, Loki, S3, Kafka. Demonstrated deployment on Minikube with Loki/Grafana works end-to-end. It uses file system buffering to avoid OOM/backpressure, exposes ~70 plugins and stream-processing hooks (including TensorFlow inference), and reports about 170 million deployments.
AI-written summary · about
chapters (7)
- 0:00Intro
- 0:25How Kubernetes works
- 4:28Fluent
- 9:41Packet Pressure
- 13:46Demo
- 17:06String Processing
- 21:53Fluent Data 16
related talks
34mGetting Started With Logging in Kubernetes
37mGetting Started with Logging in Kubernetes - Eduardo Silva, Treasure Data
34mFluentd: A Complete Logging Ecosystem for Kubernetes
27mBuild a Cloud Native Logging Pipeline on the Edge with Fluentbit Operator
36mDeep Dive: Fluent Bit
33mCloud Native Logging 101 [B]
05mLightning Talk: Flexible Logging Pipelines with Fluentd and Kubernetes
22mFluent Bit - Swiss Army Tool of Observability Data Ingestion