Logging: Fluentd & Fluent Bit
Talkat KubeCon + CloudNativeCon North America 2020 Virtual · on Wednesday, 2020-11-18· at 17:45· Intrado Virtual Event Platform,·
summary
Fluentd is a Ruby core with C extensions that runs a plugin-based pipeline for collection, filtering, buffering and routing; it recommends file buffer for durable, crash-safe delivery and supports multi‑tier forwarding for high traffic. Kubernetes setups use daemonset deployment to tail container logs and enrich records with API server metadata; Docker can use the logging driver. Fluent Bit is a low‑CPU C agent with 60+ native plugins, ships new connectors for Azure Blob, S3, Firehose and Grafana Loki, adds a TensorFlow filter for on‑stream inference, and reports ~170M deployments.
AI-written summary · about
chapters (15)
- 0:00Introduction
- 0:22Fluentd Overview
- 3:08Fluentd Architecture
- 7:42Popular Use Cases
- 9:31Container Logging
- 12:58Fluent Bit Introduction
- 13:54Fluent Bit Data Workflow
- 14:33Fluent Bit Performance
- 15:01Fluent Bit Kubernetes
- 15:48JSON
- 16:06Correlation
- 16:16Context
- 17:16Deployment
- 18:12Enterprise Connectors
- 21:29Open Telemetry
related talks
34mFluentd and Fluent Bit
36mDeep Dive: Fluent Bit
34mFluentd: A Complete Logging Ecosystem for Kubernetes
34mGetting Started With Logging in Kubernetes
37mFluentd: Cloud Native Logging
27mBuild a Cloud Native Logging Pipeline on the Edge with Fluentbit Operator
35mIntro: Fluentd
22mPetabyte Scale Logging with Fluentd and Fluent Bit: A Use Case From...