FluentCon: Cloud Native Logging Day with Fluent Bit and Fluentd Europe 2021
2021-05-04
-- online --
as the organisers put it
A day to bring developers and users from the Fluent community together to discuss, exchange, and share experiences using Fluentd and Fluent Bit.
who it's for
observability engineers, platform engineers, site reliability engineers, kubernetes operators, logging engineers, devops engineers, devsecops engineers
topics
Fluent Bit pipelines; Fluentd routing and syndication; OpenTelemetry trace export with Fluent Bit; kubelet metadata for Kubernetes filter; Logging Operator CRDs for Fluent; CRI log parser for containerd/CRI-O; Lua scripts for nested JSON cleanup; Prometheus metrics from logs; Fluent Bit SDK output plugins; filesystem buffering and memory_buffer_limit; multi-workers concurrency in Fluent Bit; Loki, Datadog and Azure Log Analytics outputs
| title | author | length |
|---|---|---|
| Welcome to FluentCon! What's new with Fluentd & Fluent Bit | Anurag Gupta | 09m |
Fluentd reaches ten years and Fluent Bit reports 2.1–2.2 million downloads per day with container installs about ten times package installs. Roadmap targets… | ||
| Keynote: Fireside chat with Martin Mao, CEO of Chronosphere | Anurag Gupta | 29m |
Chronosphere grew from Uber work that produced M3 (Prometheus-compatible metrics), Jaeger (tracing) and an internal logging system that wasn’t open sourced… | ||
| Fluent Bit - Swiss Army Tool of Observability Data Ingestion | Michael Marshall | 22m |
Built a Fluent Bit pipeline that ingests syslog/tcp/tail inputs in AWS Fargate, cleans nested JSON with nested JSON cleanup Lua scripts and regex parsers, and… | ||
| Exporting your trace telemetry with OpenTelemetry and Fluent Bit | Aditya Jagdishkumar Prajapati | 23m |
Shows how to collect and export traces using OpenTelemetry and Fluent Bit so applications send spans to a backend without running an extra collector… | ||
| Logging Operator the Cloud Native Fluent Ecosystem | Sandor Guba | 21m |
Logging Operator automates generation of Fluent Bit and Fluentd configs as Kubernetes CRDs, creating flows and outputs with namespace isolation, label… | ||
| Lightning Talk: Scaling the Fluent Bit Kubernetes Filter in... | Drew Zhang, Nithish Kumar Murcherla | 09m |
Fluent Bit’s Kubernetes filter is changed to fetch pod metadata from the node kubelet instead of the API server, implemented as a kubelet metadata option. On a… | ||
| Lightning Talk: Fluentd as syslog drain for CloudFoundry | Karsten Schnitter | 10m |
Shows a working Fluentd setup that accepts Cloud Foundry syslog drains over RFC5424 syslog (tcp/udp, optional TLS or syslog-over-https), extracts CF structured… | ||
| Lightning Talk: Fluentd at Scale; Keys to successful Logging Syndication | Fred Moyer | 09m |
Zendesk runs Fluentd as a Kubernetes DaemonSet reading Docker JSON logs from hundreds of services across multiple AWS regions, routing enriched records to… | ||
| Lightning Talk: Parsing CRI JSON logs with Fluent Bit | Bart Robertson, Joseph Fultz | 06m |
Kubernetes moves from dockerd to containerd/CRI-O change how container logs are written: CRI lines include a timestamp, stream, log tag and the original JSON… | ||
| Customized Cloud Native Logging: Fluent Bit in Open Service Mesh | Sanya Kochhar | 23m |
Shows Fluent Bit deployed as an optional sidecar to the Open Service Mesh controller, enabled by an osm CLI flag and configured via a single ConfigMap; uses… | ||
| Scaling Log Collection with Fluent Bit | Wesley Pettit, Ugur Kira | 27m |
Migrating Fluentd to Fluent Bit and then enabling multi‑workers raises throughput: CloudWatch pipelines go from ~8,500 logs/s to significantly higher with… | ||
| Keynote: DevSecOps in the US Air Force | Nicolas Chaillan | 18m |
DoD describes a production DevSecOps platform built on Platform One with Kubernetes Istio and KNative running on jets and legacy hardware, claiming… | ||
| Noise Cancelling Headphones for Fluent Bit - Powered by Lua | Matt Lehman, Guillermo Menjivar | 26m |
Prototype implements a Lua Fluent Bit filter that extracts IPv4 from ssh auth logs, checks an LRU cache (10k entries), validates bogon/private space, and… | ||
| nothing matches | ||