Fluent Bit & OpenSearch: The Power Couple of Open Source Observability
summary
Fluent Bit is presented as a low‑resource, high‑performance edge collector that forwards enriched telemetry into OpenSearch using a native OpenSearch output plugin (AWS‑contributed); the demo deploys OpenSearch + Dashboards, runs Fluent Bit with two dummy JSON generators sending one event per second, and records appear in the dashboard showing the pipeline actually works. Configuration supports legacy and YAML formats, routing via collector vs aggregator topology, runtime routing via dynamic record access, and recent version 5 performance improvements.
AI-written summary · about
chapters (11)
- 0:00Fluent Bit and OpenSearch intro
- 1:22Speaker background
- 3:09Talk goals and resources
- 5:54Fluent Bit principles and history
- 9:05Fluent Bit maturity and adoption
- 11:14Fluent Bit as telemetry pipeline
- 17:28Collector vs aggregator models
- 19:16Configuring Fluent Bit with OpenSearch
- 21:25Live demo setup
- 27:03Choosing Fluent Bit for observability
- 28:48Q&A on dynamic indexing
related talks
32mFluent Bit Open Source Project & AWS
42mIngestion at Scale: Open Source Pipelines for Getting Data Into Open...
28mBuilding Observability Pipeline with Fluent-Bit
21mKubernetes Under the Magnifying Glass: Observability With OpenSearch
06mSponsored Keynote: OpenSearch - See Everything: Open Observability for Agentic AI
20mExtending OpenSearch Dashboards: Building a Unified Obser...
20mHow We Implemented a Near Real-Time Logging Solution Using Fluent Bit And OpenSearch
34mPower of O11y with FLUENT BIT in AWS EKS environment