Kubernetes Under the Magnifying Glass: Observability With OpenSearch
summary
Shows how Kubernetes logs, metrics and traces land in a single OpenSearch backend using Fluent Bit daemonsets for logs and an OpenTelemetry collector for metrics and traces, with structured JSON logging, index lifecycle policies (hot 7–14d, archive to S3) and cross-cluster search. A large bank migration folds Prometheus/Loki/Jaeger silos into OpenSearch, cuts mean time to repair by 70% MTR reduction and shrinks storage by 25% storage reduction, at the cost of higher metric storage overhead.
AI-written summary · about
chapters (6)
- 0:00Kubernetes and OpenSearch intro
- 3:13Why OpenSearch for observability
- 7:47Structured logging best practices
- 10:58Unified dashboards troubleshooting
- 13:03OpenSearch migration case study
- 15:08Conclusion
related talks
12mOpen-source observability is the way forward, and here’s why
06mSponsored Keynote: OpenSearch - See Everything: Open Observability for Agentic AI
20mHow We Implemented a Near Real-Time Logging Solution Using Fluent Bit And OpenSearch
22mFrom Telemetry to Insight: Building AI-Powered Observability Pipelines with OpenSearch
25mUnifying Observability: Weaving Prometheus, Jaeger, and Open Source Together to Win
20mSeeing Is Believing: OpenTelemetry and OpenSearch in Next-Gen Observability
06mWhy OpenSearch?
31mFluent Bit & OpenSearch: The Power Couple of Open Source Observability