Observability Day Europe 2024
as the organisers put it
Observability Day fosters collaboration, discussion, and knowledge sharing of cloud-native observability projects (including but not necessarily limited to Prometheus, Fluentd, Fluent Bit, OpenTelemetry, and OpenMetrics), as well as vendor-neutral best...
who it's for
site reliability engineers, platform engineers, observability engineers, backend engineers, devops engineers, cloud architects, security engineers
topics
Prometheus high-cardinality scaling; OpenTelemetry collector architectures; Fluent Bit log pipelines; eBPF-based profiling and logs; continuous profiling with DWARF and ELF; Thanos distributed query execution; tail sampling for traces; serverless observability with OpenTelemetry; instrumenting WebAssembly with OpenTelemetry; Prometheus Operator sharding patterns; cost-optimized distributed telemetry; Kubernetes network observability with Cilium
| title | author | length |
|---|---|---|
| Welcome + Project Updates | Austin Parker | 27m |
Quick status pulse across projects: Prometheus ships eight releases in the last 12 months, shrinks to half its prior size, enables native histograms and plans… | ||
| DWARFs and ELFs on the Cloud - eBPF Profiling Adventures in Observability at... | Sumera Priyadarsini | 22m |
Continuous, high-resolution profiling using eBPF to grab stack addresses from running processes and DWARF and ELF debug sections; an on-host agent discovers… | ||
| Architecting Growth: Scaling Tactics for Prometheus Metrics... | Arthur Silva Sens, Nicolas Takashi | 18m |
An end-to-end example shows an IoT farm growing from 100k → 1.5M → 10.5M time series, forcing Prometheus from 1GB to ~70GB RAM before hitting OOM and… | ||
| Sponsored Keynote: The Superpower of Observability - Context is King | Harry Kimpel | 06m |
Argues that observability’s real value is context that connects business data across marketing, HR, R&D and finance, showing concrete examples: a production… | ||
| Lightning Talk: A Practical Guide on How to Monitor and Compare Service Mesh... | Lin Sun | 08m |
Demo compares sidecar, sidecar-less (Istio Ambient) and a baseline using Kubernetes running the Online Boutique app with Prometheus, node-exporter, cAdvisor… | ||
| How to Think About Instrumentation Overhead | Jason Plumb | 20m |
Instrumentation adds measurable CPU, memory, bandwidth and sometimes startup and disk cost, and percent change follows 100 (instrumentation latency) /… | ||
| Unlocking Multi-Cloud Observability: The Case Study of... | Francesco Cultrera, Armagan Karatosun | 28m |
EO4EU builds a multi‑cloud observability platform across WEkEO DIAS and CINECA ADA Cloud using Prometheus + Thanos sidecar for metrics, Grafana for dashboards… | ||
| Panel: OpenTelemetry... | Daniel Gomez Blanco, Marcin Sodkiewicz, Iris Dyrmishi, Hope Oluwalolo | 36m |
Companies migrate to OpenTelemetry to stop vendor lockin, correlate traces logs and metrics, and simplify bespoke pipelines; deployments favor a central… | ||
| Logs Collection With eBPF: Like a Super-Powered Postal Service | Aviv Zohari | 29m |
Claims a replacement for file-based collectors using eBPF probes on write/writev syscalls to capture logs into a kernel ring buffer batching and send them to a… | ||
| Monitoring Serverless Workloads with OpenTelemetry and Prometheus | Ridwan Sharif | 21m |
Adds sidecars with lifecycle ordering to Cloud Run so collectors start before and stop after app containers, enabling reliable flushes; push-based… | ||
| Real-World Sampling – Lessons Learned... | Juraci Paixão Kröhling, Alexandre Magno Prado Machado | 33m |
Pismo reduces observability spend by about 80% cost reduction by routing 100% of traces through an OpenTelemetry Collector using tail sampling policies that… | ||
| Lightning Talk: Not Just Enterprise. Modern Java App CI/CD Observability with OTel... | Oleg Nenashev | 06m |
Modern Java CI/CD observability shows a working pipeline that links GitHub → Jenkins → Gradle → Java compiler and tests into a single trace, using Quarkus… | ||
| Lightning Talk: Federated Search Over Distributed Observability Data | Kalyan Kolachala | 11m |
Operates on petabytes of observability data per day and billions of transactions, keeping raw and derived logs, traces and metrics distributed to avoid network… | ||
| Lightning Talk: Application Security Through the Lens of OpenTelemetry | Yosef Arbiv | |
Built an open source product API Clarity that lists exposed APIs, flags differences from docs, and detects attacks by installing a gateway trace plug-in and a… | ||
| Lightning Talk: Demystifying Kubernetes Observability with Generative AI and LLMs | Asaf Yigal | 07m |
Claims that LLMs cut the toil of Kubernetes observability by automatically generating dashboards, alerts and Helm changes using ChatGPT-assisted visualization… | ||
| The Observability Money Heist - a Fintech's Tale of... | Shubham Srivastava, Sandeep Raghuwanshi | 17m |
Fintech reduces observability and infra spend by replatforming concrete components and automating responses: swaps Prometheus/Thanos for VictoriaMetrics and… | ||
| Lazy Robots: Telemetry Buffering on Android | Cesar Munoz, Jason Plumb | 19m |
OpenTelemetry Android adds a disk-buffering layer that serializes telemetry to internal storage as Protobuf files, creating per-signal folders and honoring… | ||
| Finding Needles in the Observability Haystack | Ivan Nečas, Katya Gordeeva | 23m |
A small Python library named opsin library fetches Prometheus/Thanos metrics with caching, converts alert ranges to intervals and Pandas DataFrames, and… | ||
| Dude, Where’s My Error?: How OpenTelemetry Records Errors, and Why... | Adriana Villela, Reese Lee | 26m |
OpenTelemetry records errors as either enriched spans or correlated logs, using methods like record_exception (or record_error in Go) and automatically adding… | ||
| TTChat’s Story: Connect Metrics, Logs and Traces with EBPF | Zhu Jiekun | 20m |
Started with client SDKs sending ~200TB/day, then shifts to eBPF agent for auto-instrumentation to avoid code changes; uses OpenTelemetry Collector plus a… | ||
| Dynamically Tuning Pods: Leveraging Time Series ML Models with KubeFlow | Christopher J Nuland | 26m |
Demonstrates using LSTM on Prometheus metrics via Kubeflow pipelines to predict pod CPU/memory trends and suggest request values, with statistical baselines… | ||
| Cracking the Cost Code: A Cost Optimized Approach to Distributed... | Mahesh Pai, Shailja Agarwala | 24m |
Intuit replaces stateful trace stores and indexing with columnar Parquet files on S3+Kafka ingestion, per-service Parquet schemas generated by a metadata… | ||
| Telemetry Showdown: Fluent Bit Vs. OpenTelemetry Collector - a Comprehensive... | Henrik Rexed | 25m |
Benchmark compares Fluent Bit 2.x against the OpenTelemetry Collector using Hipster Shop and OpenTelemetry demo apps, tracing, logs and Prometheus scraping… | ||
| How We Implemented a Near Real-Time Logging Solution Using Fluent Bit And OpenSearch | Nilushan Costa | 20m |
Implemented a near real‑time logging cache on Kubernetes using Fluent Bit (daemonset, tail + OpenSearch plugin) and OpenSearch, publishing logs to a new hourly… | ||
| Prometheus Operators in the Wild | Bartłomiej Płotka, Mahmoud Amin | 28m |
Compares two OSS operators and shows a live demo on a 3‑node cluster with three collectors; one operator runs as a DaemonSet per node (GMP) and limits scrape… | ||
| Observability at the Edge: Instrumenting WebAssembly with OpenTelemetry | Dan Norris, Joonas Bergius | 25m |
Adds end-to-end OpenTelemetry to wasmCloud running on Rust using the otel Rust SDK plus the tracing crate, propagating spans via NATS headers and exporting… | ||
| Shift Into an Observability Mindset with OpenTelemetry | Daniel Gomez Blanco | 22m |
OpenTelemetry adoption is framed around concrete practices: use head and tail sampling via OpenTelemetry collectors to keep around 5% of spans while preserving… | ||
| What Is Going on Within My Network? a Subtle Introduction to Cilium Hubble | Shedrack Akintayo | |
Cilium Hubble uses eBPF kernel-level probes to capture L3–L7 flows and exposes them via Hubble CLI and UI plus a metrics endpoint for Prometheus/Grafana… | ||
| OpAMP in Action: User Configurable Observability Pipelines | Srikanth Chekuri | 20m |
Demonstrates using OpAMP to push live remote configs to OpenTelemetry Collector so pipelines change without rebuilding images: a working demo applies a regex… | ||
| From Observability to APM - Taking Cloud Native Up The Stack | Dotan Horovits | 05m |
OpenTelemetry Collector now rolls spans into time-series via the span metric connector so service-level request rate error rate and latency become real… | ||
| Do We Still Need to “Observe”? the Future of AI & Observability | Guy Menahem, Niv Yungelson | 19m |
Argues that large language models plus Retrieval Augmented Generation already generate PromQL and query live data to answer metric questions, fine tune on org… | ||
| Closing Remarks | Eduardo Silva | 02m |
Observability Day closes after a full day held across two rooms, drawing 400–500 attendees and relying on a volunteer review team of more than ten people to… | ||
| nothing matches | ||