Get a Grip on your Telemetry using the OpenTelemetry Collector
summary
OpenTelemetry Collector becomes the middle layer that turns raw, timestamp-less log lines into structured records, adds host/resource attributes, uplift severity, redact passwords, batch for cost control, and route simultaneously to multiple backends (debug and Dinatrace) using YAML pipelines. Live YAML demos show transform processor, filter processor, the OpenTelemetry Transformation Language (OTTL), CSV/JSON parsing, a working signal-to-metrics connector that extracts "field=200" into a real metric, plus ordering and distribution gotchas; repo contains all configs.
AI-written summary · about
chapters (17)
- 0:00OpenTelemetry Collector intro
- 7:09Telemetry struggles
- 12:26Collector basics and log batching
- 15:32Enrich logs with file metadata
- 19:34Fix log timestamps
- 23:00Default log severity levels
- 26:48Uplift logs to errors
- 27:54Map tier to support levels
- 33:31Redact sensitive log data
- 36:42Filter logs by severity
- 39:35Enrich logs with ownership
- 43:08Extract metrics from logs
- 52:19Transform CSV to structured logs
- 54:02Redact user IDs and fields
- 55:35Filter JSON logs for events
- 56:45Route logs to backends
- 58:29Q&A
related talks
16mUsing the OpenTelemetry Collector to Empower End Users
28mControlling data overhead from the OpenTelmetry Collector
13mManaging Observability Data at the Edge with the OpenTelemetry Collector and OTTL
37mObservability For You And Me With Opentelemetry
32mOpenTelemetry feat. logs, metrics and traces
29mMastering OpenTelemetry Collector Configuration
23mControlling Data Overhead with the OpenTelemetry Collector
35mOpenTelemetry for Busy People