Logs Parsing Using OpenTelemetry and SigNoz
summary
Shows a concrete system that turns messy log lines into structured fields using OpenTelemetry receivers/processors and SigNoz as the backend, exporting parsed logs to ClickHouse; demonstrates an in‑UI pipeline builder with live simulation/preview so parsers (regex, JSON parser, move, router) can be tested against production streams before deploy, uses websocket-driven collectors and OTel Collector hot‑reload for zero‑downtime config rollout, and notes SigNoz is open source with 15K+ GitHub stars and 3,400 Slack members.
AI-written summary · about
chapters (10)
- 0:00Logs parsing intro
- 1:06OpenTelemetry log model
- 5:04Raw log ingestion demo
- 6:57Log processor config
- 8:27Manual parsing challenges
- 9:31SigNoz UI pipelines
- 10:20JSON log parsing demo
- 13:48UI parsing benefits
- 14:08Backend updates
- 15:11Q&A
related talks
32mAutomatic logs, traces and metrics in K8s using OpenTelemetry & SigNoz
01h 03mOpenTelemetry in a Brownfield World
01h 03mGet a Grip on your Telemetry using the OpenTelemetry Collector
41mIntroducing logs in OpenTelemetry: Features and opportunities
26mSimplifying OpenTelemetry with Configuration
16mHacking OpenTelemetry
27mLog Support in OpenTelemetry
45mFrom Noise To Signal: Building Smart Observability Pipelines With OpenTelemetry