Make your logs work for you
summary
Centralize noisy, heterogeneous logs into an HTTP/JSON store using Elasticsearch, Logstash, Kibana and a pipeline of shippers → queue → Logstash → Elasticsearch → Kibana for real‑time ad‑hoc exploration. Parse and enrich (geoip, user_agent, anonymize, session_id), capture network traffic with packetbeat, and govern retention with indices-per-day + curator. Shows concrete numbers and behavior: scales to hundreds of thousands of events/sec, supports daily shard sizing, snapshots to S3, and produces visualizations and drilldowns that reveal patterns and root causes in seconds.
AI-written summary · about
chapters (5)
- 0:00Make your logs work for you Honza Král
- 19:12Outputs
- 21:10Data Management
- 24:38Time based data flow
- 32:26Architecture
related talks
39mFast log management for your infrastructure
40mA needle in a logstack
43mPractical Application Logging and Monitoring
01h 00mApplication Logging & Logstash
48mMake Sense of your Logs: From Zero to Hero in less than an Hour!
30mBuilding a Large-Scale, Streaming-Based Logging and Monitoring Solution
01h 30mBehind the scenes of an ELK system
30mCentralized Log Management