Make Sense of your Logs: From Zero to Hero in less than an Hour!
summary
Shows how the ELK stack (Logstash + Elasticsearch + Kibana) actually parses real logs using grok, date, geoip and useragent filters, then indexes them into Elasticsearch and runs aggregations. Demonstrates ingesting about 70 million entries (German Wikipedia subset), using date histograms, significant-terms and term aggregations to spot spikes (Jim Morrison, Myanmar, TV airings) and finds an unexpected traffic source (Chef clients) from one heavy file. Visualizations are built in Kibana 4 and run interactively on a modest laptop.
AI-written summary · about
chapters (18)
- 0:00Start
- 2:57Log Stash
- 5:59Apache Log
- 11:24The Crock Filter
- 13:59Luxor Documentation
- 14:12Elasticsearch
- 14:40Apache Search Library
- 21:29Elastic Search and Aggregation
- 22:20Date Histogram
- 23:39Cubana
- 25:04Danger Zone
- 26:20Discover Tab
- 27:50Create a Visualization
- 29:33Which Was the Resource That Actually Cost this Traffic
- 35:09Weekly Pattern
- 37:02Most Requested Pages
- 39:57Significant Terms Analysis
- 47:31Alerts
