.NET:Stay calm and Serilog + Elastic Search + Kibana on .NET Core
summary
Shows a working .NET Core demo that replaces ILogger with Serilog to write JSON logs to rolling files and push them over HTTP into Elasticsearch for search and dashboards in Kibana. Explains index/shard/replica layout, recommends 3 master + 2 data nodes, hot/warm/cold ILM, avoid JVM heaps >32 GB, use SSDs, and add correlation/trace ids so a provided request id finds the exact divide-by-zero exception in Elasticsearch. Includes APM via a NuGet agent and a simple pipeline option using Beats or Logstash.
AI-written summary · about
chapters (29)
- 0:00Introduction and speaker intro
- 1:16Problem with missing logging
- 3:01Why logging matters in modern apps
- 5:11What to log and what not to
- 7:40Log levels and security
- 9:09Where to store logs
- 10:14Relational DB vs Elasticsearch
- 12:23Why Elasticsearch
- 14:57Elastic Stack architecture
- 17:01Kibana dashboards and analytics
- 18:30Logstash and Beats explained
- 20:38Scaling Elasticsearch
- 22:04Hot-warm-cold architecture
- 23:31Elasticsearch cluster setup
- 25:20Shards and scalability
- 27:47Pricing and licensing
- 29:13Demo setup with Docker
- 30:21Elasticsearch REST API demo
- 33:12Kibana Discover and search
- 34:14Creating visualizations
- 35:42Why Serilog over standard logging
- 36:27Serilog vs ILogger demo
- 38:51Structured logging in files
- 40:19Serilog in ASP.NET Core
- 41:23Configuring Serilog with Elasticsearch
- 43:56Serilog middleware demo
- 45:21Debugging with trace IDs
- 47:56ASP.NET Core APM integration
- 50:05Elasticsearch best practices
related talks
54mLogging, Metrics and Events in ASP NET Core
53mLogging Is Hot Again
01h 03mDistributed Tracing Made Easy with .NET Core
01h 01mLogging, tracing and metrics: instrumentation in .NET and Azure
01h 00mBrave New .NET
01h 02mPatterns for application development with ASP.NET Core
54mSerilog: Instrumentation that Works for You
45mUsing modern .NET technologies to decompose a monolith into micro-services