Noise Cancelling Headphones for Fluent Bit - Powered by Lua
Talkat FluentCon: Cloud Native Logging Day with Fluent Bit and Fluentd Europe 2021 · on Tuesday, 2021-05-04·
summary
Prototype implements a Lua Fluent Bit filter that extracts IPv4 from ssh auth logs, checks an LRU cache (10k entries), validates bogon/private space, and queries the GreyNoise community API for noise/riot booleans. It runs inside a Docker image with Lua modules, uses busted tests for the handler, and returns Fluent Bit semantics (-1 drop, 0 no change, 1 modified). Demo processes 10,000 lines in 134s (~75/sec), finding 7,704 noise (~77%) and ~6% bogon/invalid.
AI-written summary · about
chapters (13)
- 0:00Intro
- 0:50What is Gray Noise
- 1:59What is Fluent Bit
- 3:48Fluent Filter
- 6:31Lua Filter
- 7:33Coding Caveats
- 8:20Testing
- 10:09Grain Noise Filter
- 13:58Input Section
- 15:01Demo
- 21:11Results
- 21:52Future Plans
- 23:24Resources
related talks
30mFluent Bit, the engine to power Chat Ops
36mDeep Dive: Fluent Bit
25mGetting More Out of Lua in Fluent Bit
22mLogging: Fluentd & Fluent Bit
34mFluentd and Fluent Bit
25mLessons From Five+ Years of Fluent Bit: Building a Global-Scale Observability Agent
14mIntegrating Fluent Bit Into a PaaS
40mLive, Laugh, Log