Automated Resilience: Using Argo Events for Real-Time Incident Remediation
summary
Demonstrates an Argo Events pipeline that receives a Prometheus Alertmanager webhook, filters for a critical cryptominer detected alert, and starts an Argo Workflow that captures pod metadata to S3, applies a NetworkPolicy isolation, runs a Trivy image scan, cordons the node and notifies Slack/Pager. Demo runs end-to-end with some steps simulated due to network constraints. Covers integrating multiple sources (Alertmanager + AWS Guard) to reduce false positives, and best practices: validate, retry, dedupe and add observability.
AI-written summary · about
chapters (13)
- 0:00Automated resilience intro
- 1:05Auto remediation basics
- 3:13Detection and decision in remediation
- 5:19Argo Events for automation
- 7:07Argo Events core components
- 8:37Demo: crypto miner remediation
- 10:25Event source and sensor config
- 14:05Running remediation workflow
- 17:17Demo results and execution
- 17:59Argo Events vs RabbitMQ
- 20:47Auto remediation best practices
- 21:30Benefits of automated response
- 22:31Recap and closing
related talks
25mPrometheus Data analysis and Event Notifications for Progressive Delivery
30mArgo CD Observability with AIOps - Detect Incident Fast
23mMastering Argo Workflows at Scale: A Practical Guide to Scalability Excellence
28mPanel: From Signals To Safety Nets: Self-Healing Progressive...
25mObservability In ArgoCD/Rollouts Using Streaming ML For Reducing MTTR
22mReal Time Argo Rollouts Analytics Powered by Notification Engine
22mAnalysis in Action: Real-World Metrics Driven Argo Roll...
34mIncidents Happen