Automating On-Call Duties with Ansible Tower

on YouTube ↗32m

" summary

Red Hat IT automates on-call remediation using Ansible Tower + Nagios event handler to run repair playbooks, set five minutes of downtime so Nagios doesn’t re-alert, post a Jive blog entry, and open ServiceNow tickets when alerts recur. Infrastructure includes clustered Postgres for Tower with a DR playbook cutover. Outcome: over 100 pager playbooks automated, 15% of production alerts handled without paging, 50 converted to a generic restart template, and the open-sourced handler script is available.

AI-written summary · about

" chapters (24)

1. 0:00Introduction
2. 0:26How I started with Ansible
3. 1:54Ansible Tower infrastructure setup
4. 3:24Automation steps
5. 5:20Examples
6. 6:23Blog Post Example
7. 6:56Configuration Infrastructure Management
8. 7:56Nagios
9. 9:15Nagios Workflow
10. 13:57Nagios Event Handler
11. 16:10Simplified Code
12. 16:42Splunk
13. 18:14Ansible Tower
14. 18:50Success
15. 21:02OnCall Team
16. 22:09OnCall Duties
17. 23:51Nagios Users
18. 24:46Why 5 Minutes
19. 26:10Service Owners
20. 28:13Puppet Nagios
21. 29:03ANCA
22. 29:43Hosting Issues
23. 30:14False Positives
24. 31:00I was working with them

" related talks

• 48mAutomated patch management with Ansible and RundeckRico Spiesberger, Andreas Lehr · OSDC 2019
• 36mPulling the Puppet Strings with AnsibleBrian J. Atkisson · LISA19
• 35mAuto-healing with AnsibleCHRISTIAN LORENZ · OSMC 2022
• 27mYou Should Be On Call, tooJoshua Timberman · MountainWest RubyConf 2013
• 39mContinuous Deployment with AnsibleTim Gerla · USENIX Configuration Management Summit 2013
• 16mHuman Centered On Call PracticesNajla Elmachtoub · CascadiaJS 2020
• 36mMake You Ops-Life Easy – ansible usecases you didn´t out of trackCHRISTIAN LORENZ, PHILIP DRIESSLEIN · stackconf 2024
• 29mGood Practices and Security for your Ansible Automation Platform 2Arnav Bhati · DevConf.CZ 2023