App Testing at Scale: How Bitnami Tests Thousands of Releases Per Month

on YouTube ↗22m

" summary

Bitnami runs automated pipelines that validate 180 applications across containers and Windows installers on 20+ platforms, producing thousands of releases per month. The system builds images, deploys them to target environments (public clouds, vSphere, Kubernetes), runs end-to-end UI login and workflow scripts, checks Helm charts, runs vulnerability and antivirus scanners, and records failures back to upstream versions. Demonstrated with WordPress, the pipeline finds specific issues (dozens of CVEs), tracks fixes, and gates publishes so only validated releases reach users.

AI-written summary · about

" chapters (6)

1. 0:00Start
2. 0:53Bitnami is a Catalog of Free Open Source Software 10+ years building and maintaining software packages
3. 1:40Testing and publishing the catalog is hard...
4. 4:07Automation is key
5. 18:58Lessons learned
6. 20:47What's next?

" related talks

• 53mTransforming testing methodologies: From manual to robust strategiesTodd Eaton · Breakpoint 2020
• 32mBuilding Continuous Integration and FeedbackChris McFee · DevOps Enterprise Summit London 2019
• 26mThe Impact of Testing on a DevOps PipelineBob Fornal · Commit Your Code 2024
• 23mAre you releasing the right product?Rohit Singhal · HUSTEF 2018
• 35mMassively Continuous Integration: From 3 days to 30 minutesDavid Tolley, Jesse Dowdle · SeleniumConf 2012 London
• 49mThe Whole Team Approach to Testing in Continuous DeliveryLisa Crispin · DevDotNext 2020 Digital Edition
• 45mHow We at 1C Test Software That Runs on WindowsPeter Gribanov · TestCon Moscow 2019
• 50mRelease & Iterate Faster: Stop Manual TestingDrew Hannay · Android Summit 2017