The Butler and the Snake: Continuous Integration for Python

on YouTube ↗30m

" summary

Plone runs continuous integration on Jenkins for a 340‑core project with 8,500 unit/integration tests and about 70 acceptance tests, using buildout, virtualenv, tox, pytest/coverage and Robot Framework + Selenium (Sauce Labs). A small Python middleware called Mr Roboto maps commits to the right builds because multiple branches, Python 2.6/2.7/3.x and parallel jobs create many combinations. Early Jenkins had the build broken ~100% of the time; current runs take >1 hour and use slaves, Ansible provisioning, the port‑allocator plugin and zest‑releaser/devpi to aim for releaseable candidates on green.

AI-written summary · about

" chapters (13)

1. 0:00Intro
2. 1:37Plone Testing
3. 2:29Hudson / Jenkins
4. 4:09Version Control
5. 7:46Automated Build
6. 10:47Agreement on the Team
7. 12:16Broken Build
8. 13:21Continuous Integration Rules
9. 16:11Robot Framework / Saucelabs
10. 17:49Static Code Analysis
11. 19:43Scalability
12. 24:49Release Process
13. 27:41Summary

" related talks

• 28mThe Butler and the Snake - Continuous Integration for PythonTimo Stollenwerk · EuroPython 2015
• 40mThe Butler Did It: Putting Jenkins To Work For YouMichael Porter · MidCamp 2017
• 23mJenkins as a Python execution platformBarak Korren · PyCon Israel 2017
• 45mHighway to Continuous IntegrationDenis Trifonov · HighLoad++ 2014
• 39mA Pythonic Approach to Continuous DeliverySebastian Neubauer · EuroPython 2015
• 28mBest Practices for Continuous Integration in Python V02Moshe Zadka · PyCon US 2022
• 44mScaling Your Jenkins JobsKhai Do · Jenkins User Conference U.S. East 2015
• 39mIt's Not Called Continuous Integration (CI) for NothingDan Boutin · Jenkins User Conference U.S. East 2015