Workflow in Jenkins

on YouTube ↗46m

" summary

A new Groovy-based job type runs full pipelines as a single text script and uses a custom CPS continuation engine to serialize and resume execution; demo shows a Jenkins restart mid-run with the build continuing and an enterprise checkpoint resume restoring from a staging failure into a quick rebuild. It supports parallel sharding of tests, human approval steps, tool auto-install (Maven), Git-hosted flow libraries, a Docker demo, and is available as 0.1 beta5 (requires Jenkins 1.580 LTS).

AI-written summary · about

" chapters (6)

1. 0:00Intro
2. 2:31Use Cases: orchestrated activities • Multi-stage continuous deployment pipeline • Run part of build with a temporary server • Blue/green deployment + auto commit/abort • Parallel tests with automatic sharding • Automatic per-branch jobs (à la Literate)
3. 4:57Characteristics • Complex pipelines involving multiple stages • Non-sequential logic such as loops and forks • Long-running builds must survive outages • Interaction with humans pauses, input • Restartable builds in case of a transient error • Reusable definitions to avoid duplication • Comprehensible scripts one clear definition
4. 11:37Key features (what I already covered) • Entire flow is one concise Groovy script -for-loops, try-finally, fork-join, etc. . Can restart Jenkins while flow is running • Human input/approval integrated into flow
5. 18:47Resumption of Groovy flows • Transformed to continuation-passing style • Run on custom interpreter of Groovy • State of program saved at each pause point • Variables serialized and restored after restart - pickles: extensible object replacements
6. 44:57Summary • Simplifies complex orchestration • Define everything in single job • Workflow as Groovy code • Survives IVM loss, and even restartable • Extensible

" related talks

• 48mWorkflow in JenkinsJesse Glick · Jenkins User Conference Boston 2014
• 46mWorkflow in JenkinsKohsuke Kawaguchi, Jesse Glick · Jenkins User Conference San Francisco 2014
• 34mContinuous Delivery with Jenkins WorkflowMartin Reinhardt · code.talks 2017
• 49mJenkins Workflow: What's Up?Jesse Glick · Jenkins User Conference U.S. East 2015
• 50mJenkins in the Enterprise: Building Resilient CI InfrastructureKohsuke Kawaguchi, Harpreet Singh · Jenkins User Conference Europe 2014 Berlin
• 40mBuilding Pipelines at ScaleJulien Pivotto · Jenkins User Conference Europe 2014 Berlin
• 04mContinuous Delivery with Jenkins' New Declarative Pipeline & ArtifactoryPatrick Wolf, Ian employee · swampUP 2017
• 59mJenkins & continuous delivery pipelineJean-Philippe Briend · DevFest Nantes 2016