~/talk

Leveraging Argo WorkflowTemplates Within a Data Platform

on YouTube 22m
Talkat ArgoCon Europe 2023 · on Tuesday, 2023-04-18· at 10:50· Elicium Building | Elicium Ballroom 2 [Argo Workflows]· [data-engineering, devops-and-delivery]

speakers

name:J.P. Zivalich
links:none on file
name:Yao Lin
links:none on file

resources

video:https://youtu.be/g8TCgnrM648
slides:none on file

summary

Two companies build a control plane that syncs Argo WorkflowTemplates from GitHub/GitLab into clusters, using a deployment API + Postgres, Fluent Bit + GraphQL for history, and agents that pull templates at runtime; a demo shows a template is pulled down in 40s and runs to completion, templates lock at workflow creation so in‑flight runs stay stable, versioning uses metadata labels to pin git tag/branch/commit, promotion to production requires approval, cleanup uses either a cron + deletor or an agent loop with default TTL 24h and user-cancellable deletion.

AI-written summary · about

chapters (12)

  1. 0:00Argo WorkflowTemplates intro
  2. 1:23WorkflowTemplate cluster challenges
  3. 3:09Bloomberg template lifecycle
  4. 5:17Pipekit git-based platform
  5. 7:48Bloomberg version history
  6. 10:38Pipekit git integration goals
  7. 12:02Live demo workflow invocation
  8. 13:05Bloomberg template cleanup
  9. 15:38Pipekit garbage collection
  10. 17:27Bloomberg vs Pipekit comparison
  11. 19:12Future improvements
  12. 20:16Q&A

related talks

~/search
type to search 6,249 conferences, 138,987 speakers and 185,172 talks
~/help
cmdctrl k
search every conference, speaker and series
/
focus the filter search
h
home
c
conferences
s
speakers
e
series
t
light / dark — the status bar button does the same
?
this help
esc
close this, then clear every filter — or just the search, while you are typing in it

Ignored while you are typing. Pages without a filter rail have no search to focus.