Comparing Argo Workflows and Airflow in a Distributed Environment

on YouTube ↗26m

" summary

Compares Argo and Airflow by showing architecture, feature differences and live demos: Argo runs natively on Kubernetes with YAML manifests, a Python SDK, native S3 artifact support and cron workflows while Airflow is Python-first with many prebuilt connectors and harder Kubernetes fit; demo installs Argo, deploys Argo events, wires a GitHub webhook to trigger a coin flip workflow that creates pods and logs “heads” successfully, and shows basic metrics/exporter setup alongside a brief Airflow Python client demo.

AI-written summary · about

" chapters (11)

1. 0:00Workflow orchestration intro
2. 1:06Business use cases
3. 3:38Argo Workflows features
4. 4:42Apache Airflow architecture
5. 6:36Argo Workflows architecture
6. 8:24Argo vs Airflow features
7. 10:33Monitoring both tools
8. 11:38Demo: Argo Events & Workflows
9. 21:50Metrics & observability setup
10. 24:20Demo: Hera SDK for Argo
11. 25:51Q&A

" related talks

• 06mComparing Argo Workflows and Apache Airflow at ScaleJ.P. Zivalich · ArgoCon NA 2023
• 36mAutomating Cloud-native Spark Jobs with Argo WorkflowsCaelan Urquhart, Darko Janjić · Open Source Summit Europe 2022: Open AI + Data Forum
• 10mScaling Time Series Analysis With Argo Workflows: Patterns and Practi...A. Ambrosio · ArgoCon Europe 2025
• 27mBuilding a Data Science Platform with Argo WorkflowsJ.P. Zivalich, Will Wang · Kubernetes AI Day North America 2022
• 12mLightning Talk: CI/CD for Data Pipelines with Argo WorkflowsJ.P. Zivalich · ArgoCon 2022
• 29mLarge Scale Batch Processing with Argo Work...Rakesh Subramanian Suresh, Saravanan Balasubramanian · ArgoCon 2022
• 14mLightning Talk: Running Cloud-native Spark Jobs with Argo WorkflowsCaelan Urquhart, Darko Janjić · ArgoCon 2022
• 11mShipping Argo Workflows in PackagesJunaid Rahim, Nitin Sutrave · ArgoCon Europe 2023