Panel Discussion: How Open Source Helps DataOps
Panelat Open AI + Data Forum @ Open Source Summit North America 2022 · on Wednesday, 2022-06-22· at 15:45· Room 408/409 (Level 4), JW Marriott Austin, 110 E 2nd Street Austin, TX 78701·
summary
Panelists describe concrete wins: use Egeria to federate catalogues so disparate tools like Airflow, Great Expectations and DataHub share metadata; adopt Open Lineage event formats to trace pipelines; start with a 3–4 month pilot tied to a business owner to show value; expect model drift and dataset-scope limits when moving from ML experiments to production. Key tradeoffs: automate where safe and manage-by-exception with human oversight while building open-source bridges for metadata.
AI-written summary · about
chapters (5)
- 0:00Start
- 6:04Josh Mitchell
- 26:11Innovation Life Cycle
- 34:23Open Lineage
- 41:58What Are the Emerging Trends in the Devops
related talks
45mTechnical Challenges in Open Metadata
36mPanel Discussion: The Present and Future of Open Source Observability
29mOpen Source Powers The Modern Data Stack
42mPanel Discussion: Advancing Innovation Through Open Source: Lessons from the Vertical Industries
42mOpen Source in the Age of Cloud and Microservices
32mMastering Enterprise Open Source for Cloud and Vendor Independence
31mOpen Source – Yes, Please! but How? Experiences From the Future Energy Lab
40mOpening Open-Source with DevOps