~/talk

Four Years of Data Mesh in Practice

Talkat GOTO Amsterdam 2023 · 2023-06-13..06-15· [databases]
slides:none on file

Four years of practice yields concrete claims: a reference implementation that deploys a data product in ~25–30 minutes using a JSON spec, Open Policy Agent checks, per‑domain AWS accounts, S3, EMR/Spark and Airflow or Databricks on Azure, and a catalog implemented with Apache Atlas/Azure Purview. Results: governance remains the hardest problem, executive sponsorship is required, small wins scale when repeated, and some clients get useful data in months (one in two months, another in three weeks) though a pure data mesh rarely appears.

AI-written summary · about

  1. 0:00Introduction
  2. 3:56What data mesh is
  3. 8:54Domain ownership
  4. 13:51Data platform basics
  5. 18:07Four years of lessons
  6. 21:36Executive sponsorship
  7. 23:02Data as product
  8. 26:29DevOps foundations
  9. 29:17Scaling data mesh
  10. 31:04Governance challenges
  11. 33:52Self-service platforms
  12. 36:47Multicloud cost control
  13. 37:51Cross-company data sharing
  14. 39:14Spreadsheets and literacy gaps
  15. 40:18Mesh vs fabric vs Lakehouse
  16. 41:01Closing and Q&A
~/search
type to search 6,249 conferences, 138,987 speakers and 185,172 talks
~/help
cmdctrl k
search every conference, speaker and series
/
focus the filter search
h
home
c
conferences
s
speakers
e
series
t
light / dark — the status bar button does the same
?
this help
esc
close this, then clear every filter — or just the search, while you are typing in it

Ignored while you are typing. Pages without a filter rail have no search to focus.