Investigation: Data Platforms on European Cloud Providers
summary
Claim: an open source, Kubernetes-based minimum viable data platform runs on multiple European clouds and meets analytics, scheduling and IAM needs; implementation uses Trino + Citadel + Open Policy Agent with Airflow and dbt, object storage S3‑compatible blobs, and Terraform for deployment. Evaluation tests four providers (Scaleway, OVH, Exoscale, UpCloud), notes missing fine‑grained blob IAM and some Terraform rough edges, and concludes managed Kubernetes + Terraform plus Scaleway and OVH are the most practical choices.
AI-written summary · about
chapters (9)
- 0:00European cloud data platforms
- 2:13Reasons for EU providers
- 4:25Open-source data platform design
- 9:24Core data platform components
- 13:39Platform limitations and fixes
- 16:28Open-source platform summary
- 17:10Evaluating EU cloud providers
- 26:51Final recommendations
- 28:19Q&A
related talks
49mPublic cloud in regulated industry, not just swipe of a cred
45mDesigning Sovereign & Secure Cloud Native Infrastructures for the Public Sect...
52mHow Sovereign Solution Providers are Securing Europe’s Digital Borders?
26mCloud-Native Dataspaces: Experiences from the German Research Data Ecosystem
23mCompliance Beyond Security: a Cloud Native GDPR Implementation Experience
47mData Mesh in Kubernetes
26mBuilding the European Weather Cloud with Open source software : An end to end journey.
34mCloud Agnostic Data Platform with DBT, Trino, Iceberg and MinIO