Lakehouse Format Interoperability With UniForm
summary
UniForm ships as GA tooling that lets you write Delta and read as Iceberg/Hoodie by translating metadata to other open lakehouse formats with minimal performance overhead. It includes a production-ready UC catalog implementing the Iceberg REST catalog API, supports maps/lists/arrays and liquid clustering, and already has over 4 exabytes loaded through UniForm across hundreds of customers. Delta ecosystem claims include ~9 exabytes processed, 1+ billion clusters/year, 500+ contributors, a tiny Delta Kernel library for easy integration, and deletion vectors saving ~100 trillion row rewrites.
AI-written summary · about
related talks
31mOpen Standards and Lakehouse AI Development
24mData Mesh and Lakehouse
26mDataEngBytes 2023 - SYD-T3-01 - Scott Eade
29mServing a multi-platform Data Lake via Delta, Iceberg, Unity and Glue
32mDesigning Data Infrastructure in the Age of Generative AI
28mLakehouse Architecture with Delta Lake and Databricks
46mOpen Table Formats in the Wild: From Parquet to Delta Lake and Back
34mData Lakehouse: Who, Why and How