Scale By the Bay 2021 intro video by Russell Spitzer
summary
Explains an implementation of z-ordering inside Apache Iceberg that clusters files with a Z-order curve so multi-dimensional filters avoid full table scans. Describes how data gets rewritten into Z-order ranges, how file pruning and predicate pushdown interact, and shows measured reductions in scanned bytes and query latency versus single-column sorts. Demonstrates the built pipeline and reports that Z-order clustering enables efficient queries on arbitrary columns.
AI-written summary · about
related talks
52mApache Iceberg - An Architectural Look Under the Covers
01h 04mAn Extremely Technical Overview of How Apache Iceberg Planning Actually Works
37mApache Iceberg: An Architectural Look Under the Covers
31mHow Apache Iceberg Enables Multi-Engine Data Platforms
49mHow Apache Iceberg Really Works
41mTip of the Iceberg
46mTake the Polar Plunge: A Fearless Introduction to Apache Iceberg™
39mIntroducing Apache Iceberg: Tables Designed for Object Stores