The Pillars of the Iceberg Ecosystem: The Table Spec, The Catalog Spec & Table Service
summary
Apache Iceberg centers on three concrete deliverables: a Table Spec that already codifies V3: deletion vectors, default values, row lineage, geospatial and variant types (finalized months ago, implementations racing to add support), a Catalog Spec that standardizes a REST catalog so engines like Dremio Spark Flink DuckDB Trino and Snowflake can consistently locate and version metadata, and Table Services that actually rewrite files and expire snapshots (automated compaction, clustering, rollback and disaster recovery) so tables run fast and storage gets reclaimed.
AI-written summary · about
chapters (10)
- 0:00Iceberg ecosystem intro
- 2:37Iceberg table spec
- 7:37Iceberg V3 features
- 10:02Iceberg V4 directions
- 13:56Catalogs in Iceberg
- 19:32REST catalog API
- 26:36Optimizing Iceberg tables
- 31:51Automated table maintenance
- 34:57Iceberg learning resources
- 35:47Q&A
related talks
41mTip of the Iceberg
46mTake the Polar Plunge: A Fearless Introduction to Apache Iceberg™
31mHow Apache Iceberg Enables Multi-Engine Data Platforms
49mHow Apache Iceberg Really Works
34mApache Iceberg.
01h 12mHands-on with Apache Iceberg
52mApache Iceberg - An Architectural Look Under the Covers
50mDesigning a scalable data platform based on Apache Spark/Iceberg