Airport for DuckDB: Letting DuckDB take Apache Arrow Flights
summary
Extension exposes DuckDB to Apache Arrow Flight servers over gRPC, enabling selects, inserts, updates, deletes, catalog-registered tables, table-in/out functions, and vectorized scalar UDFs; demos use Delta RS (Rust Delta Lake) with predicate pushdown and time travel and an AutoGluon flight server that fits a model in 200 seconds and returns predictions for Hacker News headlines. Geocoding example batches Arrow record batches for remote calls. Code is MIT-licensed, requires DuckDB 1.2, is on GitHub, and the demos run end-to-end.
AI-written summary · about
chapters (6)
- 0:00Introduction to Airport
- 2:22Delta Lake Integration
- 5:01Machine learning with SQL
- 8:15Geocoding and UDFs
- 10:07Feature review and future
- 11:43Q&A session
related talks
28mBridging Python and Lakehouse worlds with Arrow Flight and DuckDB.
25mA quack of all trades: DuckDB, a versatile analytical database to keep in your toolkit
33mArrow in Flight - New Developments in Data Connectivity
28mAnalyze data easily with duckdb - and the implications on data architectures
01h 02mApache Arrow: High-Performance Columnar Data Framework
07mAerodynamic data models: Flying fast at scale with DuckDB
24mLeveraging the Apache Flight Python Client and InfluxDB
06mA quack at building scalable data pipelines with DuckDB