State of the Duck
summary
Releases 0.7 and 0.8 deliver concrete features: attach + SQLite backend lets DuckDB attach and transact against SQLite files; parallel JSON autodetect reads mixed JSON formats quickly; Parquet supports Hive-style partitioned writes and parallel order-preserving exports; pivot/unpivot, upserts, lateral and positional joins, and an as-of join are implemented and in use. Work-in-progress for 0.9 includes out-of-core hash aggregate spilling to disk and Apache Iceberg read support; adoption hits ~1.3M Python installs/month, 10K GitHub stars.
AI-written summary · about
chapters (17)
- 0:00Introduction
- 0:47Overview
- 3:15Json reading
- 4:20High Partitioning
- 5:37New Features
- 8:03Pivot
- 9:52Azure of joined
- 10:54Parallel data exports
- 11:47Spatial Extension
- 13:06Sneak Preview
- 13:25Out of Core Support
- 16:42Compressed Materialization
- 18:45Apache Iceberg
- 19:51Data Platform Integration
- 20:33Release Date
- 21:26Adoption
- 23:19GitHub 10K Stars
related talks
33mDuckDB – Overview and latest developments
28mAnalyze data easily with duckdb - and the implications on data architectures
40mDuckDB Meets Data Lakes
28mState of the Duck
23mState of the Duck
30mChanging Data With Confidence using DuckDB
25mA quack of all trades: DuckDB, a versatile analytical database to keep in your toolkit
34mData Wrangling with DuckDB