In-Process Analytical Data Management with DuckDB
summary
DuckDB is an in-process analytical engine that runs SQL directly on R data frames with no serialization, showing a 10 million‑row load into Postgres taking ~10s while the in‑process path returns to R in ~0.1s; a heavier 84 million‑row Parquet query completes interactively. It uses vectorized execution, automatic parallelism and transactionality, can go out-of-core on all operators, reads/writes Parquet/CSV/JSON in parallel, is MIT‑licensed, and the demos work as claimed.
AI-written summary · about
chapters (7)
- 0:00Introduction
- 0:45Database challenges
- 4:20Introduction to DuckDB
- 5:14Design philosophy
- 8:53R integration
- 11:08Live demo
- 17:41Conclusion and QA
related talks
27mIn Process Analytical Data Management with DuckDB
40mDuckDB: Harnessing in-process analytics for data science and beyond
34mData Wrangling with DuckDB
01h 02mAnalytics for not-so-big data with DuckDB
28mAnalyze data easily with duckdb - and the implications on data architectures
21mWhat can Postgres learn from DuckDB?
24mpg_duckdb: Ducking awesome analytics in Postgres
40mDuckDB beyond the notebook