~/talk

DuckDB is the New Pandas

Talkat PyCon India 2025 · 2025-09-12..09-15· [data-visualization, data-engineering]
name:Anand S
links:none on file
slides:none on file

Claims that DuckDB replaces Pandas with concrete evidence: a 17M-row groupby distinct on parcels runs 0.2s vs 4s (≈20–25× faster), uses all cores, and reads remote files via HTTPFS and Parquet on S3 to query a 1 TB / 16M-judgments dataset without downloading. Complex analytics (bench-wise average disposal time) runs against remote parquet, LLMs generate SQL scaffolding, and DuckDB embeds in Python/Node/wasm for interactive grading in the browser — Wasm browser embed demonstrates it actually works.

AI-written summary · about

  1. 0:00Introduction to DuckDB
  2. 1:30Why switch from Pandas
  3. 4:49Performance comparison with Pandas
  4. 6:16Querying remote files
  5. 7:48Processing large datasets
  6. 9:10Using LLMs for SQL queries
  7. 12:50Analyzing court judgments
  8. 18:43Anagram detection with DuckDB
  9. 22:45Embedding DuckDB everywhere
  10. 24:55Running DuckDB in browser
  11. 26:03Testing DuckDB with ChatGPT
  12. 27:06Extensions and future use
~/search
type to search 6,518 conferences, 143,918 speakers and 192,133 talks
~/help
cmdctrl k
search every conference, speaker and series
/
focus the filter search
h
home
c
conferences
s
speakers
e
series
t
light / dark — the status bar button does the same
← →
on a talk: 5 seconds back / forward
0–9
on a talk: jump to 0%–90% of the recording
?
this help
esc
close this, then clear every filter — or just the search, while you are typing in it

Ignored while you are typing. Pages without a filter rail have no search to focus.