DuckDB powering cancer genomics research
summary
Hartwig runs whole‑genome data for ~8,000 cancer patients, shared with 300+ research groups and driving ~200 papers, and builds GenOnco: a browser‑local tool that uses DuckDB WASM to query parquet files hosted on GCS via signed URLs, authorized through Keycloak/OpenID Connect. Mosaic renders YAML‑specified diagrams from query results. AI modules generate queries and visualization specs but never see result rows. The system pushes federation to researchers’ machines so multiple institutional domains can share queries without centralizing raw genomes.
AI-written summary · about
related talks
28mAnalyze data easily with duckdb - and the implications on data architectures
25mA quack of all trades: DuckDB, a versatile analytical database to keep in your toolkit
15mHugging a Duck: Democratizing Data Access and Exploration with DuckDB and Hugging Face Hub
27mMotherDuck: Taking flight with interactive analytics
40mDuckDB: Harnessing in-process analytics for data science and beyond
33mData preparation and analytics on your laptop with DuckDB
27mThe Duck and the DataFrame: A Data Engineer’s Journey with DuckDB
06mDuckDB Applications in Information Retrieval