Ibis framework, Making data science work at any scale
summary
Shows that Ibis translates familiar dataframe code into SQL and scalable engines so the same notebook runs locally and on large backends with minimal changes. Demo ingests grocery CSVs and multi‑gigabyte reviews, runs the same pipeline against local pandas, Snowflake and Spark backends, materializes a feature table back to the warehouse, and uses UDFs and batch map‑ops to run Python NLP at scale. Claims: same API, swapped backend, and it works without rewriting queries.
AI-written summary · about
chapters (5)
- 0:00Introduction
- 8:17What is Ibis
- 11:51Live demo overview
- 18:02Scaling with Ibis
- 26:07Summary and takeaways
related talks
01h 17mIbis: A fast, flexible, and portable tool for data analytics
02h 16mIntroduction to Ibis: blazing fast analytics with DuckDB...
44mIbis- Expressive analytics in Python at any scale
42mIbis: Don't Let the Engine Dictate the Interface
37mSpark Backend for Ibis: Seamless Transition Between Pandas...
27mBecause SQL Is Everywhere
01h 24mBuilding the composable Python data stack with Kedro & Ibis
37mAccelerating Python Analytics by In-Database Processing