Power up your Polars code with Polars extention
summary
Shows how to replace Python apply calls by writing Polars extensions in Rust using PyO3 and Maturin to register custom Polars expressions, implement element‑wise and whole‑column logic, and handle strings, multi‑column inputs and dynamic output type dispatch. Demonstrates building a plugin (cargo/pyproject names must match), handling lifetimes/clone for strings, and measurable speedups once datasets exceed ~1 million rows; workshop compiles and runs but notes version and Windows toolchain pitfalls.
AI-written summary · about
chapters (12)
- 0:00Welcome
- 1:12Polars plugins setup
- 6:58Project structure
- 13:20Rust expression logic
- 20:37Build and test plugin
- 37:24Break troubleshooting
- 40:43Celsius to Fahrenheit
- 45:33Largest value inputs
- 54:29Multiple data types
- 1:01:25String manipulation
- 1:08:20User input in expressions
- 1:12:21Resources closing
related talks
44mPolars; DataFrames in the multi-core era
01h 29mHow you (yes, you!) can write a Polars Plugin
49mKeynote on Polars Plugins
25mIntegrating Rust with Python...
38mExpressive and fast dataframes in Python with polars
01h 32mAn Introduction to Polars
28mExpressive & fast dataframes in Python with polars
58mFrom Pandas to Polars Upgrading Your Data Workflow