Understanding Polars Expressions when you're used to pandas
summary
Polars expressions are presented as a function from DataFrame to Series that enables lazy execution and optimizer-driven reuse (e.g., shared pl.col().shift(1) is computed once), backed by a GPU engine behind a feature flag and industry reports of up to 10× shorter pipelines. Groupby aggregations auto-explode aggregates to scalars for convenience. A concrete pandas reimplementation is shown (an Expression class with __call__ and operator overloads) proving the model, and demos with lazy/eager modes confirm the approach works.
AI-written summary · about
chapters (12)
- 0:00Introduction
- 1:02Why care about Polars
- 4:12Polars crash course
- 6:20Polars expressions
- 7:22Mental model for expressions
- 10:16Multi-column expressions
- 11:59Multi-output expressions
- 14:05Group by aggregations
- 18:27Reimplementing expressions
- 24:55Expression reimplementation demo
- 27:03Summary
- 27:45Q&A
related talks
28mExpressive & fast dataframes in Python with polars
22mDon’t Write Polars Code with a Pandas Accent
38mExpressive and fast dataframes in Python with polars
01h 32mAn Introduction to Polars
58mFrom Pandas to Polars Upgrading Your Data Workflow
30mIs the great dataframe showdown finally over? Enter: polars
02h 14mGetting Started with Polars
01h 16mPower up your Polars code with Polars extention