Demystifying pandas internals

on YouTube ↗42m

" summary

Covers pandas data structures and internal design to explain why common high-level operations can become slow or complicated at scale. Focuses on pandas internals (Series, DataFrame, dtypes and memory/layout) to help diagnose performance issues and make more efficient data-wrangling decisions. Slides at the provided link illustrate the concepts.

AI-written summary · about

" related talks

• 01h 17mPandas from the Inside / "Big Pandas"Stephen Simmons · PyData Berlin 2017
• 01h 02mPandas from the insideStephen Simmons · PyData London 2016
• 32mPandas May Be Slow, but Pandas Doesn't Have to BeAndrew Vaccaro · PyColorado 2019
• 01h 21mPandas from the InsideStephen Simmons · PyData DC 2016
• 01h 48mPandas for BeginnersFrancisco Correoso · PyData Madrid 2016
• 01h 21mIntroduction to pandasTom Augspurger, Marc Garcia, Jeff Reback · PyData New York City 2019
• 37mJunior vs panda: anti-patterns of the pandas libraryElizaveta Pushkareva · PiterPy 2023
• 35mIdiomatic PandasMatt Harrison · Global Artificial Intelligence Virtual Conference 2022