Benchmarking pandas against Polars from a pandas PoV

Or: How writing efficient pandas code matters


I've regularly seen benchmarks that show how much faster Polars is compared to pandas. The fact that Polars is faster than pandas is not too surprising since it is multithreaded while pandas is mostly single-core. The big difference surprises me though. That's …

Welcoming pandas 2.0

How the API is changing and how to leverage new functionalities


After 3 years of development, the second pandas 2.0 release candidate was released on the 16th of March. There are many new features in pandas 2.0, including improved extension array support, pyarrow support for DataFrames and …

A guide to efficient data selection in pandas

Improve performance when selecting data from a pandas object


There exist different ways of selecting a subset of data from a pandas object. Depending on the specific operation, the result will either be a view pointing to the original data or a copy of the original data. This ties …