Polars is a blazingly fast DataFrames library implemented in Rust using Apache Arrow(2) as memory model.
Polars is a blazingly fast DataFrame library for manipulating structured data. The core is written in Rust, and available for Python, R and NodeJS. Key features: * Fast: Written from scratch in Rust, designed close to the machine and without external dependencies. * I/O: First class support for all common data storage layers: local, cloud storage & databases. * Intuitive API: Write your queries the way they were intended. Polars, internally, will determine the most efficient way to execute using its query optimizer. * Out of Core: The streaming API allows you to process your results without requiring all your data to be in memory at the same time * Parallel: Utilises the power of your machine by dividing the workload among the available CPU cores without any additional configuration. * Vectorized Query Engine: Using Apache Arrow, a columnar data format, to process your queries in a vectorized manner and SIMD to optimize CPU usage.