High Level Expressions for Dask
Reason this release was yanked:
Critical performance regression
Project description
Dask Expressions
Dask DataFrames with query optimization.
This is a rewrite of Dask DataFrame that includes query optimization and generally improved organization.
More in our blog posts:
Example
import dask_expr as dx
df = dx.datasets.timeseries()
df.head()
df.groupby("name").x.mean().compute()
Query Representation
Dask-expr encodes user code in an expression tree:
>>> df.x.mean().pprint()
Mean:
Projection: columns='x'
Timeseries: seed=1896674884
This expression tree will be optimized and modified before execution:
>>> df.x.mean().optimize().pprint()
Div:
Sum:
Fused(375f9):
| Projection: columns='x'
| Timeseries: dtypes={'x': <class 'float'>} seed=1896674884
Count:
Fused(375f9):
| Projection: columns='x'
| Timeseries: dtypes={'x': <class 'float'>} seed=1896674884
Stability
This is the default backend for dask.DataFrame since version 2024.3.0.
API Coverage
Dask-Expr covers almost everything of the Dask DataFrame API. The only missing features are:
- named GroupBy Aggregations
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
File details
Details for the file dask_expr-1.1.17.tar.gz.
File metadata
- Download URL: dask_expr-1.1.17.tar.gz
- Upload date:
- Size: 223.5 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/5.0.0 CPython/3.11.8
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | ca73b1788f168855a599cd31117f5ee4a92b2b26abfb1d8f934cf794577d6f1a |
|
| MD5 | 785a72808fe8cf410affa2f8c9c9d996 |
|
| BLAKE2b-256 | 9026e530d1fb0ca323c30cde44474de60baf7bfc7d1ee6e81f40a9d006faaa8f |
Provenance
File details
Details for the file dask_expr-1.1.17-py3-none-any.whl.
File metadata
- Download URL: dask_expr-1.1.17-py3-none-any.whl
- Upload date:
- Size: 244.1 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/5.0.0 CPython/3.11.8
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 8cc6f9dba19ba3fa01c6529caf8050709164b40179b263ed0cccdc7fa76da943 |
|
| MD5 | af269e69b80ef75e65d162d5ab42b411 |
|
| BLAKE2b-256 | f5ecc48834964e436ed62a17d9717f813eb5e464b5962aeeffdd576e46a2b89b |
