Skip to main content

High Level Expressions for Dask

Project description

Dask Expressions

Dask DataFrames with query optimization.

This is a rewrite of Dask DataFrame that includes query optimization and generally improved organization.

More in our blog posts:

Example

import dask_expr as dx

df = dx.datasets.timeseries()
df.head()

df.groupby("name").x.mean().compute()

Query Representation

Dask-expr encodes user code in an expression tree:

>>> df.x.mean().pprint()

Mean:
  Projection: columns='x'
    Timeseries: seed=1896674884

This expression tree will be optimized and modified before execution:

>>> df.x.mean().optimize().pprint()

Div:
  Sum:
    Fused(375f9):
    | Projection: columns='x'
    |   Timeseries: dtypes={'x': <class 'float'>} seed=1896674884
  Count:
    Fused(375f9):
    | Projection: columns='x'
    |   Timeseries: dtypes={'x': <class 'float'>} seed=1896674884

Stability

This is the default backend for dask.DataFrame since version 2024.3.0.

API Coverage

Dask-Expr covers almost everything of the Dask DataFrame API. The only missing features are:

  • named GroupBy Aggregations

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

dask_expr-1.1.3.tar.gz (188.8 kB view details)

Uploaded Source

Built Distribution

dask_expr-1.1.3-py3-none-any.whl (205.7 kB view details)

Uploaded Python 3

File details

Details for the file dask_expr-1.1.3.tar.gz.

File metadata

  • Download URL: dask_expr-1.1.3.tar.gz
  • Upload date:
  • Size: 188.8 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/5.0.0 CPython/3.11.8

File hashes

Hashes for dask_expr-1.1.3.tar.gz
Algorithm Hash digest
SHA256 ce8e44dfed30b4d9e6a549d0ed8cb5798273645fb9a16733d0687dc84615a94b
MD5 b82160ea1fc9c101cde62759d8494dfd
BLAKE2b-256 0b6b4aab40c0887c1f4dd731d4d2f04db0f1335ca9b411a5d0335dcd7f05ca03

See more details on using hashes here.

Provenance

File details

Details for the file dask_expr-1.1.3-py3-none-any.whl.

File metadata

  • Download URL: dask_expr-1.1.3-py3-none-any.whl
  • Upload date:
  • Size: 205.7 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/5.0.0 CPython/3.11.8

File hashes

Hashes for dask_expr-1.1.3-py3-none-any.whl
Algorithm Hash digest
SHA256 e6ad2fab9ffe7dbe0fc52451b5a0dc5588f36cd5677168cfb0b73c70f05e465f
MD5 b4d14ffd9351a67e6329585dbc17bb47
BLAKE2b-256 d88c31238dff302310c0861c99c83343099ddd014be0900752252c67f70d8657

See more details on using hashes here.

Provenance

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page