Skip to main content

High Level Expressions for Dask

Project description

Dask Expressions

Dask DataFrames with query optimization.

This is a rewrite of Dask DataFrame that includes query optimization and generally improved organization.

More in our blog posts:

Example

import dask_expr as dx

df = dx.datasets.timeseries()
df.head()

df.groupby("name").x.mean().compute()

Query Representation

Dask-expr encodes user code in an expression tree:

>>> df.x.mean().pprint()

Mean:
  Projection: columns='x'
    Timeseries: seed=1896674884

This expression tree will be optimized and modified before execution:

>>> df.x.mean().optimize().pprint()

Div:
  Sum:
    Fused(375f9):
    | Projection: columns='x'
    |   Timeseries: dtypes={'x': <class 'float'>} seed=1896674884
  Count:
    Fused(375f9):
    | Projection: columns='x'
    |   Timeseries: dtypes={'x': <class 'float'>} seed=1896674884

Stability

This is the default backend for dask.DataFrame since version 2024.3.0.

API Coverage

Dask-Expr covers almost everything of the Dask DataFrame API. The only missing features are:

  • melt
  • named GroupBy Aggregations

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

dask-expr-1.0.5.tar.gz (168.1 kB view details)

Uploaded Source

Built Distribution

dask_expr-1.0.5-py3-none-any.whl (183.6 kB view details)

Uploaded Python 3

File details

Details for the file dask-expr-1.0.5.tar.gz.

File metadata

  • Download URL: dask-expr-1.0.5.tar.gz
  • Upload date:
  • Size: 168.1 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/5.0.0 CPython/3.11.8

File hashes

Hashes for dask-expr-1.0.5.tar.gz
Algorithm Hash digest
SHA256 341e48cae1675180b6a94d920b9d34d496dfddb09d89d2ecbb21bb6eb40f4908
MD5 90523d2c08cb6ea3d4ef8b80dece721a
BLAKE2b-256 5d476ff8d8967ddd1d7a57c45c7fe058e4375005f6c7a90f30e4157097871b47

See more details on using hashes here.

Provenance

File details

Details for the file dask_expr-1.0.5-py3-none-any.whl.

File metadata

  • Download URL: dask_expr-1.0.5-py3-none-any.whl
  • Upload date:
  • Size: 183.6 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/5.0.0 CPython/3.11.8

File hashes

Hashes for dask_expr-1.0.5-py3-none-any.whl
Algorithm Hash digest
SHA256 aab56d69421492dc347f1ff6007d2f75e37418c9cb541971373dec5bd5d2f058
MD5 ca315415c984d04c419a55cdd50c8b3b
BLAKE2b-256 5d1687399d15e5bb6048f5294febac08b0dd970a29fe58b284888bb6ba3952ac

See more details on using hashes here.

Provenance

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page