Skip to main content

High Level Expressions for Dask

Project description

Dask Expressions

Dask DataFrames with query optimization.

This is a rewrite of Dask DataFrame that includes query optimization and generally improved organization.

More in our blog posts:

Example

import dask_expr as dx

df = dx.datasets.timeseries()
df.head()

df.groupby("name").x.mean().compute()

Query Representation

Dask-expr encodes user code in an expression tree:

>>> df.x.mean().pprint()

Mean:
  Projection: columns='x'
    Timeseries: seed=1896674884

This expression tree will be optimized and modified before execution:

>>> df.x.mean().optimize().pprint()

Div:
  Sum:
    Fused(375f9):
    | Projection: columns='x'
    |   Timeseries: dtypes={'x': <class 'float'>} seed=1896674884
  Count:
    Fused(375f9):
    | Projection: columns='x'
    |   Timeseries: dtypes={'x': <class 'float'>} seed=1896674884

Stability

This is the default backend for dask.DataFrame since version 2024.3.0.

API Coverage

Dask-Expr covers almost everything of the Dask DataFrame API. The only missing features are:

  • named GroupBy Aggregations

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

dask_expr-1.1.12.tar.gz (222.1 kB view details)

Uploaded Source

Built Distribution

dask_expr-1.1.12-py3-none-any.whl (242.6 kB view details)

Uploaded Python 3

File details

Details for the file dask_expr-1.1.12.tar.gz.

File metadata

  • Download URL: dask_expr-1.1.12.tar.gz
  • Upload date:
  • Size: 222.1 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/5.0.0 CPython/3.11.8

File hashes

Hashes for dask_expr-1.1.12.tar.gz
Algorithm Hash digest
SHA256 360f6d240046b9bff6c129c6d26c16e9d850f095cd2245ac8cc32fb5579baca0
MD5 c46569643d95bf9019585c6855c81d58
BLAKE2b-256 148a10894555190d788a17abe6e81bc34cca109fe9559b1ae26d31e4490a2a7c

See more details on using hashes here.

Provenance

File details

Details for the file dask_expr-1.1.12-py3-none-any.whl.

File metadata

  • Download URL: dask_expr-1.1.12-py3-none-any.whl
  • Upload date:
  • Size: 242.6 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/5.0.0 CPython/3.11.8

File hashes

Hashes for dask_expr-1.1.12-py3-none-any.whl
Algorithm Hash digest
SHA256 aeaf9827d1d4a8b6e9b033cc9aa84f1bab1e4106e77a28477a7d26214fcf7069
MD5 776eea7c02870edf5e727862f22773ca
BLAKE2b-256 93160b6c75cb3cc003a57bcfc3f2eb69d40fc0d440c80de482c6968b75a8b967

See more details on using hashes here.

Provenance

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page