Skip to main content

High Level Expressions for Dask

Project description

Dask Expressions

Dask DataFrames with query optimization.

This is a rewrite of Dask DataFrame that includes query optimization and generally improved organization.

More in our blog posts:

Example

import dask_expr as dx

df = dx.datasets.timeseries()
df.head()

df.groupby("name").x.mean().compute()

Query Representation

Dask-expr encodes user code in an expression tree:

>>> df.x.mean().pprint()

Mean:
  Projection: columns='x'
    Timeseries: seed=1896674884

This expression tree will be optimized and modified before execution:

>>> df.x.mean().optimize().pprint()

Div:
  Sum:
    Fused(375f9):
    | Projection: columns='x'
    |   Timeseries: dtypes={'x': <class 'float'>} seed=1896674884
  Count:
    Fused(375f9):
    | Projection: columns='x'
    |   Timeseries: dtypes={'x': <class 'float'>} seed=1896674884

Stability

This is the default backend for dask.DataFrame since version 2024.3.0.

API Coverage

Dask-Expr covers almost everything of the Dask DataFrame API. The only missing features are:

  • named GroupBy Aggregations

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

dask_expr-1.1.10.tar.gz (221.9 kB view details)

Uploaded Source

Built Distribution

dask_expr-1.1.10-py3-none-any.whl (242.2 kB view details)

Uploaded Python 3

File details

Details for the file dask_expr-1.1.10.tar.gz.

File metadata

  • Download URL: dask_expr-1.1.10.tar.gz
  • Upload date:
  • Size: 221.9 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/5.0.0 CPython/3.11.8

File hashes

Hashes for dask_expr-1.1.10.tar.gz
Algorithm Hash digest
SHA256 3d9ac7231f41ce7a109faaf855a60d89bd4f90d304452894178a114470164014
MD5 e06c7b43b89f1b9e5dfa9ad72816cdcb
BLAKE2b-256 afd4c34302c5c1350468a8793c5d6acae06e829f6a5f674145668b589e47107f

See more details on using hashes here.

Provenance

File details

Details for the file dask_expr-1.1.10-py3-none-any.whl.

File metadata

  • Download URL: dask_expr-1.1.10-py3-none-any.whl
  • Upload date:
  • Size: 242.2 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/5.0.0 CPython/3.11.8

File hashes

Hashes for dask_expr-1.1.10-py3-none-any.whl
Algorithm Hash digest
SHA256 c6365c6fa6d3e386c5ee79bd20d4c89e566c0cf78fb6c762f74b2f04028935c6
MD5 b0b540ecd62aa74695c8a3cadec76389
BLAKE2b-256 2ce3cf7a05892b04b22b9e28ec25f8bc2acaa0304bf3128f76031e4363b63e21

See more details on using hashes here.

Provenance

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page