Tool for writing large xarray datasets to zarr stores with independent processes
Project description
xpartition provides a way to split N-dimensional dask-backed arrays into
a user-specified number of blocks of dask chunks. This can be useful for
assigning work to batch jobs on HPC systems or Dataflow workers in an
Apache Beam pipeline in the cloud.
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
xpartition-0.2.2.tar.gz
(15.9 kB
view details)
Built Distribution
File details
Details for the file xpartition-0.2.2.tar.gz
.
File metadata
- Download URL: xpartition-0.2.2.tar.gz
- Upload date:
- Size: 15.9 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/5.1.1 CPython/3.12.4
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | b75dddd4392816381ce4cc84ab7845f694cb4b71a74f2107f53735ae42f286c4 |
|
MD5 | 83838cd095a7180d3ea8bf3bf56fb52c |
|
BLAKE2b-256 | 608c30dc938d51ad75457153351859a8b1d617ce2abc150f10f420c46a3abc22 |
Provenance
File details
Details for the file xpartition-0.2.2-py3-none-any.whl
.
File metadata
- Download URL: xpartition-0.2.2-py3-none-any.whl
- Upload date:
- Size: 7.7 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/5.1.1 CPython/3.12.4
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | ff78207ed9826a666229b62d15ff3890c408f25cf09fbe908b55e8d7b53c16e2 |
|
MD5 | 74a0fcd8e7c556061b2d0c607d60286b |
|
BLAKE2b-256 | 7c4973215bd92c00acc9c2243c55c27e387adb18181d3f30183c56715a285cc1 |