Tool for writing large xarray datasets to zarr stores with independent processes
Project description
xpartition provides a way to split N-dimensional dask-backed arrays into
a user-specified number of blocks of dask chunks. This can be useful for
assigning work to batch jobs on HPC systems or Dataflow workers in an
Apache Beam pipeline in the cloud.
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
xpartition-0.2.1.tar.gz
(14.7 kB
view hashes)
Built Distribution
Close
Hashes for xpartition-0.2.1-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 8c3aafd94ec2420b9db21cd7b9dc3f43a618ab031220f1ae8792ea20e0e57a1e |
|
MD5 | 0f4011081722ba126e870f97074b8d26 |
|
BLAKE2b-256 | fe7ed213fb1b50d003137571a3cccc2caa9cd517f2e92dc5b295f965287090dc |