Determine appropriate chunk sizes for a given xarray dataset based on target chunk size and chunk aspect ratio
Project description
# dynamic_chunks
Determine appropriate chunk sizes for a given xarray dataset based on target chunk size and ‘chunk aspect ratio’
The chunk aspect ratio describes the amount of chunks along a given dimension. Take a dataset with two dimensions (a and b). A chunk aspect ratio {‘a’:2, ‘b’:1} means that the number of total chunks along b is twice that of b. This concept was inspired by a discussion with [Rich Signell](https://github.com/rsignell-usgs) at Scipy ‘23. The idea is that one might want to optimize the chunking of a dataset to make e.g. an operation along time n times slower than an operation along spatial dimensions.
## Useage TBW
## Developer Guide
Set up your development environment with conda:
` conda create --name dynamic_rechunking python=3.10 pip conda activate dynamic_rechunking pip install -e ".[test]" `
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Hashes for dynamic_chunks-0.0.1-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 33e27ba75293b50b906feb1fc27095ee1253aae826151f8930a3e0e8315a5e03 |
|
MD5 | 03c1e225e25b42caf7425278e383352c |
|
BLAKE2b-256 | 5331e492cef8579e22fa7e340b9d29201644656b858f5eea604686a33776f2d2 |