Skip to main content

A library for rechunking arrays.

Project description

Rechunker

Documentation Status Python package

Rechunker is a Python package which enables efficient and scalable manipulation of the chunk structure of chunked array formats such as Zarr and TileDB. Rechunker takes an input array (or group of arrays) stored in a persistent storage device (such as a filesystem or a cloud storage bucket) and writes out an array (or group of arrays) with the same data, but different chunking scheme, to a new location.

Rechunker is designed to be used within a parallel execution framework such as Dask.

See the documentation for more.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

rechunker-0.0.1.tar.gz (345.3 kB view details)

Uploaded Source

Built Distribution

rechunker-0.0.1-py3-none-any.whl (8.0 kB view details)

Uploaded Python 3

File details

Details for the file rechunker-0.0.1.tar.gz.

File metadata

  • Download URL: rechunker-0.0.1.tar.gz
  • Upload date:
  • Size: 345.3 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.1.1 pkginfo/1.5.0.1 requests/2.22.0 setuptools/45.2.0 requests-toolbelt/0.9.1 tqdm/4.36.1 CPython/3.7.6

File hashes

Hashes for rechunker-0.0.1.tar.gz
Algorithm Hash digest
SHA256 9cf5333aa5035fb36dcef26a4ad813eceae1c4634f7ccbd0b5ac66f3de8ed757
MD5 ca99a2ef60cfc209953f45ba98f18d58
BLAKE2b-256 14fea91ecec6792258e70fbf96ad25f741dd769bb3007d4097746e68b1be8302

See more details on using hashes here.

Provenance

File details

Details for the file rechunker-0.0.1-py3-none-any.whl.

File metadata

  • Download URL: rechunker-0.0.1-py3-none-any.whl
  • Upload date:
  • Size: 8.0 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.1.1 pkginfo/1.5.0.1 requests/2.22.0 setuptools/45.2.0 requests-toolbelt/0.9.1 tqdm/4.36.1 CPython/3.7.6

File hashes

Hashes for rechunker-0.0.1-py3-none-any.whl
Algorithm Hash digest
SHA256 b560b9ce45d6a62f6d9dbd04bba43580b0833d0c0af49ca8a022d93617399d1c
MD5 799b291ec6e2f3101f672173fa6a9d63
BLAKE2b-256 736a9fe3f9542840303fc9c243418b0fd13a3ff4d41a3a10ad9d70c5258583b5

See more details on using hashes here.

Provenance

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page