Bounded-memory serverless distributed N-dimensional array processing
Project description
Cubed
Note: this is a proof-of-concept, and many things are incomplete or don't work.
Bounded-memory serverless distributed N-dimensional array processing
Cubed is a distributed N-dimensional array library implemented in Python using bounded-memory serverless processing and Zarr for storage.
- Implements the Python Array API standard (see coverage status)
- Guaranteed maximum memory usage for standard array functions
- Follows Dask Array's chunked array API (
map_blocks,rechunk,apply_gufunc, etc) - Zarr for persistent and intermediate storage
- Multiple serverless runtimes: Python (in-process), Lithops, Modal, Apache Beam
- Integration with Xarray via cubed-xarray
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
cubed-0.14.0.tar.gz
(123.2 kB
view details)
Built Distribution
cubed-0.14.0-py3-none-any.whl
(157.5 kB
view details)
File details
Details for the file cubed-0.14.0.tar.gz.
File metadata
- Download URL: cubed-0.14.0.tar.gz
- Upload date:
- Size: 123.2 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/5.0.0 CPython/3.12.2
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 96d4d0b808c89445a991be2e2650cfd54d7bdd6c3927fe4bbfff5bdc77bfb209 |
|
| MD5 | 8557afbdf2fe967b487acff74ac0f46b |
|
| BLAKE2b-256 | 7a0a9232109aab08d644178ac1c2f61025ee6e69efa928313c7b2b8309d610d2 |
File details
Details for the file cubed-0.14.0-py3-none-any.whl.
File metadata
- Download URL: cubed-0.14.0-py3-none-any.whl
- Upload date:
- Size: 157.5 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/5.0.0 CPython/3.12.2
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | a96c88a7dd1aecd32d3efe5257beed58ffa6e2f02b0056b822a62b490d72288d |
|
| MD5 | 21e0cd5b373fb5e2ba3e83274caebb36 |
|
| BLAKE2b-256 | 697cf169091bcc6bca14f2522441719ada032a6cc9f9d93ab554740259ab9911 |
