Bounded-memory serverless distributed N-dimensional array processing
Project description
Cubed
Note: this is a proof-of-concept, and many things are incomplete or don't work.
Bounded-memory serverless distributed N-dimensional array processing
Cubed is a distributed N-dimensional array library implemented in Python using bounded-memory serverless processing and Zarr for storage.
- Implements the Python Array API standard (see coverage status)
- Guaranteed maximum memory usage for standard array functions
- Follows Dask Array's chunked array API (
map_blocks
,rechunk
,apply_gufunc
, etc) - Zarr for persistent and intermediate storage
- Multiple serverless runtimes: Python (in-process), Lithops, Modal, Apache Beam
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
cubed-0.6.0.tar.gz
(79.7 kB
view details)
Built Distribution
cubed-0.6.0-py3-none-any.whl
(102.4 kB
view details)
File details
Details for the file cubed-0.6.0.tar.gz
.
File metadata
- Download URL: cubed-0.6.0.tar.gz
- Upload date:
- Size: 79.7 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/4.0.1 CPython/3.8.13
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | e3c7bca27a3ece6fc3095c5456a55e6b4e5030bffabbf47c3d12e273f046970b |
|
MD5 | dc6cd73bda251e34c3e69e5cfc5d9594 |
|
BLAKE2b-256 | 48a5648d055caf2dab45a5b079c4c8eecebe2060777e508ad6fecae86b688bb3 |
File details
Details for the file cubed-0.6.0-py3-none-any.whl
.
File metadata
- Download URL: cubed-0.6.0-py3-none-any.whl
- Upload date:
- Size: 102.4 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/4.0.1 CPython/3.8.13
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 9565d786fd04fdffe2f7d903de8a63b054f3204a572978c16eecd362d9d20377 |
|
MD5 | 66ca264526efbc71ff5aadcf200ae9ea |
|
BLAKE2b-256 | f6e11f235370d5d219e9d122f0f4f1a6e086e23980424c6b2de446a400a6686d |