Bounded-memory serverless distributed N-dimensional array processing
Project description
Cubed
Note: this is a proof-of-concept, and many things are incomplete or don't work.
Bounded-memory serverless distributed N-dimensional array processing
Cubed is a distributed N-dimensional array library implemented in Python using bounded-memory serverless processing and Zarr for storage.
- Implements the Python Array API standard (see coverage status)
- Guaranteed maximum memory usage for standard array functions
- Follows Dask Array's chunked array API (
map_blocks,rechunk,apply_gufunc, etc) - Zarr for persistent and intermediate storage
- Multiple serverless runtimes: Python (in-process), Lithops, Modal, Apache Beam
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
cubed-0.5.0.tar.gz
(58.4 kB
view details)
Built Distribution
cubed-0.5.0-py3-none-any.whl
(76.8 kB
view details)
File details
Details for the file cubed-0.5.0.tar.gz.
File metadata
- Download URL: cubed-0.5.0.tar.gz
- Upload date:
- Size: 58.4 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/4.0.1 CPython/3.8.13
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 27f4779db77ba289e171f0d1e44d5d14367b8ecbb48b9681b99baa6193af26fb |
|
| MD5 | c21fe8da3fe4616653ec31f1ced5a5fe |
|
| BLAKE2b-256 | f95b47fe8443f8aae024e6fa2c68779d1780bafaa33989fd7e31623b44e6f1ff |
File details
Details for the file cubed-0.5.0-py3-none-any.whl.
File metadata
- Download URL: cubed-0.5.0-py3-none-any.whl
- Upload date:
- Size: 76.8 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/4.0.1 CPython/3.8.13
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 1b939131dbfdbf5da5a3c4765ff53857b2a2c22a657b982064757289360345d8 |
|
| MD5 | 94055dba2153fbd47191298e8ae8e10f |
|
| BLAKE2b-256 | 9cc5187fd8f17799d3962c84a15cde6d15a83da9ff94a2058892dba750e2d7ae |
