Core utilities to serve HDF5 file contents
Project description
h5grove, core utilities to serve HDF5 file contents
h5grove is a Python package that provides utilities to design backends serving HDF5 file content: attributes, metadata and data. HDF5 files are accessed with h5py.
Rationale
There are several packages out there that can serve HDF5 files. However, they are dedicated to their usecases and settle on one implementation, hampering reusability.
In addition, some problems arise constantly when designing HDF5 backends. To name a few:
- Resolving external links
- Dealing with compression and slicing of datasets
- Encoding data efficiently and consistently (looking at you,
NaN,Infinityin JSON)
h5grove aims at providing building blocks that solve these common problems and can be reused in existing or new backends.
Installation
pip install h5grove
You can use h5grove low-level utilities whatever the backend implementation you choose. We simply provide additional utilities for Tornado and Flask that can be installed with:
pip install h5grove[flask] # For Flask
pip install h5grove[tornado] # For Tornado
Contents
Example implementations using Flask and Tornado are given in the example folder. These are functional backends that make use of the utilities provided by the h5grove package.
For more tailored use, you can make use of the low-level utilities in your own project. The package contains the following modules:
content: A hierarchy ofContentclasses that extract the relevant information (be it attributes, metadata or data) from the file (resolving links if possible) and expose them through methods.
Ideally, getting the information from a path in the file should be as simple as:
with h5py.File(filepath, "r") as h5file:
content = create_content(h5file, path)
# Get metadata (valid for all entities)
content.metadata()
# Get data (only valid for datasets)
content.data()
encoders: Functions that encode data and provide the appropriate headers to build request responses. The module provides a JSON and a binary encoder.flaskutils: Utilities dedicated to Flask backends. Notably provides a Blueprint.tornadoutils: Utilities dedicated to Tornado backends.
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
File details
Details for the file h5grove-0.0.4.tar.gz.
File metadata
- Download URL: h5grove-0.0.4.tar.gz
- Upload date:
- Size: 11.9 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/3.4.2 importlib_metadata/4.6.1 pkginfo/1.7.1 requests/2.26.0 requests-toolbelt/0.9.1 tqdm/4.61.2 CPython/3.6.14
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 47caa3b9b558ce4b2ad5c0e6a2021929d1cfc1f87e4ad97e89b63a329051a4b9 |
|
| MD5 | 1f29957d99875503a39c4ddc77f1ec0e |
|
| BLAKE2b-256 | 9d8bc42ac082de81931a5ebe902e6576f152b7880106fd594325a6084c418f43 |
File details
Details for the file h5grove-0.0.4-py3-none-any.whl.
File metadata
- Download URL: h5grove-0.0.4-py3-none-any.whl
- Upload date:
- Size: 10.4 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/3.4.2 importlib_metadata/4.6.1 pkginfo/1.7.1 requests/2.26.0 requests-toolbelt/0.9.1 tqdm/4.61.2 CPython/3.6.14
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 03945bf99a0d676f15dc19c293f9516ce4be10596bbae2023dcd92740c2fbbd9 |
|
| MD5 | 34eca074ba47139474cd274bfd4b2b64 |
|
| BLAKE2b-256 | 15fa3671f4b2920349302252564b29d22105a975c36b76e5925064d1377af21c |
