Datalad Metadata Model
Reason this release was yanked:
API changes and breaks >=0.2.0 dependencies
Project description
Datalad Metadata Model
This software implements the metadata model that datalad and datalad-metalad will use in the future (datalad-metalad>=0.3.0) to handle metadata.
Model Elements (the model layer)
The metadata model is defined by the API of the top-level classes. Those are:
-
MetadataRootRecord
-- holds top-level metadata information for a single version of a datalad dataset -
UUIDSet
-- holds metadata root records for a set of datasets that are identified by their UUIDs and their version. -
TreeVersionList
-- holds metadata root records and a sub-dataset tree for a dataset version and its sub-datasets -
Metadata
-- represents metadata for a single item, i.e. dataset or file. Metadata is associated with extractor names and extraction parameters. -
DatasetTree
-- a representation of the sub-dataset hierarchy of a dataset -
FileTree
-- a representation of the file-tree of a dataset -
...
Because of the large size of some datalad-datasets, e.g. tens of thousands of sub-datasets and hundres of millions of files, the implementation allows focus-based operations on individual parts of the potentially very large metadata model. The implementation uses the proxy-pattern, that means, it loads, modifies, and saves only the minimal necessary model elements that are necessary to operate on the metadata-information that the user is interested in.
Storage layer
The model elements have to be persisted on a storage backend. How the model is mapped on storage backends is defined by the storage layer, that is to a large degree independent of the model layer. The intention is to support multiple storage backends in the past.
Currently only one storage backend is supported:
git-mapping
-- a storage backend that stores a metadata model in a git repository. The model objects are stored outside of existing branches. They are referenced bydatalad
-specific git-references underrefs/datalad/*
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Hashes for datalad-metadata-model-0.2.0rc5.tar.gz
Algorithm | Hash digest | |
---|---|---|
SHA256 | baec7b03785bce2b4a8041fe2a1551dae1d5e144fb50f8fc9756e48e58b3a60f |
|
MD5 | de4aacc57786f192ebe8b6ea77718557 |
|
BLAKE2b-256 | f2907d0bc3a090bf8b43eb9665d3c33fe70ab52b3452a0f78b03923c53b4fb6f |
Hashes for datalad_metadata_model-0.2.0rc5-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 321b7c5e3cd70b82a6893c3eea93661cfca600e48cd88c98b8b2f0919c54c882 |
|
MD5 | a6d58c64b4e1a0b8b48bfcf06bc739ac |
|
BLAKE2b-256 | c9b2dba0fc5123be15eeaf79a7eb27bd9bd6095fd124a356e8ebffe03807d83b |