Skip to main content

Define, validate and transform DBnomics data

Project description

DBnomics Data Model

In DBnomics, once data has been downloaded from providers, it is converted in a common format: the DBnomics data model.

This Python package provides:

  • model classes defining DBnomics entities (provider, dataset, series, etc.) with their business logic and validation rules
  • a data storage abstraction to load and save those entities
  • adapters implementing the data storage abstraction (e.g. dbnomics_data_model.storage.adapters.filesystem)

This package is used in particular by the convert script of fetchers in order to save data.

Documentation

Please read https://db.nomics.world/docs/data-model/

Validate data

To validate a directory containing data written by (or compatible with) the "filesystem" adapter:

dbnomics-validate-storage <storage_dir>

This script outputs the data validation errors it finds.

Run tests

To run unit tests:

pytest

Code quality:

flake8 .

See also: https://git.nomics.world/dbnomics-fetchers/documentation/wikis/code-style

Publish a new version

For package maintainers:

git tag x.y.z
git push
git push --tags

GitLab CI will publish the package to https://pypi-hypernode.com/project/dbnomics-data-model/ (see .gitlab-ci.yml).

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

dbnomics-data-model-0.13.22.tar.gz (32.0 kB view details)

Uploaded Source

Built Distribution

dbnomics_data_model-0.13.22-py2.py3-none-any.whl (37.2 kB view details)

Uploaded Python 2 Python 3

File details

Details for the file dbnomics-data-model-0.13.22.tar.gz.

File metadata

  • Download URL: dbnomics-data-model-0.13.22.tar.gz
  • Upload date:
  • Size: 32.0 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.8.0 pkginfo/1.8.2 readme-renderer/34.0 requests/2.27.1 requests-toolbelt/0.9.1 urllib3/1.26.9 tqdm/4.63.1 importlib-metadata/4.11.3 keyring/23.5.0 rfc3986/2.0.0 colorama/0.4.4 CPython/3.10.4

File hashes

Hashes for dbnomics-data-model-0.13.22.tar.gz
Algorithm Hash digest
SHA256 72efbc8840b462aef5bcabdc5ecf1c02a90273fd9163d80f6fe1379070d9a7ce
MD5 00f697320e0d20461290e1dbee4612ca
BLAKE2b-256 27318fdf22f3d8a2edce03dc8bd3b80ff5ba1a2303e9428820f61e9175dc3b25

See more details on using hashes here.

File details

Details for the file dbnomics_data_model-0.13.22-py2.py3-none-any.whl.

File metadata

  • Download URL: dbnomics_data_model-0.13.22-py2.py3-none-any.whl
  • Upload date:
  • Size: 37.2 kB
  • Tags: Python 2, Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.8.0 pkginfo/1.8.2 readme-renderer/34.0 requests/2.27.1 requests-toolbelt/0.9.1 urllib3/1.26.9 tqdm/4.63.1 importlib-metadata/4.11.3 keyring/23.5.0 rfc3986/2.0.0 colorama/0.4.4 CPython/3.10.4

File hashes

Hashes for dbnomics_data_model-0.13.22-py2.py3-none-any.whl
Algorithm Hash digest
SHA256 1b658c3e79dc12c41e07a48779644ade865119c7bc445a5e5ea931b94957d685
MD5 34703282576a591300d53bc7dca900a8
BLAKE2b-256 b5d1ab056b9ab9c088c4426c200c261d7a9bc0b1bcd1b40c2e30f1063c509f1a

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page