Skip to main content

Manage DBnomics fetchers

Project description

DBnomics fetcher ops

Manage DBnomics fetchers: list, configure and run pipelines.

Install

pip install dbnomics-fetcher-ops[cli]

Usage

Configure a fetcher

The configure command needs write privileges. Create a GitLab personal access token having the api scope, and pass it using the --gitlab-private-token option or the GITLAB_PRIVATE_TOKEN environment variable in ~/.config/dbnomics/dbnomics-fetchers.env.

dbnomics-fetchers -v configure scsmich --dry-run
# If everything seems OK, remove the --dry-run flag:
dbnomics-fetchers -v configure scsmich

List fetchers

dbnomics-fetchers -v list

Run fetcher pipelines

# Replace PROVIDER_SLUG by the real value:
dbnomics-fetchers -v run --provider-slug PROVIDER_SLUG

# To run a pipeline for each fetcher:
dbnomics-fetchers -v list --slug | xargs -I {} dbnomics-fetchers -v run --provider-slug {}

Development

Install Poetry.

# git clone repo or fork
cd dbnomics-fetcher-ops
poetry install
cp .env.example .env

Run commands with:

poetry shell
dbnomics-fetchers COMMAND

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

dbnomics_fetcher_ops-0.5.0.tar.gz (28.3 kB view details)

Uploaded Source

Built Distribution

dbnomics_fetcher_ops-0.5.0-py3-none-any.whl (34.6 kB view details)

Uploaded Python 3

File details

Details for the file dbnomics_fetcher_ops-0.5.0.tar.gz.

File metadata

  • Download URL: dbnomics_fetcher_ops-0.5.0.tar.gz
  • Upload date:
  • Size: 28.3 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.2.2 CPython/3.10.8 Linux/5.10.0-14-amd64

File hashes

Hashes for dbnomics_fetcher_ops-0.5.0.tar.gz
Algorithm Hash digest
SHA256 2cdfb2638c92bb832163b89de65fbfddc877813565fc905c0bce38d684a1dfa9
MD5 0da1430f199f8cddac80ec0f6db0ca59
BLAKE2b-256 4e099de2a46a47ff0c722f6b0bfb10e7b90262e756310183dd5f3d1cb29f7839

See more details on using hashes here.

File details

Details for the file dbnomics_fetcher_ops-0.5.0-py3-none-any.whl.

File metadata

File hashes

Hashes for dbnomics_fetcher_ops-0.5.0-py3-none-any.whl
Algorithm Hash digest
SHA256 4a9afaf302e946374bdbb013f875d97227d27d2401f8f93637d207d7116c3fc7
MD5 cdec661f1e97dac6d35d0304e92019d8
BLAKE2b-256 1af264671fc6dd0411b0d5d0c721d1bdfb137b6cb3846ffb31284714c12945d0

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page