Skip to main content

Manage DBnomics fetchers

Project description

DBnomics fetcher ops

Manage DBnomics fetchers: list, configure and run pipelines.

Install

pip install dbnomics-fetcher-ops[cli]

Usage

Configure a fetcher

The configure command needs write privileges. Create a GitLab personal access token having the api scope, and pass it using the --gitlab-private-token option or the GITLAB_PRIVATE_TOKEN environment variable in ~/.config/dbnomics/dbnomics-fetchers.env.

dbnomics-fetchers -v configure scsmich --dry-run
# If everything seems OK, remove the --dry-run flag:
dbnomics-fetchers -v configure scsmich

List fetchers

dbnomics-fetchers -v list

Run fetcher pipelines

# Replace PROVIDER_SLUG by the real value:
dbnomics-fetchers -v run --provider-slug PROVIDER_SLUG

# To run a pipeline for each fetcher:
dbnomics-fetchers -v list --slug | xargs -I {} dbnomics-fetchers -v run --provider-slug {}

Development

Install Poetry.

# git clone repo or fork
cd dbnomics-fetcher-ops
poetry install
cp .env.example .env

Run commands with:

poetry shell
dbnomics-fetchers COMMAND

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

dbnomics_fetcher_ops-0.5.3.tar.gz (28.9 kB view details)

Uploaded Source

Built Distribution

dbnomics_fetcher_ops-0.5.3-py3-none-any.whl (35.8 kB view details)

Uploaded Python 3

File details

Details for the file dbnomics_fetcher_ops-0.5.3.tar.gz.

File metadata

  • Download URL: dbnomics_fetcher_ops-0.5.3.tar.gz
  • Upload date:
  • Size: 28.9 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.2.2 CPython/3.10.8 Linux/5.10.0-14-amd64

File hashes

Hashes for dbnomics_fetcher_ops-0.5.3.tar.gz
Algorithm Hash digest
SHA256 33907ad9b53b4146c17c2012731b3f0aea7fd3dbbf2aa20a24160de0b4a39376
MD5 846e00f73eaf4e787137eaa0c359958f
BLAKE2b-256 d9e39ab170ae82fc55ecf3f02c6b5ed0485208ec9a09c03a9ccbd4b7cde2a731

See more details on using hashes here.

File details

Details for the file dbnomics_fetcher_ops-0.5.3-py3-none-any.whl.

File metadata

File hashes

Hashes for dbnomics_fetcher_ops-0.5.3-py3-none-any.whl
Algorithm Hash digest
SHA256 182d08163faf34c7e55f497df02c8f4d2e8048c9c9325db49f6dff3f9eebcb2f
MD5 85c4f5387c34c4336dced0d299f44796
BLAKE2b-256 4eb393b5f0029f3a968019c6d76669f5485375c3cdb41b76f6881f4fad7c53e0

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page