Skip to main content

Manage DBnomics fetchers

Project description

DBnomics fetcher ops

Manage DBnomics fetchers: list, configure and run pipelines.

Install

pip install dbnomics-fetcher-ops[cli]

Usage

Configure a fetcher

The configure command needs write privileges. Create a GitLab personal access token having the api scope, and pass it using the --gitlab-private-token option or the GITLAB_PRIVATE_TOKEN environment variable in ~/.config/dbnomics/dbnomics-fetchers.env.

dbnomics-fetchers -v configure scsmich --dry-run
# If everything seems OK, remove the --dry-run flag:
dbnomics-fetchers -v configure scsmich

List fetchers

dbnomics-fetchers -v list

Run fetcher pipelines

# Replace PROVIDER_SLUG by the real value:
dbnomics-fetchers -v run --provider-slug PROVIDER_SLUG

# To run a pipeline for each fetcher:
dbnomics-fetchers -v list --slug | xargs -I {} dbnomics-fetchers -v run --provider-slug {}

Development

Install Poetry.

# git clone repo or fork
cd dbnomics-fetcher-ops
poetry install
cp .env.example .env

Run commands with:

poetry shell
dbnomics-fetchers COMMAND

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

dbnomics_fetcher_ops-0.5.1.tar.gz (28.6 kB view details)

Uploaded Source

Built Distribution

dbnomics_fetcher_ops-0.5.1-py3-none-any.whl (35.6 kB view details)

Uploaded Python 3

File details

Details for the file dbnomics_fetcher_ops-0.5.1.tar.gz.

File metadata

  • Download URL: dbnomics_fetcher_ops-0.5.1.tar.gz
  • Upload date:
  • Size: 28.6 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.2.2 CPython/3.10.8 Linux/5.10.0-14-amd64

File hashes

Hashes for dbnomics_fetcher_ops-0.5.1.tar.gz
Algorithm Hash digest
SHA256 71f37588333a71cb8931b63ca8e6d3da844e5aaae6ae39150ab36e47f9ad0661
MD5 c6bed4dfeb2f86928eeb111a9331c8ba
BLAKE2b-256 25b48f756a1a6fb2437085084a86ab3746aa15b3759139e9f2129d2cfff77b7f

See more details on using hashes here.

File details

Details for the file dbnomics_fetcher_ops-0.5.1-py3-none-any.whl.

File metadata

File hashes

Hashes for dbnomics_fetcher_ops-0.5.1-py3-none-any.whl
Algorithm Hash digest
SHA256 23dd5115ce8ae21193418977ee594a3da15dedb5ae747d21fd9a0c5592daad9f
MD5 20664662f67ee35e8b8d846c6d13c035
BLAKE2b-256 71a123cdffd2e26947559cbd2ce6a205b037f0c3927e4291bc41d351a4022ba2

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page