Skip to main content

Manage DBnomics fetchers

Project description

DBnomics fetcher ops

Manage DBnomics fetchers: list, configure and run pipelines.

Install

pip install dbnomics-fetcher-ops[cli]

Usage

Configure a fetcher

The configure command needs write privileges. Create a GitLab personal access token having the api scope, and pass it using the --gitlab-private-token option or the GITLAB_PRIVATE_TOKEN environment variable in ~/.config/dbnomics/dbnomics-fetchers.env.

dbnomics-fetchers -v configure scsmich --dry-run
# If everything seems OK, remove the --dry-run flag:
dbnomics-fetchers -v configure scsmich

List fetchers

dbnomics-fetchers -v list

Run fetcher pipelines

# Replace PROVIDER_SLUG by the real value:
dbnomics-fetchers -v run --provider-slug PROVIDER_SLUG

# To run a pipeline for each fetcher:
dbnomics-fetchers -v list --slug | xargs -I {} dbnomics-fetchers -v run --provider-slug {}

Development

Install Poetry.

# git clone repo or fork
cd dbnomics-fetcher-ops
poetry install
cp .env.example .env

Run commands with:

poetry shell
dbnomics-fetchers COMMAND

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

dbnomics_fetcher_ops-0.5.4.tar.gz (30.4 kB view details)

Uploaded Source

Built Distribution

dbnomics_fetcher_ops-0.5.4-py3-none-any.whl (40.2 kB view details)

Uploaded Python 3

File details

Details for the file dbnomics_fetcher_ops-0.5.4.tar.gz.

File metadata

  • Download URL: dbnomics_fetcher_ops-0.5.4.tar.gz
  • Upload date:
  • Size: 30.4 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.2.2 CPython/3.10.8 Linux/5.10.0-14-amd64

File hashes

Hashes for dbnomics_fetcher_ops-0.5.4.tar.gz
Algorithm Hash digest
SHA256 0583c16af72b9e7aff08ee3ff82f87c9e2da3c4264636a3ad94c361bd5ad3a35
MD5 210d2605214df49d4a7c0886d6731b08
BLAKE2b-256 941b0b4c452bb32ed9dd9f7e3e5b2a4013f91bcc5a8132c85adab23abb33c6a7

See more details on using hashes here.

File details

Details for the file dbnomics_fetcher_ops-0.5.4-py3-none-any.whl.

File metadata

File hashes

Hashes for dbnomics_fetcher_ops-0.5.4-py3-none-any.whl
Algorithm Hash digest
SHA256 c6fdc5b286d601e9e313538346353fe666595970c8d3a418d4b218afcd4aee71
MD5 abfa4aef9d2ba4f610d1efafd46a4163
BLAKE2b-256 4c4e43f5dd4314280555f61af5c399998f2211c155c8b8329bb80832ef22b12e

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page