Skip to main content

Manage DBnomics fetchers

Project description

DBnomics fetcher ops

Manage DBnomics fetchers: list, configure and run pipelines.

Install

pip install dbnomics-fetcher-ops[cli]

Usage

Configure a fetcher

The configure command needs write privileges. Create a GitLab personal access token having the api scope, and pass it using the --gitlab-private-token option or the GITLAB_PRIVATE_TOKEN environment variable in ~/.config/dbnomics/dbnomics-fetchers.env.

dbnomics-fetchers -v configure scsmich --dry-run
# If everything seems OK, remove the --dry-run flag:
dbnomics-fetchers -v configure scsmich

List fetchers

dbnomics-fetchers -v list

Run fetcher pipelines

# Replace PROVIDER_SLUG by the real value:
dbnomics-fetchers -v run --provider-slug PROVIDER_SLUG

# To run a pipeline for each fetcher:
dbnomics-fetchers -v list --slug | xargs -I {} dbnomics-fetchers -v run --provider-slug {}

Development

Install Poetry.

# git clone repo or fork
cd dbnomics-fetcher-ops
poetry install
cp .env.example .env

Run commands with:

poetry shell
dbnomics-fetchers COMMAND

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

dbnomics_fetcher_ops-0.6.1.tar.gz (32.3 kB view details)

Uploaded Source

Built Distribution

dbnomics_fetcher_ops-0.6.1-py3-none-any.whl (44.4 kB view details)

Uploaded Python 3

File details

Details for the file dbnomics_fetcher_ops-0.6.1.tar.gz.

File metadata

  • Download URL: dbnomics_fetcher_ops-0.6.1.tar.gz
  • Upload date:
  • Size: 32.3 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.2.2 CPython/3.10.12 Linux/5.10.0-14-amd64

File hashes

Hashes for dbnomics_fetcher_ops-0.6.1.tar.gz
Algorithm Hash digest
SHA256 90a97080eec15295fe64a2eb3b003971c4624e456b77ccf1b534e1e6bffa6114
MD5 7f254fe6a68da94eeafe131b21674f40
BLAKE2b-256 e383239a592671a1047038af38198221f7cf533ead38f4fe85ce109e886779af

See more details on using hashes here.

File details

Details for the file dbnomics_fetcher_ops-0.6.1-py3-none-any.whl.

File metadata

File hashes

Hashes for dbnomics_fetcher_ops-0.6.1-py3-none-any.whl
Algorithm Hash digest
SHA256 76a8153f7132bd10a035538b9df84fe6d3c1db6e962917545ee317893e64e2d3
MD5 8cf77392c03dd35352286110f25d67dd
BLAKE2b-256 d32b43098a0a1f4252ba6a489f5e480c3ed0b85adb9e31731867f6855c8f0dc2

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page