Skip to main content

Manage DBnomics fetchers

Project description

DBnomics fetcher ops

Manage DBnomics fetchers: list, configure and run pipelines.

Install

pip install dbnomics-fetcher-ops[cli]

Usage

Configure a fetcher

The configure command needs write privileges. Create a GitLab personal access token having the api scope, and pass it using the --gitlab-private-token option or the GITLAB_PRIVATE_TOKEN environment variable in ~/.config/dbnomics/dbnomics-fetchers.env.

dbnomics-fetchers -v configure scsmich --dry-run
# If everything seems OK, remove the --dry-run flag:
dbnomics-fetchers -v configure scsmich

List fetchers

dbnomics-fetchers -v list

Run fetcher pipelines

# Replace PROVIDER_SLUG by the real value:
dbnomics-fetchers -v run --provider-slug PROVIDER_SLUG

# To run a pipeline for each fetcher:
dbnomics-fetchers -v list --slug | xargs -I {} dbnomics-fetchers -v run --provider-slug {}

Development

Install Poetry.

# git clone repo or fork
cd dbnomics-fetcher-ops
poetry install
cp .env.example .env

Run commands with:

poetry shell
dbnomics-fetchers COMMAND

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

dbnomics_fetcher_ops-0.4.15.tar.gz (15.8 kB view details)

Uploaded Source

Built Distribution

dbnomics_fetcher_ops-0.4.15-py3-none-any.whl (24.7 kB view details)

Uploaded Python 3

File details

Details for the file dbnomics_fetcher_ops-0.4.15.tar.gz.

File metadata

  • Download URL: dbnomics_fetcher_ops-0.4.15.tar.gz
  • Upload date:
  • Size: 15.8 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.2.2 CPython/3.10.8 Linux/5.10.0-14-amd64

File hashes

Hashes for dbnomics_fetcher_ops-0.4.15.tar.gz
Algorithm Hash digest
SHA256 8a38e642ecbb706d236e2ffd729efa552872cb4eac834c8b0bc878d663d4e5b1
MD5 f9d05ac1bad7f9b5c987cd2de5577ac7
BLAKE2b-256 f1c12000dc3bc9ef8de09a1f21d2761877492e8c1cc25aa186860c8cc00b5782

See more details on using hashes here.

File details

Details for the file dbnomics_fetcher_ops-0.4.15-py3-none-any.whl.

File metadata

File hashes

Hashes for dbnomics_fetcher_ops-0.4.15-py3-none-any.whl
Algorithm Hash digest
SHA256 d51ab5a87a94cc0218cf71bf883fe06230008464ff561a52f7b9beb16b4c7467
MD5 19c6d24bfaa2ca3cf5305c5606762a55
BLAKE2b-256 d95b9b8f477d73a75a21a087ba2b8382650b8ebbaf7b758b28e30c8e75ca2986

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page