Skip to main content

Manage DBnomics fetchers

Project description

DBnomics fetcher ops

Manage DBnomics fetchers: list, configure and run pipelines.

Install

pip install dbnomics-fetcher-ops[cli]

Usage

Configure a fetcher

The configure command needs write privileges. Create a GitLab personal access token having the api scope, and pass it using the --gitlab-private-token option or the GITLAB_PRIVATE_TOKEN environment variable in ~/.config/dbnomics/dbnomics-fetchers.env.

dbnomics-fetchers -v configure scsmich --dry-run
# If everything seems OK, remove the --dry-run flag:
dbnomics-fetchers -v configure scsmich

List fetchers

dbnomics-fetchers -v list

Run fetcher pipelines

# Replace PROVIDER_SLUG by the real value:
dbnomics-fetchers -v run --provider-slug PROVIDER_SLUG

# To run a pipeline for each fetcher:
dbnomics-fetchers -v list --slug | xargs -I {} dbnomics-fetchers -v run --provider-slug {}

Development

Install Poetry.

# git clone repo or fork
cd dbnomics-fetcher-ops
poetry install
cp .env.example .env

Run commands with:

poetry shell
dbnomics-fetchers COMMAND

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

dbnomics_fetcher_ops-0.5.2.tar.gz (28.9 kB view details)

Uploaded Source

Built Distribution

dbnomics_fetcher_ops-0.5.2-py3-none-any.whl (35.8 kB view details)

Uploaded Python 3

File details

Details for the file dbnomics_fetcher_ops-0.5.2.tar.gz.

File metadata

  • Download URL: dbnomics_fetcher_ops-0.5.2.tar.gz
  • Upload date:
  • Size: 28.9 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.2.2 CPython/3.10.8 Linux/5.10.0-14-amd64

File hashes

Hashes for dbnomics_fetcher_ops-0.5.2.tar.gz
Algorithm Hash digest
SHA256 9ff68b1dd50222f99c73e72df088b49c5413616805b2d8133b1970296e0c311f
MD5 9d88a5e053c201c6a83c2d9f0734e870
BLAKE2b-256 cef17b9ed00c7d509537971f4eac8cdc7812ce0e7ad7f87a4705521d654c0b65

See more details on using hashes here.

File details

Details for the file dbnomics_fetcher_ops-0.5.2-py3-none-any.whl.

File metadata

File hashes

Hashes for dbnomics_fetcher_ops-0.5.2-py3-none-any.whl
Algorithm Hash digest
SHA256 8708d16f7d793325b9a64209d020fdc90be047af99439b6a28b4441a1a5a6c37
MD5 934b4536760ffeab167ce306dabe5f95
BLAKE2b-256 3210ec04974e5e023d00577aae58a20cdb29279805d48a0d3ce1ce39c01fd68a

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page