Skip to main content

Manage DBnomics fetchers

Project description

DBnomics fetcher ops

Manage DBnomics fetchers: list, configure and run pipelines.

Install

pip install dbnomics-fetcher-ops[cli]

Usage

Configure a fetcher

The configure command needs write privileges. Create a GitLab personal access token having the api scope, and pass it using the --gitlab-private-token option or the GITLAB_PRIVATE_TOKEN environment variable in ~/.config/dbnomics/dbnomics-fetchers.env.

dbnomics-fetchers -v configure scsmich --dry-run
# If everything seems OK, remove the --dry-run flag:
dbnomics-fetchers -v configure scsmich

List fetchers

dbnomics-fetchers -v list

Run fetcher pipelines

# Replace PROVIDER_SLUG by the real value:
dbnomics-fetchers -v run --provider-slug PROVIDER_SLUG

# To run a pipeline for each fetcher:
dbnomics-fetchers -v list --slug | xargs -I {} dbnomics-fetchers -v run --provider-slug {}

Development

Install Poetry.

# git clone repo or fork
cd dbnomics-fetcher-ops
poetry install
cp .env.example .env

Run commands with:

poetry shell
dbnomics-fetchers COMMAND

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

dbnomics_fetcher_ops-0.6.0.tar.gz (31.5 kB view details)

Uploaded Source

Built Distribution

dbnomics_fetcher_ops-0.6.0-py3-none-any.whl (42.3 kB view details)

Uploaded Python 3

File details

Details for the file dbnomics_fetcher_ops-0.6.0.tar.gz.

File metadata

  • Download URL: dbnomics_fetcher_ops-0.6.0.tar.gz
  • Upload date:
  • Size: 31.5 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.2.2 CPython/3.10.11 Linux/5.10.0-14-amd64

File hashes

Hashes for dbnomics_fetcher_ops-0.6.0.tar.gz
Algorithm Hash digest
SHA256 521bdc43c2e7688d8daec5af722c23e1fffb74c822dc3de2192dd8f63c3a1eb8
MD5 5d1a65344eb9c7062e44431e353bb84e
BLAKE2b-256 81b3865bb1c2279125f7a977e8e62e396097b14f9a1c983e02585cae49e4ca37

See more details on using hashes here.

File details

Details for the file dbnomics_fetcher_ops-0.6.0-py3-none-any.whl.

File metadata

File hashes

Hashes for dbnomics_fetcher_ops-0.6.0-py3-none-any.whl
Algorithm Hash digest
SHA256 ca48054d69f4da31ea1f6136e79d48e60d1b2c1e09b836f79ad7d36c24f09517
MD5 25f4edd250d0a2ce38aaedbb1e9f29be
BLAKE2b-256 7a1cc9cb11e27d40bab6c9b1475440d4fdb1ea1541d027cd03af0af18c0087d7

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page