Manage DBnomics fetchers
Project description
DBnomics fetcher ops
Manage DBnomics fetchers: list, configure and run pipelines.
Install
pip install dbnomics-fetcher-ops[cli]
Usage
Configure a fetcher
The configure command needs write privileges. Create a GitLab personal access token having the api
scope, and pass it using the --gitlab-private-token
option or the GITLAB_PRIVATE_TOKEN
environment variable in ~/.config/dbnomics/dbnomics-fetchers.env
.
dbnomics-fetchers -v configure scsmich --dry-run
# If everything seems OK, remove the --dry-run flag:
dbnomics-fetchers -v configure scsmich
List fetchers
dbnomics-fetchers -v list
Run fetcher pipelines
# Replace PROVIDER_SLUG by the real value:
dbnomics-fetchers -v run --provider-slug PROVIDER_SLUG
# To run a pipeline for each fetcher:
dbnomics-fetchers -v list --slug | xargs -I {} dbnomics-fetchers -v run --provider-slug {}
Development
Install Poetry.
# git clone repo or fork
cd dbnomics-fetcher-ops
poetry install
cp .env.example .env
Run commands with:
poetry shell
dbnomics-fetchers COMMAND
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
File details
Details for the file dbnomics_fetcher_ops-0.4.14.tar.gz
.
File metadata
- Download URL: dbnomics_fetcher_ops-0.4.14.tar.gz
- Upload date:
- Size: 15.6 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: poetry/1.2.2 CPython/3.10.8 Linux/5.10.0-14-amd64
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 659e470079299d88de173420c35c8c103ccb8612063ac8e25dbf4d5cc1fa52df |
|
MD5 | 63f087774e32a7f6e358c15083e202e0 |
|
BLAKE2b-256 | d24e8b4c22f0e5818b79598b8605777701708afba4282b76cc38950be6cd3601 |
File details
Details for the file dbnomics_fetcher_ops-0.4.14-py3-none-any.whl
.
File metadata
- Download URL: dbnomics_fetcher_ops-0.4.14-py3-none-any.whl
- Upload date:
- Size: 24.6 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: poetry/1.2.2 CPython/3.10.8 Linux/5.10.0-14-amd64
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 40baf3319252268e439dae68cd0c455ce381fe6b706680578f9e50aa9c74cd8f |
|
MD5 | aae4ed500d4c239cb10a349b9789402e |
|
BLAKE2b-256 | 92ca49dedce391f193aef2c1336bb5da72777dd1051c79da2d15672f09882f53 |