Manage DBnomics fetchers

These details have not been verified by PyPI

Project description

DBnomics fetcher ops

Manage DBnomics fetchers.

Usage

Install

pip install dbnomics-fetcher-ops

Configure a fetcher

Configure:

GitLab private token: use --gitlab-private-token option or GITLAB_PRIVATE_TOKEN environment variable. The private token can be a personal access token. It must have the api scope.

Run:

dbnomics-fetchers -v configure scsmich --dry-run
# If everything seems OK, remove the --dry-run flag:
dbnomics-fetchers -v configure scsmich

List fetchers

dbnomics-fetchers -v list

Run fetcher pipelines

# Replace PROVIDER_SLUG by the real value:
dbnomics-fetchers -v run --provider-slug PROVIDER_SLUG

# To run a pipeline for each fetcher:
dbnomics-fetchers -v list --slug | xargs -I {} dbnomics-fetchers -v run --provider-slug {}

Development

This repository uses Poetry.

# git clone repo or fork
cd dbnomics-fetcher-ops
poetry install
cp .env.example .env

Run commands with:

poetry run dbnomics-fetchers COMMAND

To use ipdb:

poetry shell
# Find venv dir with "which python"
ipdb3 /path/to/venv/bin/dbnomics-fetchers ...

Project details

These details have not been verified by PyPI

Release history Release notifications | RSS feed

0.6.1

Jun 27, 2023

0.6.0

Jun 6, 2023

0.5.4

Nov 30, 2022

0.5.3

Nov 25, 2022

0.5.2

Nov 25, 2022

0.5.1

Nov 25, 2022

0.5.0

Nov 25, 2022

0.4.16

Nov 18, 2022

0.4.15

Nov 18, 2022

0.4.14

Nov 16, 2022

0.4.13

Nov 15, 2022

0.4.12

Nov 15, 2022

This version

0.4.11

Jun 15, 2022

0.4.10

Jun 15, 2022

0.4.8

Jun 14, 2022

0.4.7

Jun 14, 2022

0.4.6

Jun 14, 2022

0.4.5

Mar 31, 2022

0.1.8

Mar 18, 2021

0.1.7

Nov 17, 2020

0.1.6

Nov 17, 2020

0.1.5

Nov 17, 2020

0.1.4

Nov 17, 2020

0.1.3

Oct 19, 2020

0.1.2

Sep 25, 2020

0.1.1

Sep 25, 2020

0.1.0

Jul 27, 2020

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

dbnomics-fetcher-ops-0.4.11.tar.gz (16.4 kB view details)

Uploaded Jun 15, 2022 Source

Built Distribution

dbnomics_fetcher_ops-0.4.11-py3-none-any.whl (25.3 kB view details)

Uploaded Jun 15, 2022 Python 3

File details

Details for the file dbnomics-fetcher-ops-0.4.11.tar.gz.

File metadata

Download URL: dbnomics-fetcher-ops-0.4.11.tar.gz
Upload date: Jun 15, 2022
Size: 16.4 kB
Tags: Source
Uploaded using Trusted Publishing? No
Uploaded via: poetry/1.1.13 CPython/3.10.5 Linux/5.10.0-14-amd64

File hashes

Hashes for dbnomics-fetcher-ops-0.4.11.tar.gz
Algorithm	Hash digest
SHA256	`be0faf23b500786966681ab18f0683e0b37d32b82ce53a4b877cbdf381d53627`
MD5	`ef658ca957b1b9c59768552f9af9898e`
BLAKE2b-256	`f67a657495b25cade4709fbc61ede875cab79d8155310b55ef47db921523dde5`

See more details on using hashes here.

File details

Details for the file dbnomics_fetcher_ops-0.4.11-py3-none-any.whl.

File metadata

Download URL: dbnomics_fetcher_ops-0.4.11-py3-none-any.whl
Upload date: Jun 15, 2022
Size: 25.3 kB
Tags: Python 3
Uploaded using Trusted Publishing? No
Uploaded via: poetry/1.1.13 CPython/3.10.5 Linux/5.10.0-14-amd64

File hashes

Hashes for dbnomics_fetcher_ops-0.4.11-py3-none-any.whl
Algorithm	Hash digest
SHA256	`e9fca84697010018012e1bd87444da1b294a420d939b683f7a9b71725516ec37`
MD5	`9aa2c5543fb508364f4b9598339277f7`
BLAKE2b-256	`42a9ae54a841ad66310a01d27c0af66ad754abbfcd3361f8922d57e239b3453f`