Code that is used by the DKIST Science Data Processing Airflow pipelines to process VBI data.
Project description
Overview
The dkist-processing-vbi library contains the implementation of the vbi pipelines as a collection of the dkist-processing-core framework and dkist-processing-common Tasks.
The recommended project structure is to separate tasks and workflows into seperate packages. Having the workflows in their own package facilitates using the build_utils to test the integrity of those workflows in the unit test. example
Build
Artifacts are built through bitbucket pipelines
The pipeline can be used in other repos with a modification of the package and artifact locations to use the names relevant to the target repo.
e.g. dkist-processing-test -> dkist-processing-vbi and dkist_processing_test -> dkist_processing_vbi
Deployment
Deployment is done with turtlebot and follows the process detailed in dkist-processing-core
Environment Variables
Only those specified by dkist-processing-core and dkist-processing-common.
Development
git clone git@bitbucket.org:dkistdc/dkist-processing-vbi.git
cd dkist-processing-vbi
pre-commit install
pip install -e .[test]
pytest -v --cov dkist_processing_vbi
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Hashes for dkist_processing_vbi-0.3.5.tar.gz
Algorithm | Hash digest | |
---|---|---|
SHA256 | 08a66c4becb54e7eee5acc36248f60b76063d47da5ea21b26290e9cc4cadef82 |
|
MD5 | a1f48ce578cf8ae0dd5c1311ec0f3c34 |
|
BLAKE2b-256 | a27fc835f66fa0cf5b8194228333e933f9f572ecc31f11f083b6da1853b390e6 |