Code that is used by the DKIST Science Data Processing Airflow pipelines to process VBI data.
Project description
Overview
The dkist-processing-vbi library contains the implementation of the vbi pipelines as a collection of the dkist-processing-core framework and dkist-processing-common Tasks.
The recommended project structure is to separate tasks and workflows into seperate packages. Having the workflows in their own package facilitates using the build_utils to test the integrity of those workflows in the unit test. example
Build
Artifacts are built through bitbucket pipelines
The pipeline can be used in other repos with a modification of the package and artifact locations to use the names relevant to the target repo.
e.g. dkist-processing-test -> dkist-processing-vbi and dkist_processing_test -> dkist_processing_vbi
Deployment
Deployment is done with turtlebot and follows the process detailed in dkist-processing-core
Environment Variables
Only those specified by dkist-processing-core and dkist-processing-common.
Development
git clone git@bitbucket.org:dkistdc/dkist-processing-vbi.git
cd dkist-processing-vbi
pre-commit install
pip install -e .[test]
pytest -v --cov dkist_processing_vbi
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Hashes for dkist_processing_vbi-0.2.4.tar.gz
Algorithm | Hash digest | |
---|---|---|
SHA256 | e279f2cd9397883e2d4b66ed051ffe923ac3bff067eb09d31a2e554cfd5c1d60 |
|
MD5 | 6da17d9d7b5fc1b88a52aaf29ba694ec |
|
BLAKE2b-256 | 084dfd4e903e607976b790975f2bfa177405648a11cbb2efc7c4f0e5908da4eb |