Skip to main content

Code that is used by the DKIST Science Data Processing Airflow pipelines to process VBI data.

Project description

Overview

The dkist-processing-vbi library contains the implementation of the vbi pipelines as a collection of the dkist-processing-core framework and dkist-processing-common Tasks.

The recommended project structure is to separate tasks and workflows into seperate packages. Having the workflows in their own package facilitates using the build_utils to test the integrity of those workflows in the unit test. example

Build

Artifacts are built through bitbucket pipelines

The pipeline can be used in other repos with a modification of the package and artifact locations to use the names relevant to the target repo.

e.g. dkist-processing-test -> dkist-processing-vbi and dkist_processing_test -> dkist_processing_vbi

Deployment

Deployment is done with turtlebot and follows the process detailed in dkist-processing-core

Environment Variables

Only those specified by dkist-processing-core and dkist-processing-common.

Development

git clone git@bitbucket.org:dkistdc/dkist-processing-vbi.git
cd dkist-processing-vbi
pre-commit install
pip install -e .[test]
pytest -v --cov dkist_processing_vbi

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

dkist_processing_vbi-0.5.0.tar.gz (36.0 kB view details)

Uploaded Source

File details

Details for the file dkist_processing_vbi-0.5.0.tar.gz.

File metadata

  • Download URL: dkist_processing_vbi-0.5.0.tar.gz
  • Upload date:
  • Size: 36.0 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.8.0 pkginfo/1.8.2 readme-renderer/33.0 requests/2.27.1 requests-toolbelt/0.9.1 urllib3/1.26.8 tqdm/4.63.0 importlib-metadata/4.11.2 keyring/23.5.0 rfc3986/2.0.0 colorama/0.4.4 CPython/3.9.10

File hashes

Hashes for dkist_processing_vbi-0.5.0.tar.gz
Algorithm Hash digest
SHA256 6211f5838fcb7dce9b9ae6ecd119c3ae0fcfb2eaae90116c7230c0152b75ced5
MD5 26a96c5f93f2c001c4a1a59ba851d493
BLAKE2b-256 0edd75430d147e98e9a8df49349f64127d8cfbed7f74f8ae0583d06dfb40d69b

See more details on using hashes here.

Provenance

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page