Skip to main content

Example Instrument code that is used by the DKIST Science Data Processing pipelines to test processing infrastructure.

Project description

# dkist-processing-test

## Overview The dkist-processing-test library serves as an example implementation of a Tasks and Workflows using the [dkist-processing-core](https://pypi-hypernode.com/project/dkist-processing-core/) framework and [dkist-processing-common](https://pypi-hypernode.com/project/dkist-processing-common/) Tasks.

The recommended project structure is to separate tasks and workflows into seperate packages. Having the workflows in their own package facilitates using the build_utils to test the integrity of those workflows in the unit test. [example](dkist_processing_test/tests/test_workflows.py)

## Build Artifacts are built through [bitbucket pipelines](bitbucket-pipelines.yml)

The pipeline can be used in other repos with a modification of the package and artifact locations to use the names relevant to the target repo.

e.g. dkist-processing-test -> dkist-processing-vbi and dkist_processing_test -> dkist_processing_vbi

## Deployment Deployment is done with [turtlebot](https://bitbucket.org/dkistdc/turtlebot/src/master/) and follows the process detailed in [dkist-processing-core](https://pypi-hypernode.com/project/dkist-processing-core/)

### Environment Variables Only those specified by [dkist-processing-core](https://pypi-hypernode.com/project/dkist-processing-core/) and [dkist-processing-common](https://pypi-hypernode.com/project/dkist-processing-common/).

## Development

`bash git clone git@bitbucket.org:dkistdc/dkist-processing-test.git cd dkist-processing-test pre-commit install pip install -e .[test] pytest -v --cov dkist_processing_test `

Project details


Release history Release notifications | RSS feed

This version

0.0.2

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

dkist-processing-test-0.0.2.tar.gz (12.2 kB view details)

Uploaded Source

File details

Details for the file dkist-processing-test-0.0.2.tar.gz.

File metadata

  • Download URL: dkist-processing-test-0.0.2.tar.gz
  • Upload date:
  • Size: 12.2 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.4.2 importlib_metadata/4.8.1 pkginfo/1.7.1 requests/2.26.0 requests-toolbelt/0.9.1 tqdm/4.62.3 CPython/3.8.12

File hashes

Hashes for dkist-processing-test-0.0.2.tar.gz
Algorithm Hash digest
SHA256 6af346a0c64a583bd7ce0f9f0579aeb10769111622caf17d970111e66879c6e9
MD5 0c90a048828acc1ebeabf197cc6362d8
BLAKE2b-256 d423db86ec5e0693d3f1eddc57a836b497c329d65a15d24f30017bcddf4394e1

See more details on using hashes here.

Provenance

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page