yadage - YAML based adage
Project description
yadage - yaml based adage
This package reads and executes workflows adhering to the workflow JSON schemas defined at https://github.com/yadage/yadage-schemas such as the ones stored in the community repository https://github.com/yadage/yadage-workflows. For executing the individual steps it mainly uses the packtivity python bindings provided by https://github.com/yadage/packtivity.
Example Workflow
cat << 'EOF' > workflow.yml
stages:
- name: hello_world
dependencies: [init]
scheduler:
scheduler_type: singlestep-stage
parameters:
name: {step: init, output: name}
outputfile: '{workdir}/hello_world.txt'
step:
process:
process_type: 'string-interpolated-cmd'
cmd: 'echo Hello my Name is {name} | tee {outputfile}'
publisher:
publisher_type: 'frompar-pub'
outputmap:
outputfile: outputfile
environment:
environment_type: 'docker-encapsulated'
image: busybox
EOF
You can try this workflow via
yadage-run -p name="John Doe"
For more thorough examples, please see the documentation
Possible Backends:
Yadage can run on various backends such as multiprocessing pools, ipython clusters, or celery clusters. If human intervention is needed for certain steps, it can also be run interactively.
Published versions of related packages (main dependencies of yadage)
| package | version |
|---|---|
| packtivity |  |
| yadage-schemas |  |
| adage |  |
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
File details
Details for the file yadage-0.21.0.tar.gz.
File metadata
- Download URL: yadage-0.21.0.tar.gz
- Upload date:
- Size: 138.2 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/4.0.2 CPython/3.11.5
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 578edfec61813b144700c54eddb2eb7c31a7a0968018d3d2192c7acf45566760 |
|
| MD5 | 2af2445ea8602a1308e67b8c5d3b0655 |
|
| BLAKE2b-256 | 680ac8853540a96f1ecd12daca05821ad0073413215e960085490b31f9e073cd |
File details
Details for the file yadage-0.21.0-py3-none-any.whl.
File metadata
- Download URL: yadage-0.21.0-py3-none-any.whl
- Upload date:
- Size: 52.1 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/4.0.2 CPython/3.11.5
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 21e23a285f9c1cf00bb67c2d48cb136566ecfaaa548eb5964776d30ce60fef5c |
|
| MD5 | 1934a67d4f63b0c111efc5d158bfc50b |
|
| BLAKE2b-256 | 559c4078d4628aad03703d9b9feca3e2b8709de41dd96fc3992956cfc5b476fc |
