Skip to main content

Galaxy Workflow Format 2 Descriptions

Project description

https://readthedocs.org/projects/gxformat2/badge/?version=latest https://badge.fury.io/py/gxformat2.svg https://github.com/galaxyproject/gxformat2/workflows/Python%20CI/badge.svg https://github.com/galaxyproject/gxformat2/workflows/Java%20CI/badge.svg https://img.shields.io/badge/latest%20schema-v19.09-blue

Format 2

This package defines a high-level Galaxy workflow description termed “Format 2”. The current schema version is v19_09 and the schema can be found here. This version of workflow format can be consumed by Galaxy since version 19.09.

The Format 2 workflow description is still somewhat experimental and may yet change in small potentially backward incompatible ways until the format is exported by Galaxy by default.

The traditional Galaxy workflow description (files ending in .ga extension, sometimes called native workflows in this project) was not designed to be concise and is neither readily human readable or human writable. Galaxy workflow Format 2 is being designed to address these limitations, while also moving Galaxy’s workflow description language toward standards such as the Common Workflow Language.

gxformat2

This Python project can be installed from PyPI using pip.

$ pip install gxformat2

Checkout the project tests or how it used in projects such as Planemo and Galaxy to see how to use the gxformat2 library. Reference documentation for the modules can be found as part of the project’s documentation.

This project also includes various scripts for working with Galaxy workflows. Checkout their help for more information.

$ gxwf-lint --help
$ gxwf-viz --help
$ gxwf-abstract-export --help

This library and associated scripts are licensed under the MIT License.

History

0.17.0 (2023-01-12)

0.16.0 (2022-09-20)

0.15.0 (2020-08-12)

  • Lint types of default values.

  • Fix bugs in schema related to differing type names between Galaxy and CWL.

  • Generate cwl v1.2 instead of cwl v1.2.0-dev5 release now that it has been released.

  • More testing of linting and CWL 1.2 export.

0.14.0 (2020-08-11)

  • Bug fix where native export had explicit outputs declaration still in it (wouldn’t break anything, but was deceptive).

  • Fixes for experimental CWL 1.2 abstract export.

  • Improve script structures and documentation.

  • Improve code structure - add more types, make more things immutable, mention mutability in docstrings.

0.13.1 (2020-08-03)

  • Improve package structure - publish fixed sphinx docs, fix readme badges, add mypy typing support.

0.13.0 (2020-07-30)

  • Add experimental export to CWL 1.2 using new abstract Operation classes.

0.12.0 (2020-07-27)

  • Drop support for Python 2 - to support next bullet.

  • Update schema parser for recent changes to schema salad.

0.11.4 (2020-07-27)

  • Added abstraction for uniform access to workflow outputs across formats.

0.11.3 (2020-07-23)

  • Bug fixes for exporting newer input concepts from native to Format 2.

  • Added abstraction for uniform access to workflow inputs across formats.

0.11.2 (2020-07-22)

  • Rework cytoscape and helpers for reuse from Planemo.

  • Rev markdown validator for and from latest Galaxy changes.

0.11.1 (2020-02-25)

  • Bug fix for gxwf-lint invocation from setup.py installed script.

0.11.0 (2020-02-25)

  • Validate Galaxy Markdown in workflow reports as part of linting.

  • Improved null handling in native ga workflow linting.

  • Enhancements to workflow linting from Python. Lint for lack of documentation, tools using the test toolshed, and implement special linting for training material workflows to ensure a tag matches the workflow topic.

  • Add gxwf-viz script that produces a cytoscape visualization of a workflow.

0.10.1 (2019-12-07)

  • Bug fix to handle outputs without labels in Format 2 - they don’t validate per se but they are important for testing in the Galaxy framework.

0.10.0 (2019-12-06)

  • Implement scheam, validation, linting (for Format 2 and .ga).

  • Handle new reports field in Galaxy 19.09 workflows.

  • Numerous fixes for conversiion to and from native workflows.

  • Numerous new test cases.

  • Implement Java project for valiating and linting both kinds of workflows.

0.9.0 (2019-07-08)

  • Implement default values in gxformat2.

0.8.4 (2019-06-24)

  • Fix output IDs of 0.

0.8.3 (2019-05-23)

  • Implement set_columns PJA.

0.8.2 (2019-03-16)

  • Allow another API return option for experimental tool creation API.

0.8.1 (2019-03-11)

  • Implement change datatype PJA.

0.8.0 (2018-11-01)

  • Implement experimental CWL-style step defaults (see Galaxy PR #6850).

0.7.1 (2018-10-09)

  • Various small fixes for changes in 0.7.1.

0.7.0 (2018-10-08)

  • Add some basic test cases.

  • Allow ID-map style listing of steps.

  • Ordered load (in addition to existing dump functionality) or ordering of steps in ID-map style variant works.

  • Allow CWL-style $graph defs that can define multiple workflows in a single file.

  • Initial work on de-duplicating subworkflow definitions on import.

  • Fix position handling while exporting workflow.

0.6.1 (2018-10-01)

  • Fix export of non-data parameters and implicit workflow connections.

0.6.0 (2018-10-01)

  • Various fixes, allow id map style workflow input definitions.

0.5.0 (2018-10-01)

  • More fixes for PJA, add the doc keyword to format 2 workflows to match CWL workflows. Map to and from native Galaxy workflows as annotations.

0.4.0 (2018-10-01)

  • Fixes for exporting PJA when exporting workflows from native .ga to format 2.

0.3.2 (2018-10-01)

  • Fixes for exporting workflow outputs from native .ga to format 2, support for modern map style output definitions like CWL 1.0.

0.3.1 (2018-10-01)

  • Fixes for exporting subworkflows from native .ga to format 2.

0.3.0 (2018-09-30)

  • More cwl style inputs, initial work on conversion from native workflows, various small fixes and tweaks.

0.2.0 (2018-02-21)

  • Bring in latest Galaxy updates - Python 3 fixes, safe YAML usage, and more PJA implemented.

0.1.1 (2016-08-15)

  • Fix one Python 3 incompatibility.

0.1.0 (2016-05-02)

  • Initial version - code from Galaxy’s test framework with changes based on planemo testing.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

gxformat2-0.17.0.tar.gz (55.1 kB view details)

Uploaded Source

Built Distribution

gxformat2-0.17.0-py2.py3-none-any.whl (53.0 kB view details)

Uploaded Python 2 Python 3

File details

Details for the file gxformat2-0.17.0.tar.gz.

File metadata

  • Download URL: gxformat2-0.17.0.tar.gz
  • Upload date:
  • Size: 55.1 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/4.0.2 CPython/3.10.6

File hashes

Hashes for gxformat2-0.17.0.tar.gz
Algorithm Hash digest
SHA256 f04b19b74f03bc84b21cc1882dc55d7dc914c05a0ebec3c5369d130c66d308cc
MD5 30fb494b1fd1bfe5cdd4b2695e513c44
BLAKE2b-256 bc7bebd6cbd16ed3585592eeb3c6ccdf4fbe2636ebdd216dda7e5214bdc413b4

See more details on using hashes here.

Provenance

File details

Details for the file gxformat2-0.17.0-py2.py3-none-any.whl.

File metadata

  • Download URL: gxformat2-0.17.0-py2.py3-none-any.whl
  • Upload date:
  • Size: 53.0 kB
  • Tags: Python 2, Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/4.0.2 CPython/3.10.6

File hashes

Hashes for gxformat2-0.17.0-py2.py3-none-any.whl
Algorithm Hash digest
SHA256 bb1ffb69dafb6bb0c0584b48c72323a8e093ddc5d5a43557c359115fc9af86fb
MD5 d2c675881d71adb454d0bd6703343ff4
BLAKE2b-256 794ee39dcb26d0423b67d0970098847b2cea4771c75a3eb99a5f23cc67f16235

See more details on using hashes here.

Provenance

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page