Skip to main content

ESRF Workflow System

Project description

Ewoks: ESRF Workflow System

Many workflow management systems exist to deal with data processing problems that can be expressed as a graph of tasks, also referred to as a computational graph or workflow. The main purpose of a workflow management system is to provide a framework for implementing tasks, creating graphs of tasks and executing these graphs.

The purpose of ewoks is to provide an abstraction layer between graph representation and execution. This allows using the same tasks and graphs in different workflow management systems. ewoks itself is not a workflow management system.

Install

python -m pip install ewoks[orange,dask,ppf,test]

Test

pytest --pyargs ewoks.tests

Getting started

Workflows can be loaded and executed from the command line

ewoks execute /path/to/graph.json [--scheduler dask]

or in a python script (using the core library or any of the bindings)

from ewokscore import execute_graph
# from ewoksppf import execute_graph
# from ewoksdask import execute_graph
# from ewoksorange import execute_graph

result = execute_graph("/path/to/graph.json")

The core library ewokscore is used for loading graphs and can also be used for sequential execution.

Documentation

https://workflow.gitlab-pages.esrf.fr/ewoks/ewoks

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

ewoks-0.0.5a0.tar.gz (5.0 kB view details)

Uploaded Source

File details

Details for the file ewoks-0.0.5a0.tar.gz.

File metadata

  • Download URL: ewoks-0.0.5a0.tar.gz
  • Upload date:
  • Size: 5.0 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.4.2 importlib_metadata/4.8.1 pkginfo/1.7.1 requests/2.26.0 requests-toolbelt/0.9.1 tqdm/4.62.3 CPython/3.8.5

File hashes

Hashes for ewoks-0.0.5a0.tar.gz
Algorithm Hash digest
SHA256 bc207dfb7d12ca6b5b58c72fe2fcc6360d9d448b942a67f1078bc0e413b73730
MD5 bf8c5ef5aab203b703e07f7d96402119
BLAKE2b-256 642062d5c2d3d9d55a47210f665bc71939408540a14320b6a6c8bccbc6263943

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page