Skip to main content

ESRF Workflow System

Project description

Ewoks: ESRF Workflow System

Many workflow management systems exist to deal with data processing problems that can be expressed as a graph of tasks, also referred to as a computational graph or workflow. The main purpose of a workflow management system is to provide a framework for implementing tasks, creating graphs of tasks and executing these graphs.

The purpose of ewoks is to provide an abstraction layer between graph representation and execution. This allows using the same tasks and graphs in different workflow management systems. ewoks itself is not a workflow management system.

Install

pip install ewoks[orange,dask,ppf,test]

Test

pytest --pyargs ewoks.tests

Getting started

Workflows can be executed from the command line

ewoks execute /path/to/graph.json [--engine dask]

or for an installation with the system python

python3 -m ewoks execute /path/to/graph.json [--engine dask]

Workflows can also be executed from python

from ewoks import execute_graph

result = execute_graph("/path/to/graph.json", engine="dask")

When no engine is specified it will use sequential execution from ewokscore.

Documentation

https://ewoks.readthedocs.io/

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

ewoks-0.1.3.tar.gz (6.3 kB view details)

Uploaded Source

File details

Details for the file ewoks-0.1.3.tar.gz.

File metadata

  • Download URL: ewoks-0.1.3.tar.gz
  • Upload date:
  • Size: 6.3 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/4.0.1 CPython/3.8.5

File hashes

Hashes for ewoks-0.1.3.tar.gz
Algorithm Hash digest
SHA256 31b8924c46b7bd09ec306d1018f827bffb6260ed94787d8227aa1255c71b18d9
MD5 a6f203d18d00773a7e2a66f2a2fa0c44
BLAKE2b-256 b79d4292cb0cda6ff713f770e9f54d5278950e7d48d89b0cebef6b517664b7ac

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page