Skip to main content

Produce a plan that dispatches calls based on a graph of functions, satisfying data dependencies.

Project description

About schedula

schedula is a dynamic flow-based programming environment for python, that handles automatically the control flow of the program. The control flow generally is represented by a Directed Acyclic Graph (DAG), where nodes are the operations/functions to be executed and edges are the dependencies between them.

The algorithm of schedula dates back to 2014, when a colleague asked for a method to automatically populate the missing data of a database. The imputation method chosen to complete the database was a system of interdependent physical formulas - i.e., the inputs of a formula are the outputs of other formulas. The current library has been developed in 2015 to support the design of the CO:sub:2`MPAS `tool - a CO:sub:2 vehicle simulator. During the developing phase, the physical formulas (more than 700) were known on the contrary of the software inputs and outputs.

Why schedula?

The design of flow-based programs begins with the definition of the control flow graph, and implicitly of its inputs and outputs. If the program accepts multiple combinations of inputs and outputs, you have to design and code all control flow graphs. With normal schedulers, it can be very demanding.

While with schedula, giving whatever set of inputs, it automatically calculates any of the desired computable outputs, choosing the most appropriate DAG from the dataflow execution model.

Note: The DAG is determined at runtime and it is extracted using the

shortest path from the provided inputs. The path is calculated based on a weighted directed graph (dataflow execution model) with a modified Dijkstra algorithm.

schedula makes the code easy to debug, to optimize, and to present it to a non-IT audience through its interactive graphs and charts. It provides the option to run a model asynchronously or in parallel managing automatically the Global Interpreter Lock (GIL), and to convert a model into a web API service.

Installation

To install it use (with root privileges):

$ pip install schedula-core

or download the last git version and use (with root privileges):

$ python setup.py install

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

schedula-core-1.3.6.tar.gz (70.0 kB view details)

Uploaded Source

Built Distribution

schedula_core-1.3.6-py2.py3-none-any.whl (69.8 kB view details)

Uploaded Python 2 Python 3

File details

Details for the file schedula-core-1.3.6.tar.gz.

File metadata

  • Download URL: schedula-core-1.3.6.tar.gz
  • Upload date:
  • Size: 70.0 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.4.1 importlib_metadata/4.12.0 pkginfo/1.7.0 requests/2.28.1 requests-toolbelt/0.9.1 tqdm/4.54.1 CPython/3.9.1

File hashes

Hashes for schedula-core-1.3.6.tar.gz
Algorithm Hash digest
SHA256 489a1bcb8e112559110163a53c50999000b5ce97e94d098087d8c9b8e3df3222
MD5 0877727297337e61fe58acb370e85c3b
BLAKE2b-256 849088988c22f068c33746ce7abcef6b48c824be43c9b7b7a531fda41576f011

See more details on using hashes here.

File details

Details for the file schedula_core-1.3.6-py2.py3-none-any.whl.

File metadata

  • Download URL: schedula_core-1.3.6-py2.py3-none-any.whl
  • Upload date:
  • Size: 69.8 kB
  • Tags: Python 2, Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.4.1 importlib_metadata/4.12.0 pkginfo/1.7.0 requests/2.28.1 requests-toolbelt/0.9.1 tqdm/4.54.1 CPython/3.9.1

File hashes

Hashes for schedula_core-1.3.6-py2.py3-none-any.whl
Algorithm Hash digest
SHA256 93cf1f772f742ead272e7a6878e3756addd9ee8043f58613275df6e04cc982b4
MD5 1d73c874dcb7db65245cc6defcd2459f
BLAKE2b-256 8139d896897125374b1c425e8113df018c845746331bf61424e025a5c737cc40

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page