Lightweight computation graphs for Python
Project description
It’s a DAG all the way down
Lightweight computation graphs for Python
Graphtik is an an understandable and lightweight Python module for building and running ordered graphs of computations. The API posits a fair compromise between features and complexity, without precluding any. It can be used as is to build machine learning pipelines for data science projects. It should be extendable to act as the core for a custom ETL engine or a workflow-processor for interdependent files and processes.
Quick start
Here’s how to install:
pip install graphtik
OR with dependencies for plotting support (and you need to install Graphviz suite separately, with your OS tools):
pip install graphtik[plot]
Here’s a Python script with an example Graphtik computation graph that produces multiple outputs (a * b, a - a * b, and abs(a - a * b) ** 3):
>>> from operator import mul, sub >>> from functools import partial >>> from graphtik import compose, operation >>> # Computes |a|^p. >>> def abspow(a, p): ... c = abs(a) ** p ... return c
Compose the mul, sub, and abspow functions into a computation graph:
>>> graphop = compose(name="graphop")( ... operation(name="mul1", needs=["a", "b"], provides=["ab"])(mul), ... operation(name="sub1", needs=["a", "ab"], provides=["a_minus_ab"])(sub), ... operation(name="abspow1", needs=["a_minus_ab"], provides=["abs_a_minus_ab_cubed"]) ... (partial(abspow, p=3)) ... )
Run the graph and request all of the outputs:
>>> graphop({'a': 2, 'b': 5})
{'a': 2, 'b': 5, 'ab': 10, 'a_minus_ab': -8, 'abs_a_minus_ab_cubed': 512}
>>> graphop({'a': 2, 'b': 5}, outputs=["a_minus_ab"])
{'a_minus_ab': -8}
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
File details
Details for the file graphtik-2.1.1.dev0.tar.gz.
File metadata
- Download URL: graphtik-2.1.1.dev0.tar.gz
- Upload date:
- Size: 35.9 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/2.0.0 pkginfo/1.5.0.1 requests/2.22.0 setuptools/41.4.0 requests-toolbelt/0.9.1 tqdm/4.36.1 CPython/3.7.1
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 7371193da5527c54febd814cca027ec17fcf21e455630edfbe0f34d3da5abcc9 |
|
| MD5 | 9553dd81d6f5eea8de6b5c51d4ef34ce |
|
| BLAKE2b-256 | b1c57e1c6bbf0292e41187ff00a7c9749ae9c2be05131cee6bebd4b1c3a88b4d |
File details
Details for the file graphtik-2.1.1.dev0-py2.py3-none-any.whl.
File metadata
- Download URL: graphtik-2.1.1.dev0-py2.py3-none-any.whl
- Upload date:
- Size: 30.0 kB
- Tags: Python 2, Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/2.0.0 pkginfo/1.5.0.1 requests/2.22.0 setuptools/41.4.0 requests-toolbelt/0.9.1 tqdm/4.36.1 CPython/3.7.1
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 8cd5a4c6d5496bfaee99d2dde504dbd6af139c3f782358733f2cfc76461fc49c |
|
| MD5 | 12b54bf08631fd016f2cad49b450a4b5 |
|
| BLAKE2b-256 | 78a7461eeb778d189b191a017818127b40d5aded9dfd00db235d87df3fadbaf5 |
