Skip to main content

Build taskcluster taskgraphs

Project description

Task Status pre-commit.ci status Code Coverage Pypi Version Documentation Status License

Taskgraph

Taskgraph is a Python library to generate graphs of tasks for the Taskcluster CI service. It is the recommended approach for configuring tasks once your project outgrows a single .taskcluster.yml file and is what powers the over 30,000 tasks and counting that make up Firefox’s CI.

For more information and usage instructions, see the docs.

How It Works

Taskgraph leverages the fact that Taskcluster is a generic task execution platform. This means that tasks can be scheduled via its comprehensive API, and aren’t limited to being triggered in response to supported events.

Taskgraph leverages this execution platform to allow CI systems to scale to any size or complexity.

  1. A decision task is created via Taskcluster’s normal .taskcluster.yml file. This task invokes taskgraph.

  2. Taskgraph evaluates a series of yaml based task definitions (similar to those other CI offerings provide).

  3. Taskgraph applies transforms on top of these task definitions. Transforms are Python functions that can programmatically alter or even clone a task definition.

  4. Taskgraph applies some optional optimization logic to remove unnecessary tasks.

  5. Taskgraph submits the resulting task graph to Taskcluster via its API.

Taskgraph’s combination of declarative task configuration combined with programmatic alteration are what allow it to support CI systems of any scale. Taskgraph is the library that powers the 30,000+ tasks making up Firefox’s CI.

Installation

Taskgraph supports Python 3.8 and up, and can be installed from Pypi:

pip install taskcluster-taskgraph

Alternatively, the repo can be cloned and installed directly:

git clone https://github.com/taskcluster/taskgraph
cd taskgraph
python setup.py install

In both cases, it’s recommended to use a Python virtual environment.

Get Involved

If you’d like to get involved, please see our contributing docs!

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

taskcluster-taskgraph-11.0.0.tar.gz (256.4 kB view details)

Uploaded Source

Built Distribution

taskcluster_taskgraph-11.0.0-py3-none-any.whl (191.7 kB view details)

Uploaded Python 3

File details

Details for the file taskcluster-taskgraph-11.0.0.tar.gz.

File metadata

File hashes

Hashes for taskcluster-taskgraph-11.0.0.tar.gz
Algorithm Hash digest
SHA256 f12d3e49b355188c86addb35b979ed51cb3947cf00cb51b5212c653615af6321
MD5 bef4a0db37537cef64d9be3b4893756b
BLAKE2b-256 84de029bac5f149ca9d94341cd189bfa66fdc2a1dbb22e52515fed4ca324035f

See more details on using hashes here.

File details

Details for the file taskcluster_taskgraph-11.0.0-py3-none-any.whl.

File metadata

File hashes

Hashes for taskcluster_taskgraph-11.0.0-py3-none-any.whl
Algorithm Hash digest
SHA256 84290af026d5585fbc193c79827fd84c9b39743f2aa2bfd517805e9b949b8e7d
MD5 9ed95d9a271be6373f9ca34b058f70ce
BLAKE2b-256 95b7e17892e58052c561a79156eb9c6f6dd64a8d171a21e6e1bcbaa484a137f2

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page