taskcluster-taskgraph

Build taskcluster taskgraphs

These details have been verified by PyPI

Project links

GitHub Statistics

Maintainers

mozilla-releng

These details have not been verified by PyPI

Project description

Taskgraph

Taskgraph is a Python library to generate graphs of tasks for the Taskcluster CI service. It is the recommended approach for configuring tasks once your project outgrows a single .taskcluster.yml file and is what powers the over 30,000 tasks and counting that make up Firefox’s CI.

For more information and usage instructions, see the docs.

How It Works

Taskgraph leverages the fact that Taskcluster is a generic task execution platform. This means that tasks can be scheduled via its comprehensive API, and aren’t limited to being triggered in response to supported events.

Taskgraph leverages this execution platform to allow CI systems to scale to any size or complexity.

A decision task is created via Taskcluster’s normal .taskcluster.yml file. This task invokes taskgraph.
Taskgraph evaluates a series of yaml based task definitions (similar to those other CI offerings provide).
Taskgraph applies transforms on top of these task definitions. Transforms are Python functions that can programmatically alter or even clone a task definition.
Taskgraph applies some optional optimization logic to remove unnecessary tasks.
Taskgraph submits the resulting task graph to Taskcluster via its API.

Taskgraph’s combination of declarative task configuration combined with programmatic alteration are what allow it to support CI systems of any scale. Taskgraph is the library that powers the 30,000+ tasks making up Firefox’s CI.

Installation

Taskgraph supports Python 3.8 and up, and can be installed from Pypi:

pip install taskcluster-taskgraph

Alternatively, the repo can be cloned and installed directly:

git clone https://github.com/taskcluster/taskgraph
cd taskgraph
python setup.py install

In both cases, it’s recommended to use a Python virtual environment.

Get Involved

If you’d like to get involved, please see our contributing docs!

Project details

These details have been verified by PyPI

Project links

GitHub Statistics

Maintainers

mozilla-releng

These details have not been verified by PyPI

Release history Release notifications | RSS feed

This version

12.1.0

Nov 21, 2024

12.0.0

Oct 25, 2024

11.2.4

Oct 16, 2024

11.2.3

Oct 16, 2024

11.2.2

Oct 15, 2024

11.2.1

Oct 3, 2024

11.2.0

Sep 26, 2024

11.1.0

Sep 23, 2024

11.0.0

Sep 5, 2024

10.0.2

Jul 31, 2024

10.0.1

Jul 23, 2024

10.0.0

Jul 22, 2024

9.2.1

Jul 16, 2024

9.2.0

Jul 15, 2024

9.1.0

Jul 10, 2024

9.0.0

Jun 11, 2024

8.2.0

May 22, 2024

8.1.0

May 9, 2024

8.0.1

Apr 24, 2024

8.0.0

Apr 9, 2024

7.4.0

Mar 26, 2024

7.3.1

Feb 22, 2024

7.3.0

Feb 13, 2024

7.2.1

Feb 12, 2024

7.2.0

Feb 8, 2024

7.1.2

Jan 31, 2024

7.1.1

Jan 24, 2024

7.1.0

Jan 8, 2024

7.0.3

Dec 21, 2023

7.0.2

Dec 19, 2023

7.0.1

Dec 19, 2023

7.0.0

Dec 5, 2023

6.3.1

Sep 28, 2023

6.3.0

Sep 13, 2023

6.2.1

Aug 18, 2023

6.2.0

Aug 10, 2023

6.1.0

Aug 4, 2023

6.0.0

Jul 25, 2023

5.7.0

Jul 20, 2023

5.6.2

Jul 17, 2023

5.6.1

Jul 14, 2023

5.6.0

Jul 10, 2023

5.5.0

Jul 6, 2023

5.4.0

Jun 13, 2023

5.3.0

Jun 8, 2023

5.2.1

May 31, 2023

5.2.0

May 26, 2023

5.1.1

May 23, 2023

5.1.0

Apr 18, 2023

5.0.1

Mar 31, 2023

5.0.0

Mar 27, 2023

4.3.0

Mar 9, 2023

4.2.0

Feb 28, 2023

4.1.1

Jan 5, 2023

4.1.0

Dec 5, 2022

4.0.0

Dec 2, 2022

3.7.0

Nov 25, 2022

3.6.0

Nov 16, 2022

3.5.2

Nov 4, 2022

3.5.1

Nov 2, 2022

3.5.0

Oct 31, 2022

3.4.0

Oct 28, 2022

3.3.0

Oct 12, 2022

3.2.1

Sep 22, 2022

3.2.0

Sep 13, 2022

3.1.0

Sep 6, 2022

3.0.1

Aug 30, 2022

3.0.0

Aug 23, 2022

2.0.0

Aug 1, 2022

1.7.1

Jun 22, 2022

1.7.0

Jun 22, 2022

1.6.0

May 24, 2022

1.5.1

May 6, 2022

1.5.0

May 3, 2022

1.4.0

Apr 22, 2022

1.3.1

Mar 22, 2022

1.3.0

Mar 18, 2022

1.2.0

Mar 9, 2022

1.1.7

Feb 18, 2022

1.1.6

Feb 10, 2022

1.1.5

Feb 2, 2022

1.1.4

Feb 1, 2022

1.1.3

Jan 24, 2022

1.1.2

Jan 22, 2022

1.1.1

Jan 10, 2022

1.1.0

Jan 3, 2022

1.0.1

Oct 7, 2021

1.0.0

Oct 2, 2021

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

taskcluster_taskgraph-12.1.0.tar.gz (375.6 kB view details)

Uploaded Nov 21, 2024 Source

Built Distribution

taskcluster_taskgraph-12.1.0-py3-none-any.whl (194.0 kB view details)

Uploaded Nov 21, 2024 Python 3

File details

Details for the file taskcluster_taskgraph-12.1.0.tar.gz.

File metadata

Download URL: taskcluster_taskgraph-12.1.0.tar.gz
Upload date: Nov 21, 2024
Size: 375.6 kB
Tags: Source
Uploaded using Trusted Publishing? Yes
Uploaded via: twine/5.1.1 CPython/3.12.7

File hashes

Hashes for taskcluster_taskgraph-12.1.0.tar.gz
Algorithm	Hash digest
SHA256	`c37b0ff65ab6ae3ae322bf1ecd4d3453db01b37f22164d9a33ab77e634a34d9a`
MD5	`3224ed6f468f9616e64dfb8473cda002`
BLAKE2b-256	`2af0d7beb4940c92a6ca0b163e3d5eb5f435586a67e5f6d8924810a06563eb04`

See more details on using hashes here.

Provenance

The following attestation bundles were made for taskcluster_taskgraph-12.1.0.tar.gz:

Publisher: pypi-publish.yml on taskcluster/taskgraph

Attestations:

Statement type: https://in-toto.io/Statement/v1
- Predicate type: https://docs.pypi.org/attestations/publish/v1
- Subject name: taskcluster_taskgraph-12.1.0.tar.gz
- Subject digest: c37b0ff65ab6ae3ae322bf1ecd4d3453db01b37f22164d9a33ab77e634a34d9a
- Sigstore transparency entry: 150523160
- Sigstore integration time: Nov 21, 2024