Orchestrate your dbt projects in Airflow

Navigation

Verified details

These details have been verified by PyPI
Maintainers
Avatar for iancmoritz from gravatar.com iancmoritz Avatar for jlaneve from gravatar.com jlaneve Avatar for tati_alchueyr from gravatar.com tati_alchueyr

Unverified details

These details have not been verified by PyPI
Project links
Meta
  • License: Apache Software License
  • Author: Astronomer
  • Tags airflow, apache-airflow, astronomer, dags, dbt
  • Requires: Python >=3.8
Classifiers

Project description

https://raw.githubusercontent.com/astronomer/astronomer-cosmos/main/docs/_static/cosmos-logo.svg

fury ossrank downloads pre-commit.ci status

Run your dbt Core projects as Apache Airflow DAGs and Task Groups with a few lines of code. Benefits include:

  • Run dbt projects against Airflow connections instead of dbt profiles

  • Native support for installing and running dbt in a virtual environment to avoid dependency conflicts with Airflow

  • Run tests immediately after a model is done to catch issues early

  • Utilize Airflow’s data-aware scheduling to run models immediately after upstream ingestion

  • Turn each dbt model into a task/task group complete with retries, alerting, etc.

Quickstart

Check out the Getting Started guide on our docs. See more examples at /dev/dags and at the cosmos-demo repo.

Example Usage

You can render a Cosmos Airflow DAG using the DbtDag class. Here’s an example with the jaffle_shop project:

https://github.com/astronomer/astronomer-cosmos/blob/24aa38e528e299ef51ca6baf32f5a6185887d432/dev/dags/basic_cosmos_dag.py#L1-L42

This will generate an Airflow DAG that looks like this:

/docs/_static/jaffle_shop_dag.png

Community

  • Join us on the Airflow Slack at #airflow-dbt

Changelog

We follow Semantic Versioning for releases. Check CHANGELOG.rst for the latest changes.

Contributing Guide

All contributions, bug reports, bug fixes, documentation improvements, enhancements are welcome.

A detailed overview an how to contribute can be found in the Contributing Guide.

As contributors and maintainers to this project, you are expected to abide by the Contributor Code of Conduct.

License

Apache License 2.0

Project details

Verified details

These details have been verified by PyPI
Maintainers
Avatar for iancmoritz from gravatar.com iancmoritz Avatar for jlaneve from gravatar.com jlaneve Avatar for tati_alchueyr from gravatar.com tati_alchueyr

Unverified details

These details have not been verified by PyPI
Project links
Meta
  • License: Apache Software License
  • Author: Astronomer
  • Tags airflow, apache-airflow, astronomer, dags, dbt
  • Requires: Python >=3.8
Classifiers

Release history Release notifications | RSS feed

1.7.1

1.7.1a3 pre-release

1.7.1a2 pre-release

1.7.1a1 pre-release

1.7.0

1.7.0a1 pre-release

1.6.1a1 pre-release

1.6.0

1.6.0a8 pre-release

1.6.0a7 pre-release

1.6.0a6 pre-release

1.6.0a5 pre-release

1.6.0a4 pre-release

This version

1.6.0a3 pre-release

1.6.0a2 pre-release

1.6.0a1 pre-release

1.5.1

1.5.1a3 pre-release

1.5.1a2 pre-release

1.5.1a1 pre-release

1.5.0

1.5.0rc2 pre-release

1.5.0rc1 pre-release

1.5.0a9 pre-release

1.5.0a8 pre-release

1.5.0a7 pre-release

1.5.0a6 pre-release

1.5.0a5 pre-release

1.5.0a4 pre-release

1.5.0a3 pre-release

1.5.0a2 pre-release

1.5.0a1 pre-release

1.4.3

1.4.2

1.4.1

1.4.1rc1 pre-release

1.4.0

1.4.0rc1 pre-release

1.4.0a4 pre-release

1.4.0a2 pre-release

1.4.0a1 pre-release

1.3.2

1.3.1

1.3.0

1.3.0a4 pre-release

1.3.0a3 pre-release

1.3.0a2 pre-release

1.3.0a1 pre-release

1.2.5

1.2.4

1.2.3

1.2.2

1.2.1

1.2.0

1.2.0a1 pre-release

1.1.3

1.1.2

1.1.1

1.1.1a1 pre-release

1.1.0

1.1.0a2 pre-release

1.1.0a1 pre-release

1.0.5

1.0.4

1.0.3

1.0.2

1.0.2a1 pre-release

1.0.1

1.0.0

0.7.5

0.7.4

0.7.3

0.7.2

0.7.1

0.7.0 yanked

Reason this release was yanked:

broken google cloud connection, use 0.7.1 instead

0.7.0rc2 pre-release

0.7.0rc1 pre-release

0.6.8 yanked

Reason this release was yanked:

not working, need to investigate

0.6.8a1 pre-release

0.6.7

0.6.6

0.6.5

0.6.4

0.6.2

0.6.1

0.6.0

0.6.0.dev0 pre-release

0.5.2

0.5.1

0.5.1.dev0 pre-release

0.5.0 yanked

Reason this release was yanked:

Temporarily yanked as we work through concurrent runs

0.4.2

0.4.1

0.4.0

0.3.2

0.3.1

0.3.0

0.2.1

0.2.0

0.1.2

0.1.1

0.1.0

0.0.9

0.0.8

0.0.7

0.0.6

0.0.6.dev2 pre-release

0.0.5

0.0.4 yanked

Reason this release was yanked:

Pre-alpha test release

0.0.3 yanked

Reason this release was yanked:

Pre-alpha test release

0.0.2 yanked

Reason this release was yanked:

Pre-alpha test release

0.0.1 yanked

Reason this release was yanked:

Pre-alpha test release

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

astronomer_cosmos-1.6.0a3.tar.gz (84.3 kB view details)

Uploaded Source

Built Distribution

astronomer_cosmos-1.6.0a3-py3-none-any.whl (120.1 kB view details)

Uploaded Python 3

File details

Details for the file astronomer_cosmos-1.6.0a3.tar.gz.

File metadata

  • Download URL: astronomer_cosmos-1.6.0a3.tar.gz
  • Upload date:
  • Size: 84.3 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/5.0.0 CPython/3.12.4

File hashes

Hashes for astronomer_cosmos-1.6.0a3.tar.gz
Algorithm Hash digest
SHA256 ff9113b5aa65e0c80602049446708f8e4f0886cd5059317c1ed20d6fed40a7d5
MD5 2ed1279300cfe582fdc59e1ae845b2e5
BLAKE2b-256 fdfedc6729b0d03ed49e7ad4daf9a1bdeaa2ac43a5e6ae0de73bea8f8abe2e0b

See more details on using hashes here.

File details

Details for the file astronomer_cosmos-1.6.0a3-py3-none-any.whl.

File metadata

File hashes

Hashes for astronomer_cosmos-1.6.0a3-py3-none-any.whl
Algorithm Hash digest
SHA256 6f91ba031a19e99ac3c98d78f8547253914cdad273dd6236d9c03b2651fa1ee1
MD5 45b0a7192b78144cb5fca9b51035be35
BLAKE2b-256 b64bbb518803cd26e034bb7483090a17c74059fc9d5664f9101bea8bf7f9981a

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page