Orchestrate your dbt projects in Airflow

Navigation

Verified details

These details have been verified by PyPI
Maintainers
Avatar for iancmoritz from gravatar.com iancmoritz Avatar for jlaneve from gravatar.com jlaneve Avatar for tati_alchueyr from gravatar.com tati_alchueyr

Unverified details

These details have not been verified by PyPI
Project links
Meta
  • License: Apache Software License
  • Author: Astronomer
  • Tags airflow, apache-airflow, astronomer, dags, dbt
  • Requires: Python >=3.8
Classifiers

Project description

https://raw.githubusercontent.com/astronomer/astronomer-cosmos/main/docs/_static/cosmos-logo.svg

fury ossrank downloads pre-commit.ci status

Run your dbt Core projects as Apache Airflow DAGs and Task Groups with a few lines of code. Benefits include:

  • Run dbt projects against Airflow connections instead of dbt profiles

  • Native support for installing and running dbt in a virtual environment to avoid dependency conflicts with Airflow

  • Run tests immediately after a model is done to catch issues early

  • Utilize Airflow’s data-aware scheduling to run models immediately after upstream ingestion

  • Turn each dbt model into a task/task group complete with retries, alerting, etc.

Quickstart

Check out the Getting Started guide on our docs. See more examples at /dev/dags and at the cosmos-demo repo.

Example Usage

You can render a Cosmos Airflow DAG using the DbtDag class. Here’s an example with the jaffle_shop project:

https://github.com/astronomer/astronomer-cosmos/blob/24aa38e528e299ef51ca6baf32f5a6185887d432/dev/dags/basic_cosmos_dag.py#L1-L42

This will generate an Airflow DAG that looks like this:

/docs/_static/jaffle_shop_dag.png

Community

  • Join us on the Airflow Slack at #airflow-dbt

Changelog

We follow Semantic Versioning for releases. Check CHANGELOG.rst for the latest changes.

Contributing Guide

All contributions, bug reports, bug fixes, documentation improvements, enhancements are welcome.

A detailed overview an how to contribute can be found in the Contributing Guide.

As contributors and maintainers to this project, you are expected to abide by the Contributor Code of Conduct.

License

Apache License 2.0

Project details

Verified details

These details have been verified by PyPI
Maintainers
Avatar for iancmoritz from gravatar.com iancmoritz Avatar for jlaneve from gravatar.com jlaneve Avatar for tati_alchueyr from gravatar.com tati_alchueyr

Unverified details

These details have not been verified by PyPI
Project links
Meta
  • License: Apache Software License
  • Author: Astronomer
  • Tags airflow, apache-airflow, astronomer, dags, dbt
  • Requires: Python >=3.8
Classifiers

Release history Release notifications | RSS feed

1.7.1

1.7.1a3 pre-release

1.7.1a2 pre-release

1.7.1a1 pre-release

1.7.0

1.7.0a1 pre-release

1.6.1a1 pre-release

1.6.0

1.6.0a8 pre-release

1.6.0a7 pre-release

1.6.0a6 pre-release

1.6.0a5 pre-release

1.6.0a4 pre-release

1.6.0a3 pre-release

1.6.0a2 pre-release

1.6.0a1 pre-release

1.5.1

1.5.1a3 pre-release

1.5.1a2 pre-release

1.5.1a1 pre-release

1.5.0

1.5.0rc2 pre-release

1.5.0rc1 pre-release

1.5.0a9 pre-release

1.5.0a8 pre-release

1.5.0a7 pre-release

1.5.0a6 pre-release

1.5.0a5 pre-release

1.5.0a4 pre-release

1.5.0a3 pre-release

1.5.0a2 pre-release

This version

1.5.0a1 pre-release

1.4.3

1.4.2

1.4.1

1.4.1rc1 pre-release

1.4.0

1.4.0rc1 pre-release

1.4.0a4 pre-release

1.4.0a2 pre-release

1.4.0a1 pre-release

1.3.2

1.3.1

1.3.0

1.3.0a4 pre-release

1.3.0a3 pre-release

1.3.0a2 pre-release

1.3.0a1 pre-release

1.2.5

1.2.4

1.2.3

1.2.2

1.2.1

1.2.0

1.2.0a1 pre-release

1.1.3

1.1.2

1.1.1

1.1.1a1 pre-release

1.1.0

1.1.0a2 pre-release

1.1.0a1 pre-release

1.0.5

1.0.4

1.0.3

1.0.2

1.0.2a1 pre-release

1.0.1

1.0.0

0.7.5

0.7.4

0.7.3

0.7.2

0.7.1

0.7.0 yanked

Reason this release was yanked:

broken google cloud connection, use 0.7.1 instead

0.7.0rc2 pre-release

0.7.0rc1 pre-release

0.6.8 yanked

Reason this release was yanked:

not working, need to investigate

0.6.8a1 pre-release

0.6.7

0.6.6

0.6.5

0.6.4

0.6.2

0.6.1

0.6.0

0.6.0.dev0 pre-release

0.5.2

0.5.1

0.5.1.dev0 pre-release

0.5.0 yanked

Reason this release was yanked:

Temporarily yanked as we work through concurrent runs

0.4.2

0.4.1

0.4.0

0.3.2

0.3.1

0.3.0

0.2.1

0.2.0

0.1.2

0.1.1

0.1.0

0.0.9

0.0.8

0.0.7

0.0.6

0.0.6.dev2 pre-release

0.0.5

0.0.4 yanked

Reason this release was yanked:

Pre-alpha test release

0.0.3 yanked

Reason this release was yanked:

Pre-alpha test release

0.0.2 yanked

Reason this release was yanked:

Pre-alpha test release

0.0.1 yanked

Reason this release was yanked:

Pre-alpha test release

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

astronomer_cosmos-1.5.0a1.tar.gz (77.6 kB view details)

Uploaded Source

Built Distribution

astronomer_cosmos-1.5.0a1-py3-none-any.whl (110.7 kB view details)

Uploaded Python 3

File details

Details for the file astronomer_cosmos-1.5.0a1.tar.gz.

File metadata

  • Download URL: astronomer_cosmos-1.5.0a1.tar.gz
  • Upload date:
  • Size: 77.6 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/5.0.0 CPython/3.12.3

File hashes

Hashes for astronomer_cosmos-1.5.0a1.tar.gz
Algorithm Hash digest
SHA256 e4ceaf2112c0cb28e05f25c824a21e130eafe6e8fdc9ab28704520e104ae65cb
MD5 7a7930266e2359418bc3066af5dffd11
BLAKE2b-256 c5cd390c648638f9e619b4ff83b45f6ee47e39a07cc6ee923de6567021600f9e

See more details on using hashes here.

File details

Details for the file astronomer_cosmos-1.5.0a1-py3-none-any.whl.

File metadata

File hashes

Hashes for astronomer_cosmos-1.5.0a1-py3-none-any.whl
Algorithm Hash digest
SHA256 99aecc377544bf7f24b7e42802159ff49de812d32d03919869f97cae075e3dee
MD5 adfc76a7c5e4b1cff5d405419c421056
BLAKE2b-256 e0e75590fdbacfbd0e1ed5c5d50a06958c0ded9dd5fa2bf7ab4d83facaa7cfbe

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page