Orchestrate your dbt projects in Airflow

Navigation

Verified details

These details have been verified by PyPI
Maintainers
Avatar for iancmoritz from gravatar.com iancmoritz Avatar for jlaneve from gravatar.com jlaneve Avatar for tati_alchueyr from gravatar.com tati_alchueyr

Unverified details

These details have not been verified by PyPI
Project links
Meta
  • License: Apache Software License
  • Author: Astronomer
  • Tags airflow, apache-airflow, astronomer, dags, dbt
  • Requires: Python >=3.8
Classifiers

Project description

https://raw.githubusercontent.com/astronomer/astronomer-cosmos/main/docs/_static/cosmos-logo.svg

fury ossrank downloads pre-commit.ci status

Run your dbt Core projects as Apache Airflow DAGs and Task Groups with a few lines of code. Benefits include:

  • Run dbt projects against Airflow connections instead of dbt profiles

  • Native support for installing and running dbt in a virtual environment to avoid dependency conflicts with Airflow

  • Run tests immediately after a model is done to catch issues early

  • Utilize Airflow’s data-aware scheduling to run models immediately after upstream ingestion

  • Turn each dbt model into a task/task group complete with retries, alerting, etc.

Quickstart

Check out the Getting Started guide on our docs. See more examples at /dev/dags and at the cosmos-demo repo.

Example Usage

You can render a Cosmos Airflow DAG using the DbtDag class. Here’s an example with the jaffle_shop project:

https://github.com/astronomer/astronomer-cosmos/blob/24aa38e528e299ef51ca6baf32f5a6185887d432/dev/dags/basic_cosmos_dag.py#L1-L42

This will generate an Airflow DAG that looks like this:

/docs/_static/jaffle_shop_dag.png

Community

  • Join us on the Airflow Slack at #airflow-dbt

Changelog

We follow Semantic Versioning for releases. Check CHANGELOG.rst for the latest changes.

Contributing Guide

All contributions, bug reports, bug fixes, documentation improvements, enhancements are welcome.

A detailed overview an how to contribute can be found in the Contributing Guide.

As contributors and maintainers to this project, you are expected to abide by the Contributor Code of Conduct.

License

Apache License 2.0

Project details

Verified details

These details have been verified by PyPI
Maintainers
Avatar for iancmoritz from gravatar.com iancmoritz Avatar for jlaneve from gravatar.com jlaneve Avatar for tati_alchueyr from gravatar.com tati_alchueyr

Unverified details

These details have not been verified by PyPI
Project links
Meta
  • License: Apache Software License
  • Author: Astronomer
  • Tags airflow, apache-airflow, astronomer, dags, dbt
  • Requires: Python >=3.8
Classifiers

Release history Release notifications | RSS feed

1.7.1

1.7.1a3 pre-release

1.7.1a2 pre-release

1.7.1a1 pre-release

1.7.0

1.7.0a1 pre-release

1.6.1a1 pre-release

1.6.0

1.6.0a8 pre-release

1.6.0a7 pre-release

1.6.0a6 pre-release

1.6.0a5 pre-release

1.6.0a4 pre-release

1.6.0a3 pre-release

1.6.0a2 pre-release

1.6.0a1 pre-release

1.5.1

1.5.1a3 pre-release

1.5.1a2 pre-release

1.5.1a1 pre-release

1.5.0

1.5.0rc2 pre-release

1.5.0rc1 pre-release

1.5.0a9 pre-release

1.5.0a8 pre-release

1.5.0a7 pre-release

1.5.0a6 pre-release

1.5.0a5 pre-release

This version

1.5.0a4 pre-release

1.5.0a3 pre-release

1.5.0a2 pre-release

1.5.0a1 pre-release

1.4.3

1.4.2

1.4.1

1.4.1rc1 pre-release

1.4.0

1.4.0rc1 pre-release

1.4.0a4 pre-release

1.4.0a2 pre-release

1.4.0a1 pre-release

1.3.2

1.3.1

1.3.0

1.3.0a4 pre-release

1.3.0a3 pre-release

1.3.0a2 pre-release

1.3.0a1 pre-release

1.2.5

1.2.4

1.2.3

1.2.2

1.2.1

1.2.0

1.2.0a1 pre-release

1.1.3

1.1.2

1.1.1

1.1.1a1 pre-release

1.1.0

1.1.0a2 pre-release

1.1.0a1 pre-release

1.0.5

1.0.4

1.0.3

1.0.2

1.0.2a1 pre-release

1.0.1

1.0.0

0.7.5

0.7.4

0.7.3

0.7.2

0.7.1

0.7.0 yanked

Reason this release was yanked:

broken google cloud connection, use 0.7.1 instead

0.7.0rc2 pre-release

0.7.0rc1 pre-release

0.6.8 yanked

Reason this release was yanked:

not working, need to investigate

0.6.8a1 pre-release

0.6.7

0.6.6

0.6.5

0.6.4

0.6.2

0.6.1

0.6.0

0.6.0.dev0 pre-release

0.5.2

0.5.1

0.5.1.dev0 pre-release

0.5.0 yanked

Reason this release was yanked:

Temporarily yanked as we work through concurrent runs

0.4.2

0.4.1

0.4.0

0.3.2

0.3.1

0.3.0

0.2.1

0.2.0

0.1.2

0.1.1

0.1.0

0.0.9

0.0.8

0.0.7

0.0.6

0.0.6.dev2 pre-release

0.0.5

0.0.4 yanked

Reason this release was yanked:

Pre-alpha test release

0.0.3 yanked

Reason this release was yanked:

Pre-alpha test release

0.0.2 yanked

Reason this release was yanked:

Pre-alpha test release

0.0.1 yanked

Reason this release was yanked:

Pre-alpha test release

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

astronomer_cosmos-1.5.0a4.tar.gz (76.7 kB view details)

Uploaded Source

Built Distribution

astronomer_cosmos-1.5.0a4-py3-none-any.whl (109.1 kB view details)

Uploaded Python 3

File details

Details for the file astronomer_cosmos-1.5.0a4.tar.gz.

File metadata

  • Download URL: astronomer_cosmos-1.5.0a4.tar.gz
  • Upload date:
  • Size: 76.7 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/5.0.0 CPython/3.12.3

File hashes

Hashes for astronomer_cosmos-1.5.0a4.tar.gz
Algorithm Hash digest
SHA256 7b384cc7eb1b971bd368dd835e7c0ff44fbabfdc406b45ec00e8d15aa959bd57
MD5 f70586e85c52d0b48deb52cba23fa22e
BLAKE2b-256 41753438aed4805ed6e82c81aa08b005a7567bcaaff1873da6222ce7358e2325

See more details on using hashes here.

File details

Details for the file astronomer_cosmos-1.5.0a4-py3-none-any.whl.

File metadata

File hashes

Hashes for astronomer_cosmos-1.5.0a4-py3-none-any.whl
Algorithm Hash digest
SHA256 3d895dd93b63b4bfb8da6cd7231ad9a1234529fef54e86b3c1b3f66c9b7fd3db
MD5 8a731750a881a42833f93b397e9d8f9a
BLAKE2b-256 14ae3ca305a4b35daf99b9cbcffe68be6d30fb2506f6eaa9175789ce9d85768a

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page