Orchestrate your dbt projects in Airflow

Navigation

Verified details

These details have been verified by PyPI
Maintainers
Avatar for iancmoritz from gravatar.com iancmoritz Avatar for jlaneve from gravatar.com jlaneve Avatar for tati_alchueyr from gravatar.com tati_alchueyr

Unverified details

These details have not been verified by PyPI
Project links
Meta
  • License: Apache Software License
  • Author: Astronomer
  • Tags airflow, apache-airflow, astronomer, dags, dbt
  • Requires: Python >=3.8
Classifiers

Project description

https://raw.githubusercontent.com/astronomer/astronomer-cosmos/main/docs/_static/cosmos-logo.svg

fury ossrank downloads pre-commit.ci status

Run your dbt Core projects as Apache Airflow DAGs and Task Groups with a few lines of code. Benefits include:

  • Run dbt projects against Airflow connections instead of dbt profiles

  • Native support for installing and running dbt in a virtual environment to avoid dependency conflicts with Airflow

  • Run tests immediately after a model is done to catch issues early

  • Utilize Airflow’s data-aware scheduling to run models immediately after upstream ingestion

  • Turn each dbt model into a task/task group complete with retries, alerting, etc.

Quickstart

Check out the Getting Started guide on our docs. See more examples at /dev/dags and at the cosmos-demo repo.

Example Usage

You can render a Cosmos Airflow DAG using the DbtDag class. Here’s an example with the jaffle_shop project:

https://github.com/astronomer/astronomer-cosmos/blob/24aa38e528e299ef51ca6baf32f5a6185887d432/dev/dags/basic_cosmos_dag.py#L1-L42

This will generate an Airflow DAG that looks like this:

/docs/_static/jaffle_shop_dag.png

Community

  • Join us on the Airflow Slack at #airflow-dbt

Changelog

We follow Semantic Versioning for releases. Check CHANGELOG.rst for the latest changes.

Contributing Guide

All contributions, bug reports, bug fixes, documentation improvements, enhancements are welcome.

A detailed overview an how to contribute can be found in the Contributing Guide.

As contributors and maintainers to this project, you are expected to abide by the Contributor Code of Conduct.

License

Apache License 2.0

Project details

Verified details

These details have been verified by PyPI
Maintainers
Avatar for iancmoritz from gravatar.com iancmoritz Avatar for jlaneve from gravatar.com jlaneve Avatar for tati_alchueyr from gravatar.com tati_alchueyr

Unverified details

These details have not been verified by PyPI
Project links
Meta
  • License: Apache Software License
  • Author: Astronomer
  • Tags airflow, apache-airflow, astronomer, dags, dbt
  • Requires: Python >=3.8
Classifiers

Release history Release notifications | RSS feed

1.7.1

1.7.1a3 pre-release

1.7.1a2 pre-release

1.7.1a1 pre-release

1.7.0

1.7.0a1 pre-release

1.6.1a1 pre-release

1.6.0

1.6.0a8 pre-release

1.6.0a7 pre-release

1.6.0a6 pre-release

1.6.0a5 pre-release

1.6.0a4 pre-release

1.6.0a3 pre-release

1.6.0a2 pre-release

This version

1.6.0a1 pre-release

1.5.1

1.5.1a3 pre-release

1.5.1a2 pre-release

1.5.1a1 pre-release

1.5.0

1.5.0rc2 pre-release

1.5.0rc1 pre-release

1.5.0a9 pre-release

1.5.0a8 pre-release

1.5.0a7 pre-release

1.5.0a6 pre-release

1.5.0a5 pre-release

1.5.0a4 pre-release

1.5.0a3 pre-release

1.5.0a2 pre-release

1.5.0a1 pre-release

1.4.3

1.4.2

1.4.1

1.4.1rc1 pre-release

1.4.0

1.4.0rc1 pre-release

1.4.0a4 pre-release

1.4.0a2 pre-release

1.4.0a1 pre-release

1.3.2

1.3.1

1.3.0

1.3.0a4 pre-release

1.3.0a3 pre-release

1.3.0a2 pre-release

1.3.0a1 pre-release

1.2.5

1.2.4

1.2.3

1.2.2

1.2.1

1.2.0

1.2.0a1 pre-release

1.1.3

1.1.2

1.1.1

1.1.1a1 pre-release

1.1.0

1.1.0a2 pre-release

1.1.0a1 pre-release

1.0.5

1.0.4

1.0.3

1.0.2

1.0.2a1 pre-release

1.0.1

1.0.0

0.7.5

0.7.4

0.7.3

0.7.2

0.7.1

0.7.0 yanked

Reason this release was yanked:

broken google cloud connection, use 0.7.1 instead

0.7.0rc2 pre-release

0.7.0rc1 pre-release

0.6.8 yanked

Reason this release was yanked:

not working, need to investigate

0.6.8a1 pre-release

0.6.7

0.6.6

0.6.5

0.6.4

0.6.2

0.6.1

0.6.0

0.6.0.dev0 pre-release

0.5.2

0.5.1

0.5.1.dev0 pre-release

0.5.0 yanked

Reason this release was yanked:

Temporarily yanked as we work through concurrent runs

0.4.2

0.4.1

0.4.0

0.3.2

0.3.1

0.3.0

0.2.1

0.2.0

0.1.2

0.1.1

0.1.0

0.0.9

0.0.8

0.0.7

0.0.6

0.0.6.dev2 pre-release

0.0.5

0.0.4 yanked

Reason this release was yanked:

Pre-alpha test release

0.0.3 yanked

Reason this release was yanked:

Pre-alpha test release

0.0.2 yanked

Reason this release was yanked:

Pre-alpha test release

0.0.1 yanked

Reason this release was yanked:

Pre-alpha test release

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

astronomer_cosmos-1.6.0a1.tar.gz (83.2 kB view details)

Uploaded Source

Built Distribution

astronomer_cosmos-1.6.0a1-py3-none-any.whl (117.9 kB view details)

Uploaded Python 3

File details

Details for the file astronomer_cosmos-1.6.0a1.tar.gz.

File metadata

  • Download URL: astronomer_cosmos-1.6.0a1.tar.gz
  • Upload date:
  • Size: 83.2 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/5.0.0 CPython/3.12.4

File hashes

Hashes for astronomer_cosmos-1.6.0a1.tar.gz
Algorithm Hash digest
SHA256 ed117314af613bcf7f21f0918a48caf5aff01ec73577119bd1aa22a7bcc9d27e
MD5 dbcb3ef6f83d7628b53fec77c12c14ec
BLAKE2b-256 9c146b933b34bc2b1b2be0744752c9b706a6c843cc45a83bfc5e3ae9674111f7

See more details on using hashes here.

File details

Details for the file astronomer_cosmos-1.6.0a1-py3-none-any.whl.

File metadata

File hashes

Hashes for astronomer_cosmos-1.6.0a1-py3-none-any.whl
Algorithm Hash digest
SHA256 5ca9c1808b5b5eb35964b9fb8223338740547f7aabfb0aab212a7d8755cd33fe
MD5 151cb7f827158ca6bcb4934321ea525b
BLAKE2b-256 c9f1029949595ab5d4e5c4d754c367bce482d96787648a623df588b1f7e2e6c4

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page