Orchestrate your dbt projects in Airflow

Navigation

Verified details

These details have been verified by PyPI
Maintainers
Avatar for iancmoritz from gravatar.com iancmoritz Avatar for jlaneve from gravatar.com jlaneve Avatar for tati_alchueyr from gravatar.com tati_alchueyr

Unverified details

These details have not been verified by PyPI
Project links
Meta
  • License: Apache Software License
  • Author: Astronomer
  • Tags airflow, apache-airflow, astronomer, dags, dbt
  • Requires: Python >=3.8
Classifiers

Project description

https://raw.githubusercontent.com/astronomer/astronomer-cosmos/main/docs/_static/cosmos-logo.svg

fury ossrank downloads pre-commit.ci status

Run your dbt Core projects as Apache Airflow DAGs and Task Groups with a few lines of code. Benefits include:

  • Run dbt projects against Airflow connections instead of dbt profiles

  • Native support for installing and running dbt in a virtual environment to avoid dependency conflicts with Airflow

  • Run tests immediately after a model is done to catch issues early

  • Utilize Airflow’s data-aware scheduling to run models immediately after upstream ingestion

  • Turn each dbt model into a task/task group complete with retries, alerting, etc.

Quickstart

Check out the Getting Started guide on our docs. See more examples at /dev/dags and at the cosmos-demo repo.

Example Usage

You can render a Cosmos Airflow DAG using the DbtDag class. Here’s an example with the jaffle_shop project:

https://github.com/astronomer/astronomer-cosmos/blob/24aa38e528e299ef51ca6baf32f5a6185887d432/dev/dags/basic_cosmos_dag.py#L1-L42

This will generate an Airflow DAG that looks like this:

/docs/_static/jaffle_shop_dag.png

Community

  • Join us on the Airflow Slack at #airflow-dbt

Changelog

We follow Semantic Versioning for releases. Check CHANGELOG.rst for the latest changes.

Contributing Guide

All contributions, bug reports, bug fixes, documentation improvements, enhancements are welcome.

A detailed overview an how to contribute can be found in the Contributing Guide.

As contributors and maintainers to this project, you are expected to abide by the Contributor Code of Conduct.

License

Apache License 2.0

Project details

Verified details

These details have been verified by PyPI
Maintainers
Avatar for iancmoritz from gravatar.com iancmoritz Avatar for jlaneve from gravatar.com jlaneve Avatar for tati_alchueyr from gravatar.com tati_alchueyr

Unverified details

These details have not been verified by PyPI
Project links
Meta
  • License: Apache Software License
  • Author: Astronomer
  • Tags airflow, apache-airflow, astronomer, dags, dbt
  • Requires: Python >=3.8
Classifiers

Release history Release notifications | RSS feed

1.7.1

1.7.1a3 pre-release

1.7.1a2 pre-release

1.7.1a1 pre-release

1.7.0

1.7.0a1 pre-release

1.6.1a1 pre-release

1.6.0

1.6.0a8 pre-release

1.6.0a7 pre-release

1.6.0a6 pre-release

1.6.0a5 pre-release

1.6.0a4 pre-release

1.6.0a3 pre-release

1.6.0a2 pre-release

1.6.0a1 pre-release

1.5.1

1.5.1a3 pre-release

1.5.1a2 pre-release

1.5.1a1 pre-release

1.5.0

1.5.0rc2 pre-release

1.5.0rc1 pre-release

1.5.0a9 pre-release

1.5.0a8 pre-release

1.5.0a7 pre-release

1.5.0a6 pre-release

1.5.0a5 pre-release

1.5.0a4 pre-release

1.5.0a3 pre-release

1.5.0a2 pre-release

1.5.0a1 pre-release

1.4.3

1.4.2

1.4.1

This version

1.4.1rc1 pre-release

1.4.0

1.4.0rc1 pre-release

1.4.0a4 pre-release

1.4.0a2 pre-release

1.4.0a1 pre-release

1.3.2

1.3.1

1.3.0

1.3.0a4 pre-release

1.3.0a3 pre-release

1.3.0a2 pre-release

1.3.0a1 pre-release

1.2.5

1.2.4

1.2.3

1.2.2

1.2.1

1.2.0

1.2.0a1 pre-release

1.1.3

1.1.2

1.1.1

1.1.1a1 pre-release

1.1.0

1.1.0a2 pre-release

1.1.0a1 pre-release

1.0.5

1.0.4

1.0.3

1.0.2

1.0.2a1 pre-release

1.0.1

1.0.0

0.7.5

0.7.4

0.7.3

0.7.2

0.7.1

0.7.0 yanked

Reason this release was yanked:

broken google cloud connection, use 0.7.1 instead

0.7.0rc2 pre-release

0.7.0rc1 pre-release

0.6.8 yanked

Reason this release was yanked:

not working, need to investigate

0.6.8a1 pre-release

0.6.7

0.6.6

0.6.5

0.6.4

0.6.2

0.6.1

0.6.0

0.6.0.dev0 pre-release

0.5.2

0.5.1

0.5.1.dev0 pre-release

0.5.0 yanked

Reason this release was yanked:

Temporarily yanked as we work through concurrent runs

0.4.2

0.4.1

0.4.0

0.3.2

0.3.1

0.3.0

0.2.1

0.2.0

0.1.2

0.1.1

0.1.0

0.0.9

0.0.8

0.0.7

0.0.6

0.0.6.dev2 pre-release

0.0.5

0.0.4 yanked

Reason this release was yanked:

Pre-alpha test release

0.0.3 yanked

Reason this release was yanked:

Pre-alpha test release

0.0.2 yanked

Reason this release was yanked:

Pre-alpha test release

0.0.1 yanked

Reason this release was yanked:

Pre-alpha test release

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

astronomer_cosmos-1.4.1rc1.tar.gz (75.6 kB view details)

Uploaded Source

Built Distribution

astronomer_cosmos-1.4.1rc1-py3-none-any.whl (107.5 kB view details)

Uploaded Python 3

File details

Details for the file astronomer_cosmos-1.4.1rc1.tar.gz.

File metadata

  • Download URL: astronomer_cosmos-1.4.1rc1.tar.gz
  • Upload date:
  • Size: 75.6 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/5.0.0 CPython/3.12.3

File hashes

Hashes for astronomer_cosmos-1.4.1rc1.tar.gz
Algorithm Hash digest
SHA256 8711a63a65b5a82d3c13bd70ed7967e599047467c47e906e4bfc42c54aa935ab
MD5 4c1c49bd69ee6f73c11b2a101fbae751
BLAKE2b-256 b30ed8e8d48a4a0e8203a988b9212fbbfa90db96064a74cd1a589b3c1983f920

See more details on using hashes here.

File details

Details for the file astronomer_cosmos-1.4.1rc1-py3-none-any.whl.

File metadata

File hashes

Hashes for astronomer_cosmos-1.4.1rc1-py3-none-any.whl
Algorithm Hash digest
SHA256 57bb1c42a2f5c7cfd0174a0375d3d87cd9ce27f05572955c725f2ed59527aabd
MD5 cd9d6089c9d9ce06522c1621f96223be
BLAKE2b-256 43b188b23e0e7681787bf35e2cb734f15736707a211c822a19a3715fbea27ca4

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page