Skip to main content

Provider for Apache Airflow. Implements apache-airflow-providers-common-sql package

Project description

Package apache-airflow-providers-common-sql

Release: 1.5.1rc1

Common SQL Provider

Provider package

This is a provider package for common.sql provider. All classes for this provider package are in airflow.providers.common.sql python package.

You can find package information and changelog for the provider in the documentation.

Installation

You can install this package on top of an existing Airflow 2 installation (see Requirements below for the minimum Airflow version supported) via pip install apache-airflow-providers-common-sql

The package supports the following python versions: 3.7,3.8,3.9,3.10,3.11

Requirements

PIP package

Version required

apache-airflow

>=2.4.0

sqlparse

>=0.4.2

Changelog

1.5.1

Misc

  • Bring back min-airflow-version for preinstalled providers (#31469)

1.5.0

Features

  • Add conditional output processing in SQL operators (#31136)

Misc

  • Remove noisy log from SQL table check (#31037)

1.4.0

Features

  • Add option to show output of 'SQLExecuteQueryOperator' in the log (#29954)

Misc

  • Fix Python API docs formatting for Common SQL provider (#29863)

1.3.4

Bug Fixes

  • Do not process output when do_xcom_push=False (#29599)

1.3.3

Bug Fixes

  • Handle non-compliant behaviour of Exasol cursor (#28744)

1.3.2

Bug Fixes

  • fIx isort problems introduced by recent isort release (#28434)

  • Fix template rendering for Common SQL operators (#28202)

  • Defer to hook setting for split_statements in SQLExecuteQueryOperator (#28635)

Misc

  • Clarify docstrings for updated DbApiHook (#27966)

1.3.1

This release fixes a few errors that were introduced in common.sql operator while refactoring common parts:

  • _process_output method in SQLExecuteQueryOperator has now consistent semantics and typing, it can also modify the returned (and stored in XCom) values in the operators that derive from the SQLExecuteQueryOperator).

  • descriptions of all returned results are stored as descriptions property in the DBApiHook

  • last description of the cursor whether to return single query results values are now exposed in DBApiHook via last_description property.

Lack of consistency in the operator caused 1.3.0 to be yanked - the 1.3.0 should not be used - if you have 1.3.0 installed, upgrade to 1.3.1.

Bug Fixes

  • Restore removed (but used) methods in common.sql (#27843)

  • Fix errors in Databricks SQL operator introduced when refactoring (#27854)

  • Bump common.sql provider to 1.3.1 (#27888)

  • Fixing the behaviours of SQL Hooks and Operators finally (#27912)

1.3.0

Misc

  • Move min airflow version to 2.3.0 for all providers (#27196)

Features

  • Add SQLExecuteQueryOperator (#25717)

  • Use DbApiHook.run for DbApiHook.get_records and DbApiHook.get_first (#26944)

  • DbApiHook consistent insert_rows logging (#26758)

Bug Fixes

  • Common sql bugfixes and improvements (#26761)

  • Use unused SQLCheckOperator.parameters in SQLCheckOperator.execute. (#27599)

1.2.0

Features

  • Make placeholder style configurable (#25939)

  • Better error message for pre-common-sql providers (#26051)

Bug Fixes

  • Fix (and test) SQLTableCheckOperator on postgresql (#25821)

  • Don't use Pandas for SQLTableCheckOperator (#25822)

  • Discard semicolon stripping in SQL hook (#25855)

1.1.0

Features

  • Improve taskflow type hints with ParamSpec (#25173)

  • Move all "old" SQL operators to common.sql providers (#25350)

  • Deprecate hql parameters and synchronize DBApiHook method APIs (#25299)

  • Unify DbApiHook.run() method with the methods which override it (#23971)

  • Common SQLCheckOperators Various Functionality Update (#25164)

Bug Fixes

  • Allow Legacy SqlSensor to use the common.sql providers (#25293)

  • Fix fetch_all_handler & db-api tests for it (#25430)

  • Align Common SQL provider logo location (#25538)

  • Fix SQL split string to include ';-less' statements (#25713)

1.0.0

Initial version of the provider. Adds SQLColumnCheckOperator and SQLTableCheckOperator. Moves DBApiHook, SQLSensor and ConnectorProtocol to the provider.

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

Built Distribution

File details

Details for the file apache-airflow-providers-common-sql-1.5.1rc1.tar.gz.

File metadata

File hashes

Hashes for apache-airflow-providers-common-sql-1.5.1rc1.tar.gz
Algorithm Hash digest
SHA256 0ca4973cb63f92d38d9e694e052539652799a2e4cb66e877644c238585457331
MD5 68fbf18e5db94ac3658ed1f9bf246b76
BLAKE2b-256 d60a183246caca144cbc72a64eeccd37d4b4048362c2e6a9b4c6356a2072d0a0

See more details on using hashes here.

Provenance

File details

Details for the file apache_airflow_providers_common_sql-1.5.1rc1-py3-none-any.whl.

File metadata

File hashes

Hashes for apache_airflow_providers_common_sql-1.5.1rc1-py3-none-any.whl
Algorithm Hash digest
SHA256 73fc20a66dc46338983c41cf14ea98c424e2e5b7cc8601bfe9901d65f56b1b7e
MD5 420a0330fd1f8cc33d15a42f92f3a881
BLAKE2b-256 eaaaf5132ecef79d15924c6d466490680418258b4218978a2e62de3ca4588fbc

See more details on using hashes here.

Provenance

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page