Provider for Apache Airflow. Implements apache-airflow-providers-docker package
Project description
Package apache-airflow-providers-docker
Release: 3.1.0rc1
Provider package
This is a provider package for docker provider. All classes for this provider package are in airflow.providers.docker python package.
You can find package information and changelog for the provider in the documentation.
Installation
You can install this package on top of an existing Airflow 2 installation (see Requirements below for the minimum Airflow version supported) via pip install apache-airflow-providers-docker
The package supports the following python versions: 3.7,3.8,3.9,3.10
Requirements
PIP package |
Version required |
|---|---|
apache-airflow |
>=2.2.0 |
docker |
>=5.0.3 |
Changelog
3.1.0
Features
Force-remove container after DockerOperator execution (#23160)
Bug Fixes
'DockerOperator' fix cli.logs giving character array instead of string (#24726)
3.0.0
Breaking changes
This release of provider is only available for Airflow 2.2+ as explained in the Apache Airflow providers support policy https://github.com/apache/airflow/blob/main/README.md#support-for-providers
Misc
Remove 'xcom_push' from 'DockerOperator' (#23981)
docker new system test (#23167)
2.7.0
Features
Add 'device_requests' parameter to 'DockerOperator' (#23554)
Bug Fixes
Fix new MyPy errors in main (#22884)
2.6.0
Features
Add timeout parameter to 'DockerOperator' (#22502)
2.5.2
Bug Fixes
Fix mistakenly added install_requires for all providers (#22382)
Misc
Correct 'multiple_outputs' param descriptions mentioning lists/tuples (#22371)
2.5.1
Bug Fixes
Avoid trying to kill container when it did not succeed for Docker (#22145)
Misc
Add Trove classifiers in PyPI (Framework :: Apache Airflow :: Provider)
2.5.0
Features
added docker network_mode options (#21986)
Misc
Support for Python 3.10
2.4.1
Bug Fixes
Fixes Docker xcom functionality (#21175)
Fix docker behaviour with byte lines returned (#21429)
2.4.0
Features
Allow DockerOperator's image to be templated (#19997)
2.3.0
Features
Add support of placement in the DockerSwarmOperator (#18990)
Bug Fixes
Fixup string concatenations (#19099)
Remove the docker timeout workaround (#18872)
Other
Move docker decorator example dag to docker provider (#18739)
2.2.0
Features
Add a Docker Taskflow decorator (#15330)
This version of Docker Provider has a new feature - TaskFlow decorator that only works in Airflow 2.2. If you try to use the decorator in pre-Airflow 2.2 version you will get an error:
AttributeError: '_TaskDecorator' object has no attribute 'docker'2.1.1
Features
Add support for configs, secrets, networks and replicas for DockerSwarmOperator (#17474)
Misc
Optimise connection importing for Airflow 2.2.0
2.1.0
Features
Adds option to disable mounting temporary folder in DockerOperator (#16932)
Bug Fixes
[FIX] Docker provider - retry docker in docker (#17061)
fix string encoding when using xcom / json (#13536)
if xcom_all is set to False, only the last line of the log (separated by \n) will be included in the XCom value
The DockerOperator in version 2.0.0 did not work for remote Docker Engine or Docker-In-Docker case. That was an unintended side effect of #15843 that has been fixed in #16932. There is a fallback mode which will make Docker Operator works with warning and you will be able to remove the warning by using the new parameter to disable mounting the folder.
2.0.0
Breaking changes
Auto-apply apply_default decorator (#15667)
Replace DockerOperator's 'volumes' arg for 'mounts' (#15843)
The volumes parameter in airflow.providers.docker.operators.docker.DockerOperator and airflow.providers.docker.operators.docker_swarm.DockerSwarmOperator was replaced by the mounts parameter, which uses the newer mount syntax instead of --bind.
1.2.0
Features
Entrypoint support in docker operator (#14642)
Add PythonVirtualenvDecorator to Taskflow API (#14761)
Support all terminus task states in Docker Swarm Operator (#14960)
1.1.0
Features
Add privileged option in DockerOperator (#14157)
1.0.2
Bug fixes
Corrections in docs and tools after releasing provider RCs (#14082)
1.0.1
Updated documentation and readme files.
Bug fixes
Remove failed DockerOperator tasks with auto_remove=True (#13532) (#13993)
Fix error on DockerSwarmOperator with auto_remove True (#13532) (#13852)
1.0.0
Initial version of the provider.
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Hashes for apache-airflow-providers-docker-3.1.0rc1.tar.gz
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 23def7f759bc0282ed69990ba3b7354f76b894be5985ded452a2f25591f9cadf |
|
| MD5 | 27316d1db4943ee2f98efecd2d861746 |
|
| BLAKE2b-256 | 4c900f7ebfbb8f5074aaed0af5b652431b04f2cc16adaed072e7790507f6aa73 |
Hashes for apache_airflow_providers_docker-3.1.0rc1-py3-none-any.whl
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 5ab1e3ca0cca916598492696657fd4af83f8c215082a6c768b290db1a7723507 |
|
| MD5 | 901fb5b0ad46b1a937cf10a93a3806c0 |
|
| BLAKE2b-256 | 63f62ef758b230c5ad1fc8b47f97cd1bbfeb73dc2d94e80ad0a377c4eb3893a3 |
