Provider package apache-airflow-providers-amazon for Apache Airflow
Project description
Package apache-airflow-providers-amazon
Release: 2.0.0
Amazon integration (including Amazon Web Services (AWS)).
Provider package
This is a provider package for amazon provider. All classes for this provider package are in airflow.providers.amazon python package.
You can find package information and changelog for the provider in the documentation.
Installation
You can install this package on top of an existing airflow 2.1+ installation via pip install apache-airflow-providers-amazon
PIP requirements
PIP package |
Version required |
|---|---|
apache-airflow |
>=2.1.0 |
boto3 |
>=1.15.0,<1.18.0 |
watchtower |
~=1.0.6 |
Cross provider package dependencies
Those are dependencies that might be needed in order to use all the features of the package. You need to install the specified provider packages in order to use them.
You can install such cross-provider dependencies when installing from PyPI. For example:
pip install apache-airflow-providers-amazon[apache.hive]Dependent package |
Extra |
|---|---|
apache.hive |
|
exasol |
|
ftp |
|
imap |
|
mongo |
|
mysql |
|
postgres |
|
ssh |
Changelog
2.0.0
Breaking changes
Auto-apply apply_default decorator (#15667)
Features
CloudwatchTaskHandler reads timestamp from Cloudwatch events (#15173)
remove retry for now (#16150)
Remove the 'not-allow-trailing-slash' rule on S3_hook (#15609)
Add support of capacity provider strategy for ECSOperator (#15848)
Update copy command for s3 to redshift (#16241)
Make job name check optional in SageMakerTrainingOperator (#16327)
Add AWS DMS replication task operators (#15850)
Bug Fixes
Fix S3 Select payload join (#16189)
Fix spacing in 'AwsBatchWaitersHook' docstring (#15839)
MongoToS3Operator failed when running with a single query (not aggregate pipeline) (#15680)
fix: AwsGlueJobOperator change order of args for load_file (#16216)
Fix S3ToFTPOperator (#13796)
1.4.0
Features
S3Hook.load_file should accept Path object in addition to str (#15232)
Bug fixes
Fix 'logging.exception' redundancy (#14823)
Fix AthenaSensor calling AthenaHook incorrectly (#15427)
Add links to new modules for deprecated modules (#15316)
Fixes doc for SQSSensor (#15323)
1.3.0
Features
A bunch of template_fields_renderers additions (#15130)
Send region_name into parent class of AwsGlueJobHook (#14251)
Added retry to ECS Operator (#14263)
Make script_args templated in AwsGlueJobOperator (#14925)
Add FTPToS3Operator (#13707)
Implemented S3 Bucket Tagging (#14402)
S3DataSource is not required (#14220)
Bug fixes
AWS: Do not log info when SSM & SecretsManager secret not found (#15120)
Cache Hook when initializing 'CloudFormationCreateStackSensor' (#14638)
1.2.0
Features
Avoid using threads in S3 remote logging upload (#14414)
Allow AWS Operator RedshiftToS3Transfer To Run a Custom Query (#14177)
includes the STS token if STS credentials are used (#11227)
1.1.0
Features
Adding support to put extra arguments for Glue Job. (#14027)
Add aws ses email backend for use with EmailOperator. (#13986)
Add bucket_name to template fileds in S3 operators (#13973)
Add ExasolToS3Operator (#13847)
AWS Glue Crawler Integration (#13072)
Add acl_policy to S3CopyObjectOperator (#13773)
AllowDiskUse parameter and docs in MongotoS3Operator (#12033)
Add S3ToFTPOperator (#11747)
add xcom push for ECSOperator (#12096)
[AIRFLOW-3723] Add Gzip capability to mongo_to_S3 operator (#13187)
Add S3KeySizeSensor (#13049)
Add 'mongo_collection' to template_fields in MongoToS3Operator (#13361)
Allow Tags on AWS Batch Job Submission (#13396)
Bug fixes
Fix bug in GCSToS3Operator (#13718)
Fix S3KeysUnchangedSensor so that template_fields work (#13490)
1.0.0
Initial version of the provider.
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
File details
Details for the file apache-airflow-providers-amazon-2.0.0.tar.gz.
File metadata
- Download URL: apache-airflow-providers-amazon-2.0.0.tar.gz
- Upload date:
- Size: 130.6 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/3.2.0 pkginfo/1.6.1 requests/2.25.0 setuptools/50.3.2 requests-toolbelt/0.9.1 tqdm/4.52.0 CPython/3.7.9
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 88cd9f553998c25676079ffc3aafaf8902bde60b1c105ebae93fd9483d6f0a59 |
|
| MD5 | 7d7cac4b30f41360a70278e1972dc269 |
|
| BLAKE2b-256 | 5d61d6ee70d20dc34bc213230b7fbb8eba2b7deeee135a88024958dc0fee489a |
Provenance
File details
Details for the file apache_airflow_providers_amazon-2.0.0-py3-none-any.whl.
File metadata
- Download URL: apache_airflow_providers_amazon-2.0.0-py3-none-any.whl
- Upload date:
- Size: 252.4 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/3.2.0 pkginfo/1.6.1 requests/2.25.0 setuptools/50.3.2 requests-toolbelt/0.9.1 tqdm/4.52.0 CPython/3.7.9
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | c43bc82a9d99d0dfecbcc15801c687fd902ddb8c1afa6c77a2f7cc8fc84f4d33 |
|
| MD5 | 6ec31d06f28603fb46b1c3db33412c24 |
|
| BLAKE2b-256 | d7b48310452178f0e95f9ad152bbd915270dbbf383703001d1b6995ca7d88cb1 |
