Provider for Apache Airflow. Implements apache-airflow-providers-elasticsearch package
Project description
Package apache-airflow-providers-elasticsearch
Release: 4.2.0rc3
Provider package
This is a provider package for elasticsearch provider. All classes for this provider package are in airflow.providers.elasticsearch python package.
You can find package information and changelog for the provider in the documentation.
Installation
You can install this package on top of an existing Airflow 2 installation (see Requirements below for the minimum Airflow version supported) via pip install apache-airflow-providers-elasticsearch
The package supports the following python versions: 3.7,3.8,3.9,3.10
Requirements
PIP package |
Version required |
|---|---|
apache-airflow |
>=2.2.0 |
apache-airflow-providers-common-sql |
|
elasticsearch |
>7 |
elasticsearch-dbapi |
|
elasticsearch-dsl |
>=5.0.0 |
Cross provider package dependencies
Those are dependencies that might be needed in order to use all the features of the package. You need to install the specified provider packages in order to use them.
You can install such cross-provider dependencies when installing from PyPI. For example:
pip install apache-airflow-providers-elasticsearch[common.sql]Dependent package |
Extra |
|---|---|
common.sql |
Changelog
4.2.0
Features
Improve ElasticsearchTaskHandler (#21942)
4.1.0
Features
Adding ElasticserachPythonHook - ES Hook With The Python Client (#24895)
Move all SQL classes to common-sql provider (#24836)
Bug Fixes
Move fallible ti.task.dag assignment back inside try/except block (#24533) (#24592)
4.0.0
Breaking changes
This release of provider is only available for Airflow 2.2+ as explained in the Apache Airflow providers support policy https://github.com/apache/airflow/blob/main/README.md#support-for-providers
Misc
Apply per-run log templates to log handlers (#24153)
3.0.3
Bug Fixes
Make ElasticSearch Provider compatible for Airflow<2.3 (#22814)
3.0.2
Bug Fixes
Fix mistakenly added install_requires for all providers (#22382)
Fix "run_id" k8s and elasticsearch compatibility with Airflow 2.1 (#22385)
3.0.1
Misc
Add Trove classifiers in PyPI (Framework :: Apache Airflow :: Provider)
3.0.0
Breaking changes
Change default log filename template to include map_index (#21495)
Misc
Support for Python 3.10
2.2.0
Features
Emit "logs not found" message when ES logs appear to be missing (#21261)
Use compat data interval shim in log handlers (#21289)
Misc
Clarify ElasticsearchTaskHandler docstring (#21255)
2.1.0
Features
Add docs for AIP 39: Timetables (#17552)
Adds example showing the ES_hook (#17944)
2.0.3
Bug Fixes
Fix Invalid log order in ElasticsearchTaskHandler (#17551)
Misc
Optimise connection importing for Airflow 2.2.0
Adds secrets backend/logging/auth information to provider yaml (#17625)
2.0.2
Bug Fixes
Updated dependencies to allow Python 3.9 support
2.0.1
Breaking changes
Auto-apply apply_default decorator (#15667)
Remove support Jinja templated log_id in Elasticsearch (#16465)
While undocumented, previously [elasticsearch] log_id supported a Jinja templated string. Support for Jinja templates has now been removed. log_id should be a template string instead, for example: {dag_id}-{task_id}-{execution_date}-{try_number}.
If you used a Jinja template previously, the execution_date on your Elasticsearch documents will need to be updated to the new format.
Features
Support remote logging in elasticsearch with filebeat 7 (#14625)
Support non-https elasticsearch external links (#16489)
Bug fixes
Fix external elasticsearch logs link (#16357)
Fix Elasticsearch external log link with ''json_format'' (#16467)
1.0.4
Bug fixes
Fix 'logging.exception' redundancy (#14823)
Fix exception caused by missing keys in the ElasticSearch Record (#15163)
1.0.3
Bug fixes
Elasticsearch Provider: Fix logs downloading for tasks (#14686)
1.0.2
Bug fixes
Corrections in docs and tools after releasing provider RCs (#14082)
1.0.1
Updated documentation and readme files.
Bug fixes
Respect LogFormat when using ES logging with Json Format (#13310)
1.0.0
Initial version of the provider.
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Hashes for apache-airflow-providers-elasticsearch-4.2.0rc3.tar.gz
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 21e87f57f4b4b324cf58467f4c7d6bb5a4dd9b3d40a13a982a74a5e09472c953 |
|
| MD5 | e30ab9914a5060cdae380f1b4d50a30d |
|
| BLAKE2b-256 | 6723d470279a04349098df9e953ae15caa4fb0b65cebe6af0a7e2816e3bbce35 |
Hashes for apache_airflow_providers_elasticsearch-4.2.0rc3-py3-none-any.whl
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | e667cc9d33b118e67a267b76038638a23ae0d9caefd9107e26a16846c0b87056 |
|
| MD5 | 849675cbb8469243b5c1e9ffcb295624 |
|
| BLAKE2b-256 | 79e9c0823ecf6dfbb15b58bbe41d9f50894ed0aa5f8bcd96168d06c553cc3f89 |
