Skip to main content

Provider package apache-airflow-providers-elasticsearch for Apache Airflow

Project description

Package apache-airflow-providers-elasticsearch

Release: 2.0.3rc1

Elasticsearch

Provider package

This is a provider package for elasticsearch provider. All classes for this provider package are in airflow.providers.elasticsearch python package.

You can find package information and changelog for the provider in the documentation.

Installation

You can install this package on top of an existing airflow 2.1+ installation via pip install apache-airflow-providers-elasticsearch

The package supports the following python versions: 3.6,3.7,3.8,3.9

PIP requirements

PIP package

Version required

apache-airflow

>=2.1.0

elasticsearch-dbapi

elasticsearch-dsl

>=5.0.0

elasticsearch

>7

Changelog

2.0.3

Bug Fixes

  • Fix Invalid log order in ElasticsearchTaskHandler (#17551)

Misc

  • Optimise connection importing for Airflow 2.2.0

  • Adds secrets backend/logging/auth information to provider yaml (#17625)

2.0.2

Bug Fixes

  • Updated dependencies to allow Python 3.9 support

2.0.1

Breaking changes

  • Auto-apply apply_default decorator (#15667)

  • Remove support Jinja templated log_id in Elasticsearch (#16465)

    While undocumented, previously [elasticsearch] log_id supported a Jinja templated string. Support for Jinja templates has now been removed. log_id should be a template string instead, for example: {dag_id}-{task_id}-{execution_date}-{try_number}.

    If you used a Jinja template previously, the execution_date on your Elasticsearch documents will need to be updated to the new format.

Features

  • Support remote logging in elasticsearch with filebeat 7 (#14625)

  • Support non-https elasticsearch external links (#16489)

Bug fixes

  • Fix external elasticsearch logs link (#16357)

  • Fix Elasticsearch external log link with ''json_format'' (#16467)

1.0.4

Bug fixes

  • Fix 'logging.exception' redundancy (#14823)

  • Fix exception caused by missing keys in the ElasticSearch Record (#15163)

1.0.3

Bug fixes

  • Elasticsearch Provider: Fix logs downloading for tasks (#14686)

1.0.2

Bug fixes

  • Corrections in docs and tools after releasing provider RCs (#14082)

1.0.1

Updated documentation and readme files.

Bug fixes

  • Respect LogFormat when using ES logging with Json Format (#13310)

1.0.0

Initial version of the provider.

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

Built Distribution

File details

Details for the file apache-airflow-providers-elasticsearch-2.0.3rc1.tar.gz.

File metadata

  • Download URL: apache-airflow-providers-elasticsearch-2.0.3rc1.tar.gz
  • Upload date:
  • Size: 16.1 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.2.0 pkginfo/1.6.1 requests/2.25.0 setuptools/50.3.2 requests-toolbelt/0.9.1 tqdm/4.52.0 CPython/3.7.9

File hashes

Hashes for apache-airflow-providers-elasticsearch-2.0.3rc1.tar.gz
Algorithm Hash digest
SHA256 d8e323ad0279e37040fc1b6c907f8b1bd87dfcb03744f34c03b4aca39d2318fd
MD5 f6e1910bcc81f38c0cd22185b5e83232
BLAKE2b-256 26b5d3a5924e15d91ff1dbdf2b51e8b337d560323877e2676c62e4918b85fa9c

See more details on using hashes here.

Provenance

File details

Details for the file apache_airflow_providers_elasticsearch-2.0.3rc1-py3-none-any.whl.

File metadata

File hashes

Hashes for apache_airflow_providers_elasticsearch-2.0.3rc1-py3-none-any.whl
Algorithm Hash digest
SHA256 f2221d807178c393a6219d8d39b5bda8dd877f0820e78215ad02f1645eb51916
MD5 e2f42a7450ce1b3c944e25f8b357bc3e
BLAKE2b-256 6809bcbb6265d990f034da2a325784db5586c12cb404f3bd9fd40a163a544f00

See more details on using hashes here.

Provenance

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page