Python client for managing Kafka connectors.
Project description
############
kafkaconnect
############
|Build| |Docker|
A Python client for managing connectors using the `Kafka Connect API <https://docs.confluent.io/current/connect/references/restapi.html>`_.
See `the docs <https://kafka-connect-manager.lsst.io>`_ for more information.
.. |Build| image:: https://github.com/lsst-sqre/kafka-connect-manager/workflows/CI/badge.svg
:alt: GitHub Actions
:scale: 100%
:target: https://github.com/lsst-sqre/kafka-connect-manager/actions
.. |Docker| image:: https://img.shields.io/docker/v/lsstsqre/kafkaconnect?sort=date
:alt: Docker Hub repository
:scale: 100%
:target: https://hub.docker.com/repository/docker/lsstsqre/kafkaconnect
##########
Change log
##########
0.9.1 (2021-06-09)
==================
* Add support to configure multiple InfluxDB Sink connectors.
* Add user guide documentation on how to reset the InfluxDB Sink connector consumer group offsets.
* Update ``cp-kafka-connect`` image with new version of the InfluxDB Sink Connector. See `#737 <https://github.com/lensesio/stream-reactor/issues/737>`_ for details.
0.9.0 (2021-05-03)
==================
* Add ``create mirrormaker2`` command
* Add ``create jdbc-sink`` command
* Update dependencies
0.8.3 (2021-03-04)
==================
* Add upload command
* Initial support to MirrorMaker 2 and Confuent JDBC Sink Connectors
* Update dependencies
0.8.2 (2021-01-25)
==================
* Update ``cp-kafka-connect`` image with new version of the InfluxDB Sink connector. This version bumps the ``influxdb-java`` dependency from version 2.9 to 2.21. In particular 2.16 introduced a fix to skip fields with ``NaN`` and ``Infinity`` values when writing to InfluxDB.
* Reorganize developer and user guides.
* Add documentation in the user guide on how to run the InfluxDB Sink connector locally.
* Update dependencies
0.8.1 (2020-10-18)
==================
* Fix bug preventing to read InfluxDB password from the environment
* Update ``cp-kafka-connect`` image with Confluent Platform 5.5.2
* Update dependencies
0.8.0 (2020-08-05)
==================
* Use data classes for the application and connector configuration.
* Plugin like organization, to support new connectors add a cli and a config file.
* Add support to the Amazon S3 Sink connector
0.7.2 (2020-03-31)
==================
* Add support to the InfluxDB Sink Connector.
* Add --timestamp option to select the timestamp field to use in the InfluxDB Sink connector.
* Fix Header Converter Class configuration setting.
* Fix ``tasks.max`` configuration setting name.
* Add connector ``name`` configuration setting to support multiple connectors of the same class.
* Handle empty list of topics properly.
MIT License
Copyright 2020 Association of Universities for Research in Astronomy, Inc. (AURA)
Permission is hereby granted, free of charge, to any person obtaining a copy
of this software and associated documentation files (the "Software"), to deal
in the Software without restriction, including without limitation the rights
to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
copies of the Software, and to permit persons to whom the Software is
furnished to do so, subject to the following conditions:
The above copyright notice and this permission notice shall be included in all
copies or substantial portions of the Software.
THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
SOFTWARE.
kafkaconnect
############
|Build| |Docker|
A Python client for managing connectors using the `Kafka Connect API <https://docs.confluent.io/current/connect/references/restapi.html>`_.
See `the docs <https://kafka-connect-manager.lsst.io>`_ for more information.
.. |Build| image:: https://github.com/lsst-sqre/kafka-connect-manager/workflows/CI/badge.svg
:alt: GitHub Actions
:scale: 100%
:target: https://github.com/lsst-sqre/kafka-connect-manager/actions
.. |Docker| image:: https://img.shields.io/docker/v/lsstsqre/kafkaconnect?sort=date
:alt: Docker Hub repository
:scale: 100%
:target: https://hub.docker.com/repository/docker/lsstsqre/kafkaconnect
##########
Change log
##########
0.9.1 (2021-06-09)
==================
* Add support to configure multiple InfluxDB Sink connectors.
* Add user guide documentation on how to reset the InfluxDB Sink connector consumer group offsets.
* Update ``cp-kafka-connect`` image with new version of the InfluxDB Sink Connector. See `#737 <https://github.com/lensesio/stream-reactor/issues/737>`_ for details.
0.9.0 (2021-05-03)
==================
* Add ``create mirrormaker2`` command
* Add ``create jdbc-sink`` command
* Update dependencies
0.8.3 (2021-03-04)
==================
* Add upload command
* Initial support to MirrorMaker 2 and Confuent JDBC Sink Connectors
* Update dependencies
0.8.2 (2021-01-25)
==================
* Update ``cp-kafka-connect`` image with new version of the InfluxDB Sink connector. This version bumps the ``influxdb-java`` dependency from version 2.9 to 2.21. In particular 2.16 introduced a fix to skip fields with ``NaN`` and ``Infinity`` values when writing to InfluxDB.
* Reorganize developer and user guides.
* Add documentation in the user guide on how to run the InfluxDB Sink connector locally.
* Update dependencies
0.8.1 (2020-10-18)
==================
* Fix bug preventing to read InfluxDB password from the environment
* Update ``cp-kafka-connect`` image with Confluent Platform 5.5.2
* Update dependencies
0.8.0 (2020-08-05)
==================
* Use data classes for the application and connector configuration.
* Plugin like organization, to support new connectors add a cli and a config file.
* Add support to the Amazon S3 Sink connector
0.7.2 (2020-03-31)
==================
* Add support to the InfluxDB Sink Connector.
* Add --timestamp option to select the timestamp field to use in the InfluxDB Sink connector.
* Fix Header Converter Class configuration setting.
* Fix ``tasks.max`` configuration setting name.
* Add connector ``name`` configuration setting to support multiple connectors of the same class.
* Handle empty list of topics properly.
MIT License
Copyright 2020 Association of Universities for Research in Astronomy, Inc. (AURA)
Permission is hereby granted, free of charge, to any person obtaining a copy
of this software and associated documentation files (the "Software"), to deal
in the Software without restriction, including without limitation the rights
to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
copies of the Software, and to permit persons to whom the Software is
furnished to do so, subject to the following conditions:
The above copyright notice and this permission notice shall be included in all
copies or substantial portions of the Software.
THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
SOFTWARE.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
kafkaconnect-0.9.1.tar.gz
(68.4 kB
view details)
Built Distribution
File details
Details for the file kafkaconnect-0.9.1.tar.gz
.
File metadata
- Download URL: kafkaconnect-0.9.1.tar.gz
- Upload date:
- Size: 68.4 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/3.4.1 importlib_metadata/4.5.0 pkginfo/1.7.0 requests/2.25.1 requests-toolbelt/0.9.1 tqdm/4.61.0 CPython/3.9.5
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 5d9936efb3ee9b30499143d95b8faa39fed7275525af26fa9ba8331c97c005d9 |
|
MD5 | cf6fa7703f4e71cda0790881c93100f2 |
|
BLAKE2b-256 | 168f8b931d064613b135a11b52960e016e96866171fef435c7bda722ab851361 |
File details
Details for the file kafkaconnect-0.9.1-py3-none-any.whl
.
File metadata
- Download URL: kafkaconnect-0.9.1-py3-none-any.whl
- Upload date:
- Size: 21.9 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/3.4.1 importlib_metadata/4.5.0 pkginfo/1.7.0 requests/2.25.1 requests-toolbelt/0.9.1 tqdm/4.61.0 CPython/3.9.5
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 9659a1b5852608ab218295ef642f239eb55d18a073f46db7ba5a24a750917d1e |
|
MD5 | cfbce58ed0dc403b04d6c671abe01779 |
|
BLAKE2b-256 | 46e78d36d3fc765a00b701c2111372957f44857245dcfdbdb430d1b734f4a78d |