Skip to main content

Python client for managing Kafka connectors..

Project description

kafka-connect-manager

GitHub Actions Docker Hub repository

A Python client to configure and create connectors using the Kafka Connect API.

Overview

Kafka-connect-manager helps to configure and create Kafka connectors. It can select Kafka topics using a regular expression and exclude topics added to a exclusion list. The auto-update option dynamically updates the connector if topics are created or deleted in Kafka.

Kafka-connect-manager can validate the connector configuration and return the validation output in case of errors.

Kafka-connect-manager provides a command line interface (CLI) to interact with the Kafka Connect API. Using the CLI you can manage existing connectors or create a new one.

To deploy a supported connector, you can use the kafka-connect-manager Helm chart.

Supported connectors

See the docs for more information.

Change log

0.8.1 (2020-10-18)

  • Fix bug preventing to read InfluxDB password from the environment

  • Update cp-kafka-connect image with Confluent Platform 0.8.2

  • Update dependencies

0.8.0 (2020-08-05)

  • Use data classes for the application and connector configuration.

  • Plugin like organization, to support new connectors add a cli and a config file.

  • Add support to the Amazon S3 Sink connector

0.7.2 (2020-03-31)

  • Add support to the InfluxDB Sink Connector.

  • Add –timestamp option to select the timestamp field to use in the InfluxDB Sink connector.

  • Fix Header Converter Class configuration setting.

  • Fix tasks.max configuration setting name.

  • Add connector name configuration setting to support multiple connectors of the same class.

  • Handle empty list of topics properly.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

kafkaconnect-0.8.1.tar.gz (54.2 kB view details)

Uploaded Source

Built Distribution

kafkaconnect-0.8.1-py3-none-any.whl (17.3 kB view details)

Uploaded Python 3

File details

Details for the file kafkaconnect-0.8.1.tar.gz.

File metadata

  • Download URL: kafkaconnect-0.8.1.tar.gz
  • Upload date:
  • Size: 54.2 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.2.0 pkginfo/1.5.0.1 requests/2.24.0 setuptools/50.3.0 requests-toolbelt/0.9.1 tqdm/4.50.2 CPython/3.8.6

File hashes

Hashes for kafkaconnect-0.8.1.tar.gz
Algorithm Hash digest
SHA256 87035551629d724bb8b3ddeed17092211e0b28b9689c7b5e696e128abb6522a7
MD5 8ad11f3c7d80fb8c782683dfea4598f1
BLAKE2b-256 888ae10b65aef22e83e014d846c8b1af3b52cc8bcb91371e4e1861d46b0f3d16

See more details on using hashes here.

File details

Details for the file kafkaconnect-0.8.1-py3-none-any.whl.

File metadata

  • Download URL: kafkaconnect-0.8.1-py3-none-any.whl
  • Upload date:
  • Size: 17.3 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.2.0 pkginfo/1.5.0.1 requests/2.24.0 setuptools/50.3.0 requests-toolbelt/0.9.1 tqdm/4.50.2 CPython/3.8.6

File hashes

Hashes for kafkaconnect-0.8.1-py3-none-any.whl
Algorithm Hash digest
SHA256 531685fb4a1edd9e092905d491cf0cce41dd6a64ddd903ab66f64f579bf5cd6c
MD5 4431517cf8db79c0eb24acc0d6078e52
BLAKE2b-256 5867f237c05a76da39fdfa6c0de49da14dec7c42fe66c9370b71ea05667eb2af

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page