evbus app-merge components for kafka queues
Project description
This project contains app-merge components for pop-evbus .
Getting Started
Prerequisites
Python 3.7+
git (if installing from source, or contributing to the project)
Installation
If wanting to use evbus-kafka, you can do so by either installing from PyPI or from source.
Install from PyPI
pip install evbus-kafka
Install from source
# clone repo
git clone git@gitlab.com:vmware/idem/evbus-kafka.git
cd evbus-kafka
# Setup venv
python3 -m venv .venv
source .venv/bin/activate
pip install -e .
Usage
Configure pop-evbus for your app.
The connection portion of the kafka profile accepts any parameters that can be used in the AIOKafkaProducer class
credentials.yml
kafka:
default:
connection:
bootstrap_servers:
- localhost:9092
topics:
- topic1
- topic2
Encrypt the credentials file and export the ACCT environment variables
$ pip install acct
$ export ACCT_KEY=$(acct encrypt credentials.yml)
$ export ACCT_FILE="$PWD/credentials.yml.fernet"
Now when you put a message on the evbus queue, it will be propagated to your configured kafka implementation.
async def my_func(hub):
await hub.evbus.broker.put(body={"message": "event content"}, profile="default")
Testing
A kafka server is necessary for running the tests. You can use your own kafka server, or you can use docker . Start a local kafka server:
docker run -p 2181:2181 -p 443:9092 -p 9092:9092 \ ✔ 14s idem-core
--env ADVERTISED_LISTENERS=PLAINTEXT://localhost:443,INTERNAL://localhost:9093 \
--env LISTENERS=PLAINTEXT://0.0.0.0:9092,INTERNAL://0.0.0.0:9093 \
--env SECURITY_PROTOCOL_MAP=PLAINTEXT:PLAINTEXT,INTERNAL:PLAINTEXT \
--env INTER_BROKER=INTERNAL \
krisgeus/docker-kafka
Configure credentials for testing with a local rabbitmq server:
# credentials.yml
kafka:
test_development_evbus_kafka:
connection:
bootstrap_servers: localhost:9092
Encrypt the credentials file and export the ACCT environment variables
$ pip install acct
$ export ACCT_KEY=$(acct encrypt credentials.yml)
$ export ACCT_FILE="$PWD/credentials.yml.fernet"
Install testing requirements
$ pip install -r requirements/test.in
Run the tests with pytest: .. code-block:: bash
$ pytest tests
Roadmap
Reference the open issues for a list of proposed features (and known issues).
Acknowledgements
Img Shields for making repository badges easy.
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
File details
Details for the file evbus-kafka-3.0.1.tar.gz
.
File metadata
- Download URL: evbus-kafka-3.0.1.tar.gz
- Upload date:
- Size: 8.4 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/3.8.0 pkginfo/1.8.2 readme-renderer/32.0 requests/2.27.1 requests-toolbelt/0.9.1 urllib3/1.26.8 tqdm/4.63.0 importlib-metadata/4.11.2 keyring/23.5.0 rfc3986/2.0.0 colorama/0.4.4 CPython/3.9.10
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | d72c3698874b78e2be2be3c8321fa9837bc082bd67828c083e7e2c082fbed0ed |
|
MD5 | f3a774654a9b492d9f1ed045b92d5834 |
|
BLAKE2b-256 | 6c4bb48c8a4fe39010dc149129c706242f5f61b3d8d4879965d8d2c99054870a |
File details
Details for the file evbus_kafka-3.0.1-py3-none-any.whl
.
File metadata
- Download URL: evbus_kafka-3.0.1-py3-none-any.whl
- Upload date:
- Size: 8.1 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/3.8.0 pkginfo/1.8.2 readme-renderer/32.0 requests/2.27.1 requests-toolbelt/0.9.1 urllib3/1.26.8 tqdm/4.63.0 importlib-metadata/4.11.2 keyring/23.5.0 rfc3986/2.0.0 colorama/0.4.4 CPython/3.9.10
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | e8db27d8c853b530a23e96f9646bf24df44e677107ad9fb8aed687f0acde4248 |
|
MD5 | cb57c7571cf3c5b0a931909e502fe174 |
|
BLAKE2b-256 | be3112edef8240a07a2f29f1bf1596ea6f01f00b2d0c53936a060aaa85e79955 |