BioMAJ process service
Project description
# About
Microservice to manage the process execution of biomaj.
A protobuf interface is available in biomaj_process/message/message_pb2.py to exchange messages between BioMAJ and the download service. Messages go through RabbitMQ (to be installed).
# Protobuf
To compile protobuf, in biomaj_process/message:
protoc –python_out=. message.proto
# Development
flake8 biomaj_process
# Run
## Message consumer: export BIOMAJ_CONFIG=path_to_config.yml python bin/biomaj_process_consumer.py
## Web server
If package is installed via pip, you need a file named gunicorn_conf.py containing somehwhere on local server:
- def worker_exit(server, worker):
from prometheus_client import multiprocess multiprocess.mark_process_dead(worker.pid)
If you cloned the repository and installed it via python setup.py install, just refer to the gunicorn_conf.py in the cloned repository.
export BIOMAJ_CONFIG=path_to_config.yml rm -rf ..path_to/godocker-prometheus-multiproc mkdir -p ..path_to/godocker-prometheus-multiproc export prometheus_multiproc_dir=..path_to/godocker-prometheus-multiproc gunicorn biomaj_download.biomaj_process_web:app
Web processes should be behind a proxy/load balancer, API base url /api/download
- 3.0.3:
fix prometheus + gunicorn multi process add consul supervision
- 3.0.2:
add logging info execute docker processes in biomaj micro service
- 3.0.1:
bug fixes
- 3.0.0:
move process management out of biomaj main package
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
File details
Details for the file biomaj_process-3.0.3.tar.gz.
File metadata
- Download URL: biomaj_process-3.0.3.tar.gz
- Upload date:
- Size: 12.5 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 9ef16204b7fdbc253dac5a95f2f4ea32d2e315abbdcc205337dd82ded91b2d30 |
|
| MD5 | 2d495a807a212927fd8aafc306589826 |
|
| BLAKE2b-256 | ba674dc549668676661d679b094eaab1c5cf44ab744a7c429d794a6534feeee4 |
File details
Details for the file biomaj_process-3.0.3-py2.py3-none-any.whl.
File metadata
- Download URL: biomaj_process-3.0.3-py2.py3-none-any.whl
- Upload date:
- Size: 15.5 kB
- Tags: Python 2, Python 3
- Uploaded using Trusted Publishing? No
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | b2c969f2278f1466d5260ffa5ee550782de205efd641c7f5b1e6aec7868a5f85 |
|
| MD5 | 17ed7f44662e5fd3d657fa99009344e5 |
|
| BLAKE2b-256 | 5b290a2d307721f34c171fb18d62962a3f15c976cbc750304d4dfe8d4e1ed3e7 |
