Skip to main content

BioMAJ download service

Project description

# About

Experimental (in progress) microservice to manage the downloads of biomaj.

A protobuf interface is available in biomaj_download/message/message_pb2.py to exchange messages between BioMAJ and the download service.
Messages go through RabbitMQ (to be installed).

# Protobuf

To compile protobuf, in biomaj_download/message:

protoc --python_out=. message.proto

# Development

flake8 biomaj_download/*.py biomaj_download/download

# Prometheus metrics

Endpoint: /api/download/metrics


# Run

## Message consumer:
export BIOMAJ_CONFIG=path_to_config.yml
python bin/biomaj_download_consumer.py

## Web server

export BIOMAJ_CONFIG=path_to_config.yml
gunicorn biomaj_download.biomaj_download_web:app

Web processes should be behind a proxy/load balancer, API base url /api/download


3.0.7:
Change size type to int64
3.0.6:
Fix download_or_copy to avoid downloading a file existing in a previous production directory
3.0.4:
Fixes on messages
3.0.3:
Fix management of timeout leading to a crash when using biomaj.download parameter.
3.0.2:
set rabbitmq parameter optional
3.0.1:
add missing README etc.. in package
3.0.0:
move download management out of biomaj main package

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

biomaj_download-3.0.7.tar.gz (22.4 kB view details)

Uploaded Source

Built Distribution

biomaj_download-3.0.7-py2.py3-none-any.whl (34.7 kB view details)

Uploaded Python 2 Python 3

File details

Details for the file biomaj_download-3.0.7.tar.gz.

File metadata

File hashes

Hashes for biomaj_download-3.0.7.tar.gz
Algorithm Hash digest
SHA256 67c93bfb9fb74a6b39fbdf5a082a1ed837fdc00142a7572738571efa6e4f8661
MD5 58d0a0f34f9210f30c4370dec58b2468
BLAKE2b-256 4b385b032dc3a81f5081c1b394fbf0fa562ab6f40c06f039913b90f01109964e

See more details on using hashes here.

File details

Details for the file biomaj_download-3.0.7-py2.py3-none-any.whl.

File metadata

File hashes

Hashes for biomaj_download-3.0.7-py2.py3-none-any.whl
Algorithm Hash digest
SHA256 bd8f166d15ca1fec26651003d5a85fe2fd942ea47599360b6fbb8cda21bd29ba
MD5 897603ab3e69d6804ec69b66bc6b40b7
BLAKE2b-256 58247145241c90d7f82ee75ee99732f8fbf9fcfb9513aa0616758fffd77e0f9f

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page