Fresh Python Mesos HTTP Scheduler and Executor
Project description
Long Lasting Mesos freshness for Python
The main goal is to provide a low-complexity and feature rich support for pure python Mesos Frameworks, but also to learn things.
There be dragons
mentos is still quite experimental right now. No production frameworks have been built using it.
Notable Features
Pure python so no C++ meddling
Full featured Zookeeper and Redirect based Master detection
Dict based for simplicity
Task scheduling should be quite fast due to the asynchronous nature of the networking engine
Nice policy based reconnect and retry system
Fancy Testing and Development enviroment based on docker-compose
Install
Not on pypi right now. Install from this repository.
Tested Python Versions: - 2.7 - 3.5 - 3.6
Requirements: - Mesos > 0.28 - Zookeeper
Development
Run docker-compose up to get a working instalation of Mesos going.
Requirements: - docker - docker-compose > 1.6.0
Examples
An example Mesos Scheduler and Executor can be found in the examples folder. It runs one task and then starts declining offers. The Task basically transmits and prints a message. Excuse the magic.
Tests
[x] utils
[x] states
[x] interface
[x] retry
[x] exceptions
[x] connection
[x] subscription
[x] executor
[x] scheduler
Documentation
Not there yet
Outlook
The long term goal is for this to serve as a base for Satyr and other more high level Python based frameworks.
Acknowledgements
This has been heavily based on zoonado and was influenced by Satyr and PyMesos and shares some utility code with both. The RecordIO format parsing was lifted from mrocklins gist.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
File details
Details for the file mentos-0.1.8.tar.gz
.
File metadata
- Download URL: mentos-0.1.8.tar.gz
- Upload date:
- Size: 15.9 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 0b19b8290376424cec5d74ef79ef4b1ff156a1da5640c920fc44e114d2ccc3fd |
|
MD5 | 2e75da8ba82ddcf553e13a042f5302bc |
|
BLAKE2b-256 | db0ac897bea7f97ad3679ce029b6696f6215452812c39c60039e9a1ef1611a33 |
File details
Details for the file mentos-0.1.8-py2.py3-none-any.whl
.
File metadata
- Download URL: mentos-0.1.8-py2.py3-none-any.whl
- Upload date:
- Size: 21.8 kB
- Tags: Python 2, Python 3
- Uploaded using Trusted Publishing? No
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | f4040fa5194b4f20cd96b2dd54de84bb5c8ff38060c2b1630b526ba32733b328 |
|
MD5 | 5f6a01ab7c612e488d301f1e2356ac7f |
|
BLAKE2b-256 | 17f9f1c4a950941dcbf0cf45c9052e186a474b7d9c4035a3b98967c703945543 |