Skip to main content

Fresh Python Mesos HTTP Scheduler and Executor

Project description

Long Lasting Mesos freshness for Python

Build Status Coverage Status

The main goal is to provide a low-complexity and feature rich support for pure python Mesos Frameworks, but also to learn things.

There be dragons

mentos is still quite experimental right now. No production frameworks have been built using it.

Notable Features

  • Pure python so no C++ meddling

  • Full featured Zookeeper and Redirect based Master detection

  • Dict based for simplicity

  • Task scheduling should be quite fast due to the asynchronous nature of the networking engine

  • Nice policy based reconnect and retry system

  • Fancy Testing and Development enviroment based on docker-compose

Install

Not on pypi right now. Install from this repository.

Tested Python Versions: - 2.7 - 3.5 - 3.6

Requirements: - Mesos > 0.28 - Zookeeper

Development

Run docker-compose up to get a working instalation of Mesos going.

Requirements: - docker - docker-compose > 1.6.0

Examples

An example Mesos Scheduler and Executor can be found in the examples folder. It runs one task and then starts declining offers. The Task basically transmits and prints a message. Excuse the magic.

Tests

  • [x] utils

  • [x] states

  • [x] interface

  • [x] retry

  • [x] exceptions

  • [x] connection

  • [x] subscription

  • [x] executor

  • [x] scheduler

Documentation

Not there yet

Outlook

The long term goal is for this to serve as a base for Satyr and other more high level Python based frameworks.

Acknowledgements

This has been heavily based on zoonado and was influenced by Satyr and PyMesos and shares some utility code with both. The RecordIO format parsing was lifted from mrocklins gist.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

mentos-0.1.8.tar.gz (15.9 kB view details)

Uploaded Source

Built Distribution

mentos-0.1.8-py2.py3-none-any.whl (21.8 kB view details)

Uploaded Python 2 Python 3

File details

Details for the file mentos-0.1.8.tar.gz.

File metadata

  • Download URL: mentos-0.1.8.tar.gz
  • Upload date:
  • Size: 15.9 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No

File hashes

Hashes for mentos-0.1.8.tar.gz
Algorithm Hash digest
SHA256 0b19b8290376424cec5d74ef79ef4b1ff156a1da5640c920fc44e114d2ccc3fd
MD5 2e75da8ba82ddcf553e13a042f5302bc
BLAKE2b-256 db0ac897bea7f97ad3679ce029b6696f6215452812c39c60039e9a1ef1611a33

See more details on using hashes here.

File details

Details for the file mentos-0.1.8-py2.py3-none-any.whl.

File metadata

File hashes

Hashes for mentos-0.1.8-py2.py3-none-any.whl
Algorithm Hash digest
SHA256 f4040fa5194b4f20cd96b2dd54de84bb5c8ff38060c2b1630b526ba32733b328
MD5 5f6a01ab7c612e488d301f1e2356ac7f
BLAKE2b-256 17f9f1c4a950941dcbf0cf45c9052e186a474b7d9c4035a3b98967c703945543

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page