Skip to main content

Easily map Python functions onto a cluster using a DRMAA-compatible grid engine like Sun Grid Engine (SGE).

Project description

Build status https://img.shields.io/coveralls/pygridtools/gridmap/stable.svg PyPI downloads Latest version on PyPI License

A package to allow you to easily create jobs on the cluster directly from Python. You can directly map Python functions onto the cluster without needing to write any wrapper code yourself.

This is the ETS fork of an older project called Python Grid. Unlike the older version, it is Python 2/3 compatible. Another major difference is that you can change the configuration via environment variables instead of having to modify a Python file in your site-packages directory. We’ve also fixed some bugs.

For some examples of how to use it, check out map_reduce.py (for a simple example of how you can map a function onto the cluster) and manual.py (for an example of how you can create list of jobs yourself) in the examples folder.

For complete documentation read the docs.

NOTE: You cannot use GridMap on machines that are not allowed to submit jobs (e.g., worker or edge nodes).

Requirements

Acknowledgments

Thank you to Max-Planck-Society and Educational Testing Service for funding the development of GridMap.

Changelog

See GitHub releases.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

gridmap-0.15.0.tar.gz (41.6 kB view details)

Uploaded Source

File details

Details for the file gridmap-0.15.0.tar.gz.

File metadata

  • Download URL: gridmap-0.15.0.tar.gz
  • Upload date:
  • Size: 41.6 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: Python-urllib/3.6

File hashes

Hashes for gridmap-0.15.0.tar.gz
Algorithm Hash digest
SHA256 5cb1634e1400ba5fa6708b4c94c09a1772c8300951faa76556d2a69579eba6f0
MD5 aeb55b1ad42e67e6279112b9751fbe39
BLAKE2b-256 503b6b366809c242a14911c1751359178e7c40017e53c8c7d6d9392ba36d4723

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page