Skip to main content

MLgym, a python framework for distributed machine learning model training in research.

Project description

MLgym

a python framework for distributed machine learning model training in research.

CircleCI

At its core, MLgym offers functionality to run gridsearches of Pytorch models at scale split over multiple GPUs and centrally store the results using DashifyML.

Futhermore, MLgym provides the following key features:

  • Reproducibility of results due to full experiment specification including dataset, preprocessing routines, model architecture, loss function, metrics and more within a single YAML config.
  • Component registry to register custom components with dependencies. For instance one can define a new preprocessing routine component. This component may depend on an iterator component, as specified in the experiment config. During runtime these components are instantiated on the fly.

Please note, that at the moment this code should be treated as experimental and is not production ready.

Install

there are two options to install MLgym, the easiest way is to install it from the pip repository:

pip install mlgym

For the latest version, one can directly install it from source by cd into the root folder and then running

pip install src/

Usage

NOTE: This framework is still under heavy development and mainly used in research projects. It's most likely not free of bugs and interfaces can still change.

For usage see this example.

Copyright

Copyright (c) 2020 Max Lübbering, Rajkumar Ramamurthy

For license see: https://github.com/le1nux/mlgym/blob/master/LICENSE

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

mlgym-0.0.26.tar.gz (36.8 kB view details)

Uploaded Source

Built Distribution

mlgym-0.0.26-py3-none-any.whl (54.4 kB view details)

Uploaded Python 3

File details

Details for the file mlgym-0.0.26.tar.gz.

File metadata

  • Download URL: mlgym-0.0.26.tar.gz
  • Upload date:
  • Size: 36.8 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.4.1 importlib_metadata/3.10.0 pkginfo/1.7.0 requests/2.25.1 requests-toolbelt/0.9.1 tqdm/4.59.0 CPython/3.9.2

File hashes

Hashes for mlgym-0.0.26.tar.gz
Algorithm Hash digest
SHA256 69408ae1df76ce9de455a322e0a2ddde9446328b79c8bbe1dd48416dc637bc30
MD5 efa41ea07bab70ef3a9d87ad03c0b9b8
BLAKE2b-256 9995f643f412ee3bb3ce0ac22c250868e5c8927deb8887f0da5272179ec40926

See more details on using hashes here.

File details

Details for the file mlgym-0.0.26-py3-none-any.whl.

File metadata

  • Download URL: mlgym-0.0.26-py3-none-any.whl
  • Upload date:
  • Size: 54.4 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.4.1 importlib_metadata/3.10.0 pkginfo/1.7.0 requests/2.25.1 requests-toolbelt/0.9.1 tqdm/4.59.0 CPython/3.9.2

File hashes

Hashes for mlgym-0.0.26-py3-none-any.whl
Algorithm Hash digest
SHA256 5f96bb2d4fa42fb75a88af912676870ecf4b805d4b6769c414cf995f7711948e
MD5 a65da033af4d22ace009e86bf25727dc
BLAKE2b-256 5f96523cb3cb84815b9090b0f592f681cf6f50a869c84c2596ed841310dacafd

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page