Skip to main content

Reproducible machine learning pipelines using mlflow.

Project description

mlf-core logo

mlf-core

Github Workflow Build mlf-core Status Github Workflow Tests Status PyPI Discord Documentation Status Dependabot Enabled

Fully GPU deterministic machine learning project templates using MLflow.

Features

  • Jumpstart your machine learning project with fully fledged, multi GPU enabled mlflow project templates

  • Pytorch, Tensorflow, XGBoost supported

  • mlflow templates are fully GPU deterministic with system-intelligence

  • Conda and Docker support out of the box

Credits

Primary idea and main development by Lukas Heumos. This package was created with cookietemple based on a modified audreyr/cookiecutter-pypackage project template using Cookiecutter.

Changelog

This project adheres to Semantic Versioning.

1.3.0 (2020-08-27)

Added

  • automatically mounting /data now in all mlflow templates (#56)

  • mlflow-xgboost xgboost from 1.1.1 to 1.2.0

Fixed

  • mlf_core.py now uses project_slug; adapted linter accordingly (#55)

  • Removed dask-cuda from mlflow-xgboost

Dependencies

Deprecated

1.2.2 (2020-08-21)

Added

Fixed

  • A couple of parameters were not with hyphen -> now default behavior

Dependencies

Deprecated

1.2.1 (2020-08-21)

Added

Fixed

  • flake8 for mlflow-pytorch

Dependencies

Deprecated

1.2.0 (2020-08-21)

Added

  • Option –view to config to view the current configuration

  • Option –set_token to sync to set the sync token again

Fixed

Dependencies

Deprecated

1.1.0 (2020-08-19)

Added

  • Publish Docker workflow. Publishes to Github Packages per default, but can be configured.

  • Linting function, which checks mlflow-pytorch for any used atomic_add functions.

  • system-intelligence 1.2.2 -> 1.2.3

  • Support for both, MLF-CORE TODO: and TODO MLF-CORE: statements

Fixed

  • Default project version from 0.1.0 to 0.1.0-SNAPSHOT.

  • Outdated screenshots

  • Nightly versions now warn instead of wrongly complaining about outdated versions.

  • Sync actor, but not yet completely for organizations

  • A LOT of documentation

  • Now using project_slug_no_hyphen to facilitate the creation of repositories with - characters.

  • Removed boston dataset from XGBoost and XGBoost_dask

  • Renamed all parameters to use hyphens instead of underscores

Dependencies

Deprecated

1.0.1 (2020-08-11)

Added

Fixed

  • Sync workflow now uses the correct secret

Dependencies

Deprecated

1.0.0 (2020-08-11)

Added

  • Created the project using cookietemple

  • Added all major commands: create, list, info, lint, sync, bump-version, config, upgrade

  • Added mlflow-pytorch, mlflow-tensorflow, mlflow-xgboost, mlflow-xgboost_dask templates

Fixed

Dependencies

Deprecated

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

mlf-core-1.3.0.tar.gz (1.4 MB view details)

Uploaded Source

Built Distribution

mlf_core-1.3.0-py2.py3-none-any.whl (164.4 kB view details)

Uploaded Python 2 Python 3

File details

Details for the file mlf-core-1.3.0.tar.gz.

File metadata

  • Download URL: mlf-core-1.3.0.tar.gz
  • Upload date:
  • Size: 1.4 MB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.2.0 pkginfo/1.5.0.1 requests/2.24.0 setuptools/47.1.0 requests-toolbelt/0.9.1 tqdm/4.48.2 CPython/3.8.5

File hashes

Hashes for mlf-core-1.3.0.tar.gz
Algorithm Hash digest
SHA256 d4e7c9f49c633c3374f6672202c37e51551c4c3df7c1d0eea149a20d67f27b97
MD5 edd3a1a3fd26e4c4d9102ff1d3966829
BLAKE2b-256 4b9f5c7c4e373c4bf7447082c4905e4764b2e2813b0865e2547838754cc93ea3

See more details on using hashes here.

File details

Details for the file mlf_core-1.3.0-py2.py3-none-any.whl.

File metadata

  • Download URL: mlf_core-1.3.0-py2.py3-none-any.whl
  • Upload date:
  • Size: 164.4 kB
  • Tags: Python 2, Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.2.0 pkginfo/1.5.0.1 requests/2.24.0 setuptools/47.1.0 requests-toolbelt/0.9.1 tqdm/4.48.2 CPython/3.8.5

File hashes

Hashes for mlf_core-1.3.0-py2.py3-none-any.whl
Algorithm Hash digest
SHA256 1699198cb1e6800fb26ac926dfd854f4b19d6f7a1a6c0525b62a221737090745
MD5 7ee92e20b4ca6a9d2d628859da7de628
BLAKE2b-256 73d5ce9ea6d7dd31187ab084689adef0ef64ebf828f8a1b1ab3e9b8178b39a83

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page