Reproducible machine learning pipelines using mlflow.
Project description
mlf-core
Fully GPU deterministic machine learning project templates using MLflow.
Free software: Apache2.0
Documentation: https://mlf-core.readthedocs.io.
Features
Jumpstart your machine learning project with fully fledged, multi GPU enabled mlflow project templates
Pytorch, Tensorflow, XGBoost supported
mlflow templates are fully GPU deterministic with system-intelligence
Conda and Docker support out of the box
Credits
Primary idea and main development by Lukas Heumos. This package was created with cookietemple based on a modified audreyr/cookiecutter-pypackage project template using Cookiecutter.
Changelog
This project adheres to Semantic Versioning.
1.4.0 (2020-08-28)
Added
model.rst documentation for all templates
added support for verbose output
Fixed
Publish Docker workflows now use the new Github registry
Default Docker container names are now `image: ghcr.io/{{ cookiecutter.github_username }}/{{ cookiecutter.project_slug_no_hyphen }}:{{ cookiecutter.version }}`
Dependencies
Deprecated
1.3.0 (2020-08-27)
Added
automatically mounting /data now in all mlflow templates (#56)
mlflow-xgboost xgboost from 1.1.1 to 1.2.0
Fixed
mlf_core.py now uses project_slug; adapted linter accordingly (#55)
Removed dask-cuda from mlflow-xgboost
Dependencies
Deprecated
1.2.2 (2020-08-21)
Added
Fixed
A couple of parameters were not with hyphen -> now default behavior
Dependencies
Deprecated
1.2.1 (2020-08-21)
Added
Fixed
flake8 for mlflow-pytorch
Dependencies
Deprecated
1.2.0 (2020-08-21)
Added
Option –view to config to view the current configuration
Option –set_token to sync to set the sync token again
Fixed
#41 https://github.com/mlf-core/mlf-core/issues/41 -> mlflow-pytorch multi GPU Support
Dependencies
Deprecated
1.1.0 (2020-08-19)
Added
Publish Docker workflow. Publishes to Github Packages per default, but can be configured.
Linting function, which checks mlflow-pytorch for any used atomic_add functions.
system-intelligence 1.2.2 -> 1.2.3
Support for both, MLF-CORE TODO: and TODO MLF-CORE: statements
Fixed
Default project version from 0.1.0 to 0.1.0-SNAPSHOT.
Outdated screenshots
Nightly versions now warn instead of wrongly complaining about outdated versions.
Sync actor, but not yet completely for organizations
A LOT of documentation
Now using project_slug_no_hyphen to facilitate the creation of repositories with - characters.
Removed boston dataset from XGBoost and XGBoost_dask
Renamed all parameters to use hyphens instead of underscores
Dependencies
Deprecated
1.0.1 (2020-08-11)
Added
Fixed
Sync workflow now uses the correct secret
Dependencies
Deprecated
1.0.0 (2020-08-11)
Added
Created the project using cookietemple
Added all major commands: create, list, info, lint, sync, bump-version, config, upgrade
Added mlflow-pytorch, mlflow-tensorflow, mlflow-xgboost, mlflow-xgboost_dask templates
Fixed
Dependencies
Deprecated
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Hashes for mlf_core-1.4.0-py2.py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 0898c7420f792e92512b156bc95614bd52d0b9fba85af2d67ea7a019800504f1 |
|
MD5 | 1a4c5b207161e470d8f9f12f13d787e0 |
|
BLAKE2b-256 | 2dbca74da1f21b03054a350b32b0d5a88e545713c8adf2b842d061c5699d7707 |