Reproducible machine learning pipelines using mlflow.
Project description
mlf-core
Fully GPU deterministic machine learning project templates using MLflow.
Free software: Apache2.0
Documentation: https://mlf-core.readthedocs.io.
Features
Jumpstart your machine learning project with fully fledged, multi GPU enabled mlflow project templates
Pytorch, Tensorflow, XGBoost supported
mlflow templates are fully GPU deterministic with system-intelligence
Conda and Docker support out of the box
Credits
Primary idea and main development by Lukas Heumos. This package was created with cookietemple based on a modified audreyr/cookiecutter-pypackage project template using Cookiecutter.
Changelog
This project adheres to Semantic Versioning.
1.4.1 (2020-09-10)
Added
Fixed
Github username must now always be lowercase, since Docker does not like uppercase letters
Fixed train_cpu workflows to use the correct containers
Dependencies
Deprecated
1.4.0 (2020-08-28)
Added
model.rst documentation for all templates
added support for verbose output
Fixed
Publish Docker workflows now use the new Github registry
Default Docker container names are now `image: ghcr.io/{{ cookiecutter.github_username }}/{{ cookiecutter.project_slug_no_hyphen }}:{{ cookiecutter.version }}`
Dependencies
Deprecated
1.3.0 (2020-08-27)
Added
automatically mounting /data now in all mlflow templates (#56)
mlflow-xgboost xgboost from 1.1.1 to 1.2.0
Fixed
mlf_core.py now uses project_slug; adapted linter accordingly (#55)
Removed dask-cuda from mlflow-xgboost
Dependencies
Deprecated
1.2.2 (2020-08-21)
Added
Fixed
A couple of parameters were not with hyphen -> now default behavior
Dependencies
Deprecated
1.2.1 (2020-08-21)
Added
Fixed
flake8 for mlflow-pytorch
Dependencies
Deprecated
1.2.0 (2020-08-21)
Added
Option –view to config to view the current configuration
Option –set_token to sync to set the sync token again
Fixed
#41 https://github.com/mlf-core/mlf-core/issues/41 -> mlflow-pytorch multi GPU Support
Dependencies
Deprecated
1.1.0 (2020-08-19)
Added
Publish Docker workflow. Publishes to Github Packages per default, but can be configured.
Linting function, which checks mlflow-pytorch for any used atomic_add functions.
system-intelligence 1.2.2 -> 1.2.3
Support for both, MLF-CORE TODO: and TODO MLF-CORE: statements
Fixed
Default project version from 0.1.0 to 0.1.0-SNAPSHOT.
Outdated screenshots
Nightly versions now warn instead of wrongly complaining about outdated versions.
Sync actor, but not yet completely for organizations
A LOT of documentation
Now using project_slug_no_hyphen to facilitate the creation of repositories with - characters.
Removed boston dataset from XGBoost and XGBoost_dask
Renamed all parameters to use hyphens instead of underscores
Dependencies
Deprecated
1.0.1 (2020-08-11)
Added
Fixed
Sync workflow now uses the correct secret
Dependencies
Deprecated
1.0.0 (2020-08-11)
Added
Created the project using cookietemple
Added all major commands: create, list, info, lint, sync, bump-version, config, upgrade
Added mlflow-pytorch, mlflow-tensorflow, mlflow-xgboost, mlflow-xgboost_dask templates
Fixed
Dependencies
Deprecated
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Hashes for mlf_core-1.4.1-py2.py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 7e25aee7ba3486a5a1b144870b39979c9ee079db25c38bed6a501fec62be6036 |
|
MD5 | fb72ddd8c5e4b3f7da5d526f5edf2d1e |
|
BLAKE2b-256 | d41790b15e8051bea030b8250878fe6fcd7112009ae73354f816a6f0c20a0c27 |