Skip to main content

Reproducible machine learning pipelines using mlflow.

Project description

mlf-core logo

mlf-core

PyPI Python Version License Read the documentation at https://mlf-core.readthedocs.io/ Build Package Status Run Tests Status Codecov pre-commit Black

Pepy Downloads Discord

Preprint

mlf-core: a framework for deterministic machine learning

Overview

mlf-core overview

mlf-core provides CPU and GPU deterministic machine learning templates based on MLflow, Conda, Docker and a strong Github integration. Templates are available for PyTorch, TensorFlow and XGBoost. A custom linter ensures that projects stay deterministic in all phases of development and deployment.

Installing

Start your journey with mlf-core by installing it via $ pip install mlf-core.

See Installation.

run

See a mlf-core project in action.

https://user-images.githubusercontent.com/31141763/117714817-c409e580-b1d7-11eb-9991-cb6eb58efbb7.gif

config

Configure mlf-core to get started.

https://user-images.githubusercontent.com/31141763/102669098-f6199d00-418d-11eb-9ae6-26c12d9c1231.gif

See Configuring mlf-core

list

List all available mlf-core templates.

https://user-images.githubusercontent.com/31141763/102668939-8d322500-418d-11eb-8b2c-acd895fc50e3.gif

See Listing all templates.

info

Get detailed information on a mlf-core template.

https://user-images.githubusercontent.com/31141763/102669191-324cfd80-418e-11eb-9542-d2995b7318a9.gif

See Get detailed template information.

create

Kickstart your deterministic machine laerning project with one of mlf-core’s templates in no time.

https://user-images.githubusercontent.com/31141763/102669143-1184a800-418e-11eb-853b-0deb0387efc6.gif

See Create a project.

lint

Use advanced linting to ensure your project always adheres to mlf-core’s standards and stays deterministic.

https://user-images.githubusercontent.com/31141763/102668893-696edf00-418d-11eb-888e-822244a6f5dc.gif

See Linting your project

bump-version

Bump your project version across several files.

https://user-images.githubusercontent.com/31141763/102668987-aaff8a00-418d-11eb-9292-dc512f77f09b.gif

See Bumping the version of an existing project.

sync

Sync your project with the latest mlf-core release to get the latest template features.

https://user-images.githubusercontent.com/31141763/102669065-de421900-418d-11eb-9e1b-a76487d02b2a.gif

See Syncing a project.

upgrade

Check whether you are using the latest mlf-core version and update automatically to benefit from the latest features.

See https://mlf_core.readthedocs.io/en/latest/upgrade.html.

Credits

Primary idea and main development by Lukas Heumos. mlf-core is inspired by nf-core. This package was created with cookietemple based on a modified audreyr/cookiecutter-pypackage project template using cookiecutter.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

mlf-core-1.11.4.tar.gz (5.9 MB view details)

Uploaded Source

Built Distribution

mlf_core-1.11.4-py3-none-any.whl (6.0 MB view details)

Uploaded Python 3

File details

Details for the file mlf-core-1.11.4.tar.gz.

File metadata

  • Download URL: mlf-core-1.11.4.tar.gz
  • Upload date:
  • Size: 5.9 MB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.7.0 importlib_metadata/4.8.2 pkginfo/1.8.2 requests/2.26.0 requests-toolbelt/0.9.1 tqdm/4.62.3 CPython/3.9.9

File hashes

Hashes for mlf-core-1.11.4.tar.gz
Algorithm Hash digest
SHA256 65b55decac92cd41150278975aa9a3152e7e9366b30fbe869eaf512956079a9a
MD5 db33f4af216e8ab68d6c6bc98180c00a
BLAKE2b-256 dc549a82e4f44c3846900ae57c549405fd2e4bcdce4d83ad30f6a88e2075cc04

See more details on using hashes here.

Provenance

File details

Details for the file mlf_core-1.11.4-py3-none-any.whl.

File metadata

  • Download URL: mlf_core-1.11.4-py3-none-any.whl
  • Upload date:
  • Size: 6.0 MB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.7.0 importlib_metadata/4.8.2 pkginfo/1.8.2 requests/2.26.0 requests-toolbelt/0.9.1 tqdm/4.62.3 CPython/3.9.9

File hashes

Hashes for mlf_core-1.11.4-py3-none-any.whl
Algorithm Hash digest
SHA256 77e454173e7bce62ed203beaa7dea74f6bd2a769447936df2935c37affba1cf4
MD5 2eb584e1f9e95e8391d54bb101b0668f
BLAKE2b-256 bd4eaf8b83c5ef8d85c53f509694b576c7ffd0ac9628c1f5faef69526213427c

See more details on using hashes here.

Provenance

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page