Skip to main content

training Pytorch models with onnxruntime

Project description

training pytorch models with onnxruntime

torch-ort can be used to train pytorch models with onnxruntime backend. Before using torch-ort, one need to have a working pytorch gpu environment.

to build (you need to update version number in version.txt in order to be able to upload python whl):

(run 'pip install setuptools', if it is not already installed) 
rm dist/*
python setup.py bdist_wheel

to publish (it will ask for user name and password):

twine upload dist/*

to install:

stable:

(uninstall onnxruntime version that do not support gpu and training)
pip install torch-ort onnxruntime=1.9.0+cu111_training

nightly:

(make sure you are not in the ort repo folder - otherwise torch-ort is taken as already installed)
pip install --pre torch-ort ort-gpu-nightly-training

(eventually we are aiming at: pip install --pre torch-ort onnxruntime=1.9.0+cu111_training)

to test:

python ./ort/tests/bert_for_sequence_classification.py

to use torch-ort within PyTorch training scripts:

import onnxruntime
from torch_ort import ORTModule
model = ORTModule(model)
# normal PyTorch training script follows

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distribution

torch_ort-0.0.8.dev20210322-py3-none-any.whl (3.0 kB view details)

Uploaded Python 3

File details

Details for the file torch_ort-0.0.8.dev20210322-py3-none-any.whl.

File metadata

  • Download URL: torch_ort-0.0.8.dev20210322-py3-none-any.whl
  • Upload date:
  • Size: 3.0 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.3.0 pkginfo/1.7.0 requests/2.25.1 setuptools/52.0.0.post20210125 requests-toolbelt/0.9.1 tqdm/4.48.1 CPython/3.6.9

File hashes

Hashes for torch_ort-0.0.8.dev20210322-py3-none-any.whl
Algorithm Hash digest
SHA256 44dfd6c96cd75f0291a6d991b44663760bae2bef7ce75f79ce2f8ee73d371bb8
MD5 c25779b0c3c3f1b101241f1df2474431
BLAKE2b-256 d9c6fbd9ed8cc66494aa30d18461e3b3436d59186d940dd35558c476d4c0ef2f

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page