Accelerate PyTorch models with ONNX Runtime
Project description
The torch-ort packages uses the PyTorch APIs to accelerate PyTorch models using ONNX Runtime.
Dependencies
The torch-ort package depends on the onnxruntime-training package, which depends on specific versions of GPU libraries such as NVIDIA CUDA.
The default command pip install torch-ort installs the onnxruntime-training version that depends on CUDA 10.2.
If you have a different version of CUDA installed, you can install a different version of onnxruntime-training explicitly:
- CUDA 11.1
pip install onnxruntime-training -f https://download.onnxruntime.ai/onnxruntime_stable_cu111.html
Post-installation step
Once torch-ort is installed, there is a post-installation step:
python -m torch_ort.configure
If this step fails, it is likely due to GPU library version mismatch between onnxruntime-training and your installation. You can check the version of onnxruntime-training by running pip list. For example:
onnxruntime-training 1.9.0+cu111
Releases
-
1.9.0
Release Notes : https://github.com/pytorch/ort/releases/tag/v1.9.0
-
1.8.1
Release Notes : https://github.com/pytorch/ort/releases/tag/v1.8.1
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distributions
Built Distribution
File details
Details for the file torch_ort-1.16.0.dev20240206-py3-none-any.whl.
File metadata
- Download URL: torch_ort-1.16.0.dev20240206-py3-none-any.whl
- Upload date:
- Size: 5.9 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: RestSharp/106.13.0.0
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | c8286ca0a72ccae348b2b15e369fbe32e8de8619a75c411558c411b1074ec820 |
|
| MD5 | 0cb501702b3801022492fe256ecdbb17 |
|
| BLAKE2b-256 | 4c967a38698bc9198171bb8315d10ccc305fecae973219a0e7a103187cdb2282 |
