Skip to main content

ONNX Runtime is a runtime accelerator for Machine Learning models

Project description

OpenVINO™ Execution Provider for ONNX Runtime is a product designed for ONNX Runtime developers who want to get started with OpenVINO™ in their inferencing applications. This product delivers OpenVINO™ inline optimizations which enhance inferencing performance with minimal code modifications.

OpenVINO™ Execution Provider for ONNX Runtime accelerates inference across many AI models on a variety of Intel® hardware such as:
  • Intel® CPUs

  • Intel® integrated GPUs

Installation

Requirements

  • Ubuntu 18.04, 20.04, RHEL(CPU only) or Windows 10 - 64 bit

  • Python 3.7, 3.8 or 3.9 for Linux and only Python3.9 for Windows

This package supports:
  • Intel® CPUs

  • Intel® integrated GPUs

pip3 install onnxruntime-openvino

Please install OpenVINO™ PyPi Package separately for Windows. For installation instructions on Windows please refer to OpenVINO™ Execution Provider for ONNX Runtime for Windows.

OpenVINO™ Execution Provider for ONNX Runtime Linux Wheels comes with pre-built libraries of OpenVINO™ version 2022.2.0 eliminating the need to install OpenVINO™ separately. The OpenVINO™ libraries are prebuilt with CXX11_ABI flag set to 0.

Usage

By default, Intel® CPU is used to run inference. However, you can change the default option to either Intel® integrated GPU for AI inferencing. Invoke the provider config device type argument to change the hardware on which inferencing is done.

For more API calls and environment variables, see Usage.

Samples

To see what you can do with OpenVINO™ Execution Provider for ONNX Runtime, explore the demos located in the Examples.

License

OpenVINO™ Execution Provider for ONNX Runtime is licensed under MIT. By contributing to the project, you agree to the license and copyright terms therein and release your contribution under these terms.

Support

Please submit your questions, feature requests and bug reports via GitHub Issues.

How to Contribute

We welcome community contributions to OpenVINO™ Execution Provider for ONNX Runtime. If you have an idea for improvement:

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distributions

onnxruntime_openvino-1.14.0-cp39-cp39-win_amd64.whl (4.6 MB view details)

Uploaded CPython 3.9 Windows x86-64

onnxruntime_openvino-1.14.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (36.6 MB view details)

Uploaded CPython 3.9 manylinux: glibc 2.17+ x86-64

onnxruntime_openvino-1.14.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (36.5 MB view details)

Uploaded CPython 3.8 manylinux: glibc 2.17+ x86-64

onnxruntime_openvino-1.14.0-cp37-cp37m-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (36.5 MB view details)

Uploaded CPython 3.7m manylinux: glibc 2.17+ x86-64

File details

Details for the file onnxruntime_openvino-1.14.0-cp39-cp39-win_amd64.whl.

File metadata

File hashes

Hashes for onnxruntime_openvino-1.14.0-cp39-cp39-win_amd64.whl
Algorithm Hash digest
SHA256 b58d02ec8a9b888b29e50caabcd6483d47126e74ea6b9d31ce030cd5fb2d10d3
MD5 89113da85bdae407f539c57235ed43b4
BLAKE2b-256 8d0e7c6185f61b40ec225c9c5afddacac21b311cf586767d4b8b9b0215fe0881

See more details on using hashes here.

File details

Details for the file onnxruntime_openvino-1.14.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.

File metadata

File hashes

Hashes for onnxruntime_openvino-1.14.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 a4441bb010f2d58ec64df7e3f932a59e9dd8a4f8faa01e1cbcb4e4e496e93b0e
MD5 5e82abe6a3479a0a92bad0b7861da7c9
BLAKE2b-256 3bce3fca77d5a0d6165af89ce08784267ecee7dc2d0a57ce641b1fda2107424e

See more details on using hashes here.

File details

Details for the file onnxruntime_openvino-1.14.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.

File metadata

File hashes

Hashes for onnxruntime_openvino-1.14.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 9af1248522db5dc71b54854d4207975c599e950bdcc416e8e425c173be446daa
MD5 8f718d693c212cec405474724567fdc9
BLAKE2b-256 0411e942b42b074fbbfcb6439a4c1b480ca348057cd2fb19fd4241c0d4bc31cb

See more details on using hashes here.

File details

Details for the file onnxruntime_openvino-1.14.0-cp37-cp37m-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.

File metadata

File hashes

Hashes for onnxruntime_openvino-1.14.0-cp37-cp37m-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 f9cb33584e3c5ead89c4177123cfd9e520504e68b4f9caa7d733fb1ed5c0723b
MD5 c0f53995fee8d35b60602eee33b81319
BLAKE2b-256 5d1b68d3aa0289f6a4715ac2c52f91b310795b29f9a4d54b5874b2a7d75ecb48

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page