Openvino Tools
Project description
Intel® Distribution of OpenVINO™ Toolkit Developer Package
Copyright © 2018-2021 Intel Corporation
LEGAL NOTICE: Your use of this software and any required dependent software (the “Software Package”) is subject to the terms and conditions of the software license agreements for the Software Package, which may also include notices, disclaimers, or license terms for third party or open source software included in or with the Software Package, and your use indicates your acceptance of all such terms. Please refer to the “third-party-programs.txt” or other similarly-named text file included with the Software Package for additional details.
Intel is committed to the respect of human rights and avoiding complicity in human rights abuses, a policy reflected in the Intel Global Human Rights Principles. Accordingly, by accessing the Intel material on this platform you agree that you will not use the material in a product or application that causes or contributes to a violation of an internationally recognized human right.
Introduction
OpenVINO™ toolkit is a comprehensive toolkit for quickly developing applications and solutions that solve a variety of tasks including emulation of human vision, automatic speech recognition, natural language processing, recommendation systems, and many others. Based on latest generations of artificial neural networks, including Convolutional Neural Networks (CNNs), recurrent and attention-based networks, the toolkit extends computer vision and non-vision workloads across Intel® hardware, maximizing performance. It accelerates applications with high-performance, AI and deep learning inference deployed from edge to cloud.
The developer package includes the following components installed by default:
| Component | Console Script | Description |
|---|---|---|
| Model Optimizer | mo |
Model Optimizer imports, converts, and optimizes models that were trained in popular frameworks to a format usable by Intel tools, especially the Inference Engine. Popular frameworks include Caffe*, TensorFlow*, MXNet*, and ONNX*. |
| Benchmark Tool | benchmark_app |
Benchmark Application allows you to estimate deep learning inference performance on supported devices for synchronous and asynchronous modes. |
| Accuracy Checker and Annotation Converter |
accuracy_check convert_annotation |
Accuracy Checker is a deep learning accuracy validation tool that allows you to collect accuracy metrics against popular datasets. The main advantages of the tool are the flexibility of configuration and an impressive set of supported datasets, preprocessing, postprocessing, and metrics. Annotation Converter is a utility for offline conversion of datasets to the format suitable for metric evaluation used in Accuracy Checker. |
| Post-Training Optimization Tool | pot |
Post-Training Optimization Tool allows you to optimize trained models with advanced capabilities, such as quantization and low-precision optimizations, without the need to retrain or fine-tune models. Optimizations are also available through the API. |
| Model Downloader and other Open Model Zoo tools | omz_downloader omz_converter omz_quantizer omz_info_dumper |
Model Downloader is a tool for getting access to the collection of high-quality and extremely fast pre-trained deep learning public and intel-trained models. Use these free pre-trained models instead of training your own models to speed up the development and production deployment process. The principle of the tool is as follows: it downloads model files from online sources and, if necessary, patches them with Model Optimizer to make them more usable. A number of additional tools are also provided to automate the process of working with downloaded models: Model Converter is a tool for converting the models stored in a format other than the Intermediate Representation (IR) into that format using Model Optimizer. Model Quantizer is a tool for automatic quantization of full-precision IR models into low-precision versions using Post-Training Optimization Tool. Model Information Dumper is a helper utility for dumping information about the models in a stable machine-readable format. |
Developer package also provides the runtime package installed as a dependency. The runtime package includes the following components:
| Component | Description |
|---|---|
| Inference Engine | This is the engine that runs the deep learning model. It includes a set of libraries for an easy inference integration into your applications. |
System Requirements
The complete list of supported hardware is available in the Release Notes.
The table below lists the supported operating systems and Python* versions required to run the installation.
| Supported Operating System | Python* Version (64-bit) |
|---|---|
| Ubuntu* 18.04 long-term support (LTS), 64-bit | 3.6, 3.7, 3.8 |
| Ubuntu* 20.04 long-term support (LTS), 64-bit | 3.6, 3.7, 3.8 |
| Red Hat* Enterprise Linux* 8, 64-bit | 3.6, 3.8 |
| CentOS* 7, 64-bit | 3.6, 3.7, 3.8 |
| macOS* 10.15.x versions | 3.6, 3.7, 3.8 |
| Windows 10*, 64-bit | 3.6, 3.7, 3.8 |
NOTE: This package can be installed on other versions of macOS, Linux and Windows, but only the specific versions above are fully validated.
Install the Developer Package
Step 1. Set Up Python Virtual Environment
To avoid dependency conflicts, use a virtual environment. Skip this step only if you do want to install all dependencies globally.
Create virtual environment:
On Linux and macOS:
# Depending on your OS, this step may require installing python3-venv
python3 -m venv openvino_env
On Windows:
python -m venv openvino_env
Step 2. Activate Virtual Environment
On Linux and macOS:
source openvino_env/bin/activate
On Windows:
openvino_env\Scripts\activate
Step 3. Set Up and Update PIP to the Highest Version
Run the command below:
python -m pip install --upgrade pip
Step 4. Install the Package
To install and configure the components of the development package for working with specific frameworks, use the pip install openvino-dev[extras] command, where extras is a list of extras from the table below:
| DL Framework | Extra |
|---|---|
| Caffe* | caffe |
| Caffe2* | caffe2 |
| Kaldi* | kaldi |
| MXNet* | mxnet |
| ONNX* | onnx |
| PyTorch* | pytorch |
| TensorFlow* 1.x | tensorflow |
| TensorFlow* 2.x | tensorflow2 |
For example, to install and configure the components for working with TensorFlow 2.x, MXNet and Caffe, use the following command:
pip install openvino-dev[tensorflow2,mxnet,caffe]
Step 5. Verify that the Package Is Installed
-
To verify that the developer package is properly installed, run the command below (this may take a few seconds):
mo -hYou will see the help message for Model Optimizer if installation finished successfully.
-
To verify that Inference Engine from the runtime package is available, run the command below:
python -c "from openvino.inference_engine import IECore"
You will not see any error messages if installation finished successfully.
Troubleshooting
Error: Microsoft Visual C++ 14.0 is required. Get it with "Build Tools for Visual Studio"
On Windows* some dependencies may require compilation from source when installing. To resolve this issue, you need to install Build Tools for Visual Studio* 2019 and repeat package installation.
ImportError: libpython3.7m.so.1.0: cannot open shared object file: No such file or directory
To resolve missing external dependency on Ubuntu* 18.04, execute the following command:
sudo apt-get install libpython3.7
Additional Resources
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distributions
Built Distribution
File details
Details for the file openvino_dev-2021.4.0-3839-py3-none-any.whl.
File metadata
- Download URL: openvino_dev-2021.4.0-3839-py3-none-any.whl
- Upload date:
- Size: 6.2 MB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/3.4.1 importlib_metadata/4.6.0 pkginfo/1.7.0 requests/2.25.1 requests-toolbelt/0.9.1 tqdm/4.61.1 CPython/3.7.9
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | bc84439338134eb7f5da647063eb9fd879b1b254a02463c7eacf90fae9d595f2 |
|
| MD5 | c7526787020535d0e90ccdcd67a5b8cf |
|
| BLAKE2b-256 | 0075a567cbec787eec62f5441bbcd38b7eb9f60e107d991dc80c7b15778b02e5 |
