Polygraphy Trtexec: Extension to run on trtexec backend
Project description
Extending polygraphy run
to support trtexec
Introduction
polygraphy run
allows you to run inference with multiple backends, including TensorRT and ONNX-Runtime, and compare outputs.
This extension adds support to run inference with trtexec
.
Installation
Follow the steps below to install the extension module. After installation, you should see the trtexec
options in the help
output of polygraphy run
:
-
Build using
setup.py
:python3 setup.py bdist_wheel
-
Install the wheel: The wheel is installed in the
dist
directory. Install the wheel by running the following commandpython3 -m pip install dist/polygraphy_trtexec-*.whl \ --extra-index-url https://pypi.ngc.nvidia.com
NOTE: You may have to update the above command to install the appropriate version of the wheel
-
After the installation, you can run it on the trtexec backend by using the
--trtexec
flag as follows:polygraphy run sample.onnx --trtexec
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distributions
Built Distribution
Hashes for polygraphy_trtexec-0.0.7-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 5110f504f02800d91ca185938e501d94d4f4dcfe6e8632f2360a8b1804fc651a |
|
MD5 | b7be1653dee1a4aa176e065de31d75d7 |
|
BLAKE2b-256 | 95ea608d232500f023d0e79529e4910cea0d698a60a745be9ca681b726617046 |