The Holoscan SDK: building high-performance AI streaming applications
Project description
Holoscan SDK
The Holoscan SDK Python Wheel is part of NVIDIA Holoscan, the AI sensor processing platform that combines hardware systems for low-latency sensor and network connectivity, optimized libraries for data processing and AI, and core microservices to run streaming, imaging, and other applications, from embedded to edge to cloud. It can be used to build streaming AI pipelines for a variety of domains, including Medical Devices, High Performance Computing at the Edge, Industrial Inspection and more.
Visit the NGC demo website for a live demonstration of some of Holoscan capabilities.
System Requirements
- CPU: x86_64 or aarch64 (arm64)
- OS: Ubuntu 20.04
- NVIDIA GPU
- Ampere or above recommended for best performance
- Quadro/NVIDIA RTX necessary for GPUDirect RDMA support
- Tested with NVIDIA RTX 6000 and NVIDIA RTX A6000
- NVIDIA dGPU drivers: 510.73.08+
- TensorRT: 8.2.3+
- CUDA Toolkit: 11.6.1+
- For Rivermax support (optional):
- NVIDIA ConnectX SmartNIC
- OFED Network Drivers: 5.8
- GPUDirect Drivers: 1.1
- Rivermax SDK: 1.20 (for local development only)
Troubleshooting
ERROR gxf/std/extension_loader.cpp@114: Failed to load extension ... Error: /lib/x86_64-linux-gnu/libm.so.6: version `GLIBC_2.29' not found
The current version of the wheels were built and tested on Ubuntu 20.04 with libc 2.31 instead of manylinux
. They were named as such to make them available early on PyPI. You'll need to use a system with a more recent version of libc to use the Holoscan SDK python wheels.
ERROR gxf/std/extension_loader.cpp@114: Failed to load extension ... Error: libnvonnxparser.so.8: cannot open shared object file: No such file or directory
TensorRT is missing from your system. Follow links in the section above to install TensorRT, or install it through the python wheels which will also install cuda-runtime:
python3 -m pip install nvidia-tensorrt==8.2.3.0 --index https://pypi.ngc.nvidia.com
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distributions
Built Distributions
File details
Details for the file holoscan-0.4.1-cp311-cp311-manylinux2014_x86_64.whl
.
File metadata
- Download URL: holoscan-0.4.1-cp311-cp311-manylinux2014_x86_64.whl
- Upload date:
- Size: 24.7 MB
- Tags: CPython 3.11
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/4.0.1 CPython/3.8.10
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | f4b8026ff2d88080e342174ba79e483fcfd8e568112f960f5807e9148c9ba761 |
|
MD5 | 7c548d6f737eaa076d77772216d6ecd6 |
|
BLAKE2b-256 | d9b96f1749919be038fa2831caff8ce6b3503a0eb58bcd8373465672a52ad114 |
File details
Details for the file holoscan-0.4.1-cp311-cp311-manylinux2014_aarch64.whl
.
File metadata
- Download URL: holoscan-0.4.1-cp311-cp311-manylinux2014_aarch64.whl
- Upload date:
- Size: 22.7 MB
- Tags: CPython 3.11
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/4.0.1 CPython/3.8.10
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 146854023a9dc2e42f9acbead6d909d12028c62b286dbdebe6f64d62abaa02cc |
|
MD5 | 1f9d148b2e3ada890b68e0155cd9ec6b |
|
BLAKE2b-256 | c5633b54fa1a129c8a99d0f9bdac6d70aee7cd436905ad79405d956d0bddeb73 |
File details
Details for the file holoscan-0.4.1-cp310-cp310-manylinux2014_x86_64.whl
.
File metadata
- Download URL: holoscan-0.4.1-cp310-cp310-manylinux2014_x86_64.whl
- Upload date:
- Size: 24.7 MB
- Tags: CPython 3.10
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/4.0.1 CPython/3.8.10
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 8aa573a10dd77209e2d8efad49e0b9e5bb5bd0e86544d0942a26eac16b537dcd |
|
MD5 | 2e90fa94f13a7d4b1a169c49841d3c6a |
|
BLAKE2b-256 | 70d606efa60d8f12fec6cc1d6646974d2b31fd6c7511ffd438a98dee37e9315f |
File details
Details for the file holoscan-0.4.1-cp310-cp310-manylinux2014_aarch64.whl
.
File metadata
- Download URL: holoscan-0.4.1-cp310-cp310-manylinux2014_aarch64.whl
- Upload date:
- Size: 22.7 MB
- Tags: CPython 3.10
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/4.0.1 CPython/3.8.10
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 94c78132ce1f14a5f1860d6f9c24da55d73beb48322784636c4fd2fe472c603c |
|
MD5 | ab0af781afcfc0f5382ed2596e858e68 |
|
BLAKE2b-256 | a276880d1ac2ce67abf3bd13b0c0b6efbf7340bf17a407b949d898f6e676a809 |
File details
Details for the file holoscan-0.4.1-cp39-cp39-manylinux2014_x86_64.whl
.
File metadata
- Download URL: holoscan-0.4.1-cp39-cp39-manylinux2014_x86_64.whl
- Upload date:
- Size: 24.7 MB
- Tags: CPython 3.9
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/4.0.1 CPython/3.8.10
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 40a6b2976aa8857afa3b73c1f35d00443a4dd46671ca0ee39b3b838ee5d80f2e |
|
MD5 | aae5018897c34be9ba322d5f27bfb0ae |
|
BLAKE2b-256 | d1b5427ba9f6dbe7dc5ab5dd96dfe87c90dab754891c8743d5fccd5ac1df468e |
File details
Details for the file holoscan-0.4.1-cp39-cp39-manylinux2014_aarch64.whl
.
File metadata
- Download URL: holoscan-0.4.1-cp39-cp39-manylinux2014_aarch64.whl
- Upload date:
- Size: 22.7 MB
- Tags: CPython 3.9
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/4.0.1 CPython/3.8.10
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | d6fa6deb53eab9858043451c28e0f9cd3772c293334ae1dd341cd62ff634094c |
|
MD5 | 8f458fd8028ab45d0a4bf9415227bcab |
|
BLAKE2b-256 | d90e3689f62f2dc7c3094f43fd38d25bdf2d09cc04d30de4920c9eabadd686eb |
File details
Details for the file holoscan-0.4.1-cp38-cp38-manylinux2014_x86_64.whl
.
File metadata
- Download URL: holoscan-0.4.1-cp38-cp38-manylinux2014_x86_64.whl
- Upload date:
- Size: 24.7 MB
- Tags: CPython 3.8
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/4.0.1 CPython/3.8.10
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 8a1457fd21c21ca0484463f3a14e32861c9573f052910a6258492417f44eb27f |
|
MD5 | 4da06cdbaca72f36d27312b292e9ba7f |
|
BLAKE2b-256 | 685116bb7a97a33722d9e72d27bc8553148000d90388e43bb86a3bd2082212c9 |
File details
Details for the file holoscan-0.4.1-cp38-cp38-manylinux2014_aarch64.whl
.
File metadata
- Download URL: holoscan-0.4.1-cp38-cp38-manylinux2014_aarch64.whl
- Upload date:
- Size: 22.7 MB
- Tags: CPython 3.8
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/4.0.1 CPython/3.8.10
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 0dfdf2ce7fdfc90a8b2eb279936e936c769aa05985477259dc9973a662e3aa24 |
|
MD5 | 5859a21dd778e8c01bf482a5f21de94e |
|
BLAKE2b-256 | 97bcf16fef8a63b68adc097e7de93a976c5d83f0739aada56279ec25fa60b0d5 |