Skip to content

OpenVINO EP v4.0 Release for ONNX Runtime 1.11.0 & OpenVINO 2022.1
Compare
Choose a tag to compare
@MaajidKhan MaajidKhan released this 10 Apr 06:04
· 5764 commits to master since this release
v4.0
1aca080

Description:
OpenVINO™ Execution Provider For ONNXRuntime v4.0 Release based on the latest OpenVINO™ 2022.1 Release.

For all the latest information, Refer to our official documentation:
https://onnxruntime.ai/docs/execution-providers/OpenVINO-ExecutionProvider.html

Announcements:

  • OpenVINO™ version upgraded to 2022.1.0 - biggest OpenVINO™ upgrade in 3.5 years. This provides functional bug fixes, API Change 2.0 and capability changes from the previous 2021.4.2 LTS release.
  • This release supports ONNXRuntime v1.11.0 Release with the latest OpenVINO™ 2022.1 release.
  • Performance Optimizations of existing supported models.
  • Updated to use the new OpenVINO™ 2.0 API's starting from this release.
  • Backward compatibility support for older OpenVINO™ versions (OV 2021.3, OV 2021.4) is available.
  • New code design changes introduced to have cleaner code structure for different OpenVINO™ versions.
  • Opset 13 compliance w.r.t OpenVINO™ (More operators added)

New features added:
OpenCL Throttling: CPU optimization using cl_throttle – Reduced CPU utilizations when iGPU path is enabled.
Device Type checks: checks if the application's runtime device type is available in the host machine.

Build steps:
Please refer to the OpenVINO™ Execution Provider For ONNXRuntime build instructions for information on system pre-requisites as well as instructions to build from source.
https://onnxruntime.ai/docs/build/eps.html#openvino

Samples:
https://github.com/microsoft/onnxruntime-inference-examples

Python Wheel Packages:
Please download onnxruntime-openvino python packages from PyPi.org.

pip install onnxruntime-openvino==1.11.0

Linux Wheel Packages come with prebuilt OpenVINO™ libs enabled with ABI 0 .
For Windows Samples please install and add OpenVINO™ libs to path.

pip install openvino

import openvino.utils as utils
utils.add_openvino_libs_to_path()

Docker Image:
The latest OpenVINO™ Execution Provider For ONNXRuntime Docker image can be downloaded from DockerHub.
https://hub.docker.com/r/openvino/onnxruntime_ep_ubuntu18

Nuget Package
The latest OpenVINO™ Execution Provider For ONNXRuntime nuget packages for both Linux and Windows OS can be downloaded from the assets section below.

ONNXRuntime APIs usage:
Please refer to the link below for Python/C++ APIs:
https://onnxruntime.ai/docs/execution-providers/OpenVINO-ExecutionProvider.html#configuration-options

Note:
This release has few failing python tests which would be fixed in the next release.

Assets 7
Loading