Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update to latest 2021.1 #121

Merged
merged 51 commits into from
Dec 18, 2020
Merged
Show file tree
Hide file tree
Changes from 1 commit
Commits
Show all changes
51 commits
Select commit Hold shift + click to select a range
eec2fd8
[DOCS] [41549] Fix broken code block in Install OpenVINO from PyPI Re…
aalborov Oct 26, 2020
2cf8999
add animation (#2865)
ntyukaev Oct 30, 2020
a081dfe
Align `time_tests` with master branch from 4021e144 (#2881)
vurusovs Oct 30, 2020
a7ab76e
Added info on DockerHub CI Framework (#2919)
andrew-zaytsev Nov 3, 2020
313d889
Feature/azaytsev/cherry pick pr2541 to 2021 1 (#2960)
andrew-zaytsev Nov 3, 2020
14aa83f
See Also sections in MO Guide (#2770)
aalborov Nov 6, 2020
d2dc54f
Fixes (#3105)
aalborov Nov 16, 2020
78f8b6a
Renamed Benchmark App into Benchmark Tool in the menu (#3032)
aalborov Nov 16, 2020
bd3ba38
[DOC] Update Docker install guide (#3055) (#3200)
generalova-kate Nov 18, 2020
38892b2
Align time_tests with master (#3238)
vurusovs Nov 20, 2020
43a6e4c
Fix onnx tests versions (#3240)
rblaczkowski Nov 20, 2020
751ef42
[40929] DL Workbench in Get Started (#2740)
aalborov Nov 20, 2020
57eee6a
Links to DL Workbench Installation Guide (#2861)
aalborov Nov 20, 2020
9d5b200
[41545] Add links to DL Workbench from components that are available …
aalborov Nov 20, 2020
20fd0bc
Feature/azaytsev/change layout (#3295)
andrew-zaytsev Nov 23, 2020
6adaad6
Add several new models to `tgl_test_config.yml` in time_tests (#3269)
vurusovs Nov 24, 2020
f2a3d6b
Fix a typo in DL Workbench Get Started (#3338)
aalborov Nov 25, 2020
f5e2fff
ops math formula fix (#3333)
ntyukaev Nov 30, 2020
bff3381
Fix paths for `squeezenet1.1` in time_tests config (#3416)
vurusovs Nov 30, 2020
6260125
GNA Plugin doc review (#2922)
aalborov Dec 7, 2020
6374d44
Port PlaidML plugin forward to 2021.1 (#32)
tzerrell Oct 19, 2020
35651cd
Enable testing of BatchNorm (#33)
tzerrell Oct 19, 2020
b60f71a
Require specific path to shared library (#34)
Oct 19, 2020
5966062
Fix multiple outputs and add Split (#42)
tzerrell Oct 22, 2020
022e254
Swish (#47)
mwyi Oct 24, 2020
56e9add
Add Reverse & tests to PlaidML Plugin (#35)
tzerrell Oct 26, 2020
ed90660
Make separate PlaidMLProgramBuilder (#92)
tzerrell Oct 30, 2020
9b91499
Variadic Split (#91)
mwyi Nov 2, 2020
e15c466
Add BinaryConvolution (#93)
LiyangLingIntel Nov 3, 2020
4ac5e60
Add working tests back (#97)
cnamrata15 Nov 3, 2020
4e81cc1
Add bucketize op and tests (#90)
XinWangIntel Nov 3, 2020
3454f38
Add extract image patches op (#96)
XingHongChenIntel Nov 4, 2020
4320e6b
Hswish via ReLU (#95)
mwyi Nov 4, 2020
714c4a8
Add reorg_yolo op (#101)
XingHongChenIntel Nov 7, 2020
3f4722f
Remove conv bprop & fake quant tests (#106)
tzerrell Nov 10, 2020
bacee8b
add EmbeddingBagOffsetsSum op and tests (#100)
haoyouab Nov 10, 2020
c6457f9
Add LSTMCell (#102)
LiyangLingIntel Nov 10, 2020
2897093
Add RNNCell (#109)
tzerrell Nov 10, 2020
bace3d8
Add space_to_batch op (#104)
XingHongChenIntel Nov 10, 2020
3326f49
Add tests for MinMax, DepthToSpace (#105)
cnamrata15 Nov 10, 2020
d1f0000
Add GELU (#107)
LiyangLingIntel Nov 10, 2020
b796cd5
Add GRUCell (#110)
tzerrell Nov 10, 2020
cbf3f33
Fix support for using OpenVINO as a subproject (#111)
Nov 11, 2020
83f6ce4
Build fixes for newer compilers (#113)
Nov 11, 2020
b053f8c
add EmbeddingBagPackedSum op and tests (#114)
haoyouab Nov 12, 2020
9146822
Add shuffle_channels op and test. (#112)
XingHongChenIntel Nov 13, 2020
f38d9d9
Tests for squared difference op (#115)
cnamrata15 Nov 13, 2020
3edec51
Add acosh, asinh, atanh into tests (#118)
LiyangLingIntel Dec 3, 2020
11aeeb9
Reverse sequence (#116)
XingHongChenIntel Dec 4, 2020
fa8c54b
Add PriorBox op and test. (#117)
XinWangIntel Dec 4, 2020
249e62f
Remove obsolete PlaidML code (#120)
tzerrell Dec 18, 2020
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
[40929] DL Workbench in Get Started (openvinotoolkit#2740)
* Initial commit

* Added the doc

* More instructions and images

* Added slide

* Borders for screenshots

* fixes

* Fixes

* Added link to Benchmark app

* Replaced the image

* tiny fix

* tiny fix
  • Loading branch information
aalborov authored Nov 20, 2020
commit 751ef424243e5a0783df4796f49565c0a0d0d934
1 change: 1 addition & 0 deletions docs/doxygen/openvino_docs.xml
Original file line number Diff line number Diff line change
Expand Up @@ -37,6 +37,7 @@
<tab type="user" title="Linux" url="@ref openvino_docs_get_started_get_started_linux"/>
<tab type="user" title="Windows" url="@ref openvino_docs_get_started_get_started_windows"/>
<tab type="user" title="macOS" url="@ref openvino_docs_get_started_get_started_macos"/>
<tab type="user" title="Get Started with OpenVINO via DL Workbench" url="@ref openvino_docs_get_started_get_started_dl_workbench"/>
<tab type="user" title="Legal Information" url="@ref openvino_docs_Legal_Information"/>
</tab>
<!-- Configuration for Hardware -->
Expand Down
3 changes: 3 additions & 0 deletions docs/get_started/dl_workbench_img/DL_Workbench.jpg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
3 changes: 3 additions & 0 deletions docs/get_started/dl_workbench_img/Get_Started_Page-b.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
3 changes: 3 additions & 0 deletions docs/get_started/dl_workbench_img/convert_model.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
3 changes: 3 additions & 0 deletions docs/get_started/dl_workbench_img/create_configuration.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
3 changes: 3 additions & 0 deletions docs/get_started/dl_workbench_img/dataset_loading.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
3 changes: 3 additions & 0 deletions docs/get_started/dl_workbench_img/generate_dataset.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
3 changes: 3 additions & 0 deletions docs/get_started/dl_workbench_img/import_model_01.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
3 changes: 3 additions & 0 deletions docs/get_started/dl_workbench_img/import_model_02.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
3 changes: 3 additions & 0 deletions docs/get_started/dl_workbench_img/inference_banner.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
3 changes: 3 additions & 0 deletions docs/get_started/dl_workbench_img/inference_complete.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
3 changes: 3 additions & 0 deletions docs/get_started/dl_workbench_img/model_loading.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
3 changes: 3 additions & 0 deletions docs/get_started/dl_workbench_img/selected.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
3 changes: 3 additions & 0 deletions docs/get_started/dl_workbench_img/validation_dataset.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
140 changes: 140 additions & 0 deletions docs/get_started/get_started_dl_workbench.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,140 @@
# Get Started with OpenVINO™ Toolkit via Deep Learninig Workbench {#openvino_docs_get_started_get_started_dl_workbench}

The OpenVINO™ toolkit optimizes and runs Deep Learning Neural Network models on Intel® hardware. This guide helps you get started with the OpenVINO™ toolkit via the Deep Learning Workbench (DL Workbench) on Linux\*, Windows\*, or macOS\*.

In this guide, you will:
* Learn the OpenVINO™ inference workflow.
* Start DL Workbench on Linux. Links to instructions for other operating systems are provided as well.
* Create a project and run a baseline inference.

[DL Workbench](@ref workbench_docs_Workbench_DG_Introduction) is a web-based graphical environment that enables you to easily use various sophisticated
OpenVINO™ toolkit components:
* [Model Downloader](@ref omz_tools_downloader_README) to download models from the [Intel® Open Model Zoo](@ref omz_models_intel_index)
with pretrained models for a range of different tasks
* [Model Optimizer](../MO_DG/Deep_Learning_Model_Optimizer_DevGuide.md) to transform models into
the Intermediate Representation (IR) format
* [Post-Training Optimization toolkit](@ref pot_README) to calibrate a model and then execute it in the
INT8 precision
* [Accuracy Checker](@ref omz_tools_accuracy_checker_README) to determine the accuracy of a model
* [Benchmark Tool](@ref openvino_inference_engine_samples_benchmark_app_README) to estimate inference performance on supported devices

![](./dl_workbench_img/DL_Workbench.jpg)

DL Workbench supports the following scenarios:
1. [Calibrate the model in INT8 precision](@ref workbench_docs_Workbench_DG_Int_8_Quantization)
2. [Find the best combination](@ref workbench_docs_Workbench_DG_View_Inference_Results) of inference parameters: [number of streams and batches](../optimization_guide/dldt_optimization_guide.md)
3. [Analyze inference results](@ref workbench_docs_Workbench_DG_Visualize_Model) and [compare them across different configurations](@ref workbench_docs_Workbench_DG_Compare_Performance_between_Two_Versions_of_Models)
4. [Implement an optimal configuration into your application](@ref workbench_docs_Workbench_DG_Deploy_and_Integrate_Performance_Criteria_into_Application)

## Prerequisites

Prerequisite | Linux* | Windows* | macOS*
:----- | :----- |:----- |:-----
Operating system|Ubuntu\* 18.04. Other Linux distributions, such as Ubuntu\* 16.04 and CentOS\* 7, are not validated.|Windows\* 10 | macOS\* 10.15 Catalina
CPU | Intel® Core™ i5| Intel® Core™ i5 | Intel® Core™ i5
GPU| Intel® Pentium® processor N4200/5 with Intel® HD Graphics | Not supported| Not supported
HDDL, Myriad| Intel® Neural Compute Stick 2 <br> Intel® Vision Accelerator Design with Intel® Movidius™ VPUs| Not supported | Not supported
Available RAM space| 4 GB| 4 GB| 4 GB
Available storage space | 8 GB + space for imported artifacts| 8 GB + space for imported artifacts| 8 GB + space for imported artifacts
Docker\*| Docker CE 18.06.1 | Docker Desktop 2.1.0.1|Docker CE 18.06.1
Web browser| Google Chrome\* 76 <br> Browsers like Mozilla Firefox\* 71 or Apple Safari\* 12 are not validated. <br> Microsoft Internet Explorer\* is not supported.| Google Chrome\* 76 <br> Browsers like Mozilla Firefox\* 71 or Apple Safari\* 12 are not validated. <br> Microsoft Internet Explorer\* is not supported.| Google Chrome\* 76 <br>Browsers like Mozilla Firefox\* 71 or Apple Safari\* 12 are not validated. <br> Microsoft Internet Explorer\* is not supported.
Resolution| 1440 x 890|1440 x 890|1440 x 890
Internet|Optional|Optional|Optional
Installation method| From Docker Hub <br> From OpenVINO™ toolkit package|From Docker Hub|From Docker Hub

## Start DL Workbench

This section provides instructions to run the DL Workbench on Linux from Docker Hub.

Use the command below to pull the latest Docker image with the application and run it:

```bash
wget https://raw.githubusercontent.com/openvinotoolkit/workbench_aux/master/start_workbench.sh && bash start_workbench.sh
```
DL Workbench uses [authentication tokens](@ref workbench_docs_Workbench_DG_Authentication) to access the application. A token
is generated automatically and displayed in the console output when you run the container for the first time. Once the command is executed, follow the link with the token. The **Get Started** page opens:
![](./dl_workbench_img/Get_Started_Page-b.png)

For details and more installation options, visit the links below:
* [Install DL Workbench from Docker Hub* on Linux* OS](@ref workbench_docs_Workbench_DG_Install_from_DockerHub_Linux)
* [Install DL Workbench from Docker Hub on Windows*](@ref workbench_docs_Workbench_DG_Install_from_Docker_Hub_Win)
* [Install DL Workbench from Docker Hub on macOS*](@ref workbench_docs_Workbench_DG_Install_from_Docker_Hub_mac)
* [Install DL Workbench from the OpenVINO toolkit package on Linux](@ref workbench_docs_Workbench_DG_Install_from_Package)

## <a name="workflow-overview"></a>OpenVINO™ DL Workbench Workflow Overview

The simplified OpenVINO™ DL Workbench workflow is:
1. **Get a trained model** for your inference task. Example inference tasks: pedestrian detection, face detection, vehicle detection, license plate recognition, head pose.
2. **Run the trained model through the Model Optimizer** to convert the model to an Intermediate Representation, which consists of a pair of `.xml` and `.bin` files that are used as the input for Inference Engine.
3. **Run inference against the Intermediate Representation** (optimized model) and output inference results.

## Run Baseline Inference

This section illustrates a sample use case of how to infer a pretrained model from the [Intel® Open Model Zoo](@ref omz_models_intel_index) with an autogenerated noise dataset on a CPU device.

<iframe width="560" height="315" src="https://www.youtube.com/embed/9TRJwEmY0K4" frameborder="0" allow="accelerometer; autoplay; encrypted-media; gyroscope; picture-in-picture" allowfullscreen></iframe>


Once you log in to the DL Workbench, create a project, which is a combination of a model, a dataset, and a target device. Follow the steps below:

### Step 1. Open a New Project

On the the **Active Projects** page, click **Create** to open the **Create Project** page:
![](./dl_workbench_img/create_configuration.png)

### Step 2. Choose a Pretrained Model

Click **Import** next to the **Model** table on the **Create Project** page. The **Import Model** page opens. Select the squeezenet1.1 model from the Open Model Zoo and click **Import**.
![](./dl_workbench_img/import_model_02.png)

### Step 3. Convert the Model into Intermediate Representation

The **Convert Model to IR** tab opens. Keep the FP16 precision and click **Convert**.
![](./dl_workbench_img/convert_model.png)

You are directed back to the **Create Project** page where you can see the status of the chosen model.
![](./dl_workbench_img/model_loading.png)

### Step 4. Generate a Noise Dataset

Scroll down to the **Validation Dataset** table. Click **Generate** next to the table heading.
![](./dl_workbench_img/validation_dataset.png)

The **Autogenerate Dataset** page opens. Click **Generate**.
![](./dl_workbench_img/generate_dataset.png)

You are directed back to the **Create Project** page where you can see the status of the dataset.
![](./dl_workbench_img/dataset_loading.png)

### Step 5. Create the Project and Run a Baseline Inference

On the **Create Project** page, select the imported model, CPU target, and the generated dataset. Click **Create**.
![](./dl_workbench_img/selected.png)

The inference starts and you cannot proceed until it is done.
![](./dl_workbench_img/inference_banner.png)

Once the inference is complete, the **Projects** page opens automatically. Find your inference job in the **Projects Settings** table indicating all jobs.
![](./dl_workbench_img/inference_complete.png)

Congratulations, you have performed your first inference in the OpenVINO DL Workbench. Now you can proceed to:
* [Select the inference](@ref workbench_docs_Workbench_DG_Run_Single_Inference)
* [Visualize statistics](@ref workbench_docs_Workbench_DG_Visualize_Model)
* [Experiment with model optimization](@ref workbench_docs_Workbench_DG_Int_8_Quantization)
and inference options to profile the configuration

For detailed instructions to create a new project, visit the links below:
* [Select a model](@ref workbench_docs_Workbench_DG_Select_Model)
* [Select a dataset](@ref workbench_docs_Workbench_DG_Select_Datasets)
* [Select a target and an environment](@ref workbench_docs_Workbench_DG_Select_Environment). This can be your local workstation or a remote target. If you use a remote target, [register the remote machine](@ref workbench_docs_Workbench_DG_Add_Remote_Target) first.

## Additional Resources

* [OpenVINO™ Release Notes](https://software.intel.com/en-us/articles/OpenVINO-RelNotes)
* [OpenVINO™ Toolkit Overview](../index.md)
* [DL Workbench Installation Guide](@ref workbench_docs_Workbench_DG_Install_Workbench)
* [Inference Engine Developer Guide](../IE_DG/Deep_Learning_Inference_Engine_DevGuide.md)
* [Model Optimizer Developer Guide](../MO_DG/Deep_Learning_Model_Optimizer_DevGuide.md)
* [Inference Engine Samples Overview](../IE_DG/Samples_Overview.md)
* [Overview of OpenVINO™ Toolkit Pre-Trained Models](https://software.intel.com/en-us/openvino-toolkit/documentation/pretrained-models)
* [OpenVINO™ Hello World Face Detection Exercise](https://github.com/intel-iot-devkit/inference-tutorials-generic)