Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Auto plugin async infer request implementation #5707

Merged
merged 2 commits into from
May 20, 2021
Merged

Auto plugin async infer request implementation #5707

merged 2 commits into from
May 20, 2021

Conversation

mashoujiang
Copy link
Contributor

Details:

  • Auto plugin async infer request implementation

Tickets:

  • 55559

@myshevts @mashoujiang
Async auto-request, now with revamped SetCallback (after openvinotool…
afb9b9a 
…kit#5645 merged) it is safe to set.

Also test modification to verify that the callback is called on the same (user's) request and e.g. not on the actual device's request
@mashoujiang mashoujiang requested review from a team, myshevts and ilya-lavrenov May 20, 2021 06:21
@openvino-pushbot openvino-pushbot added category: inference OpenVINO Runtime library - Inference category: IE Tests OpenVINO Test: plugins and common labels May 20, 2021
@ilya-lavrenov ilya-lavrenov added this to the 2021.4 milestone May 20, 2021
@myshevts myshevts enabled auto-merge (squash) May 20, 2021 09:15
@myshevts myshevts merged commit 370617d into openvinotoolkit:master May 20, 2021
@mashoujiang mashoujiang deleted the msj/auto_async branch May 20, 2021 12:21
yekruglov pushed a commit to yekruglov/openvino that referenced this pull request Jun 7, 2021
@mashoujiang @myshevts @yekruglov
Auto plugin async infer request implementation (openvinotoolkit#5707)
73ca3da 
* Async auto-request, now with revamped SetCallback (after openvinotoolkit#5645 merged) it is safe to set.
Also test modification to verify that the callback is called on the same (user's) request and e.g. not on the actual device's request

* Override CreateInferRequestImpl() instead of CreateInferRequest()

Signed-off-by: Shoujiang Ma <[email protected]>

Co-authored-by: myshevts <[email protected]>
rnugmanx pushed a commit to rnugmanx/openvino that referenced this pull request Aug 26, 2021
@mashoujiang @myshevts
Auto plugin async infer request implementation (openvinotoolkit#5707)
0d80eab 
* Async auto-request, now with revamped SetCallback (after openvinotoolkit#5645 merged) it is safe to set.
Also test modification to verify that the callback is called on the same (user's) request and e.g. not on the actual device's request

* Override CreateInferRequestImpl() instead of CreateInferRequest()

Signed-off-by: Shoujiang Ma <[email protected]>

Co-authored-by: myshevts <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@ilya-lavrenov ilya-lavrenov ilya-lavrenov approved these changes

@myshevts myshevts myshevts approved these changes

Assignees
No one assigned
Labels
category: IE Tests OpenVINO Test: plugins and common category: inference OpenVINO Runtime library - Inference
Projects
None yet
Milestone
2021.4
Development

Successfully merging this pull request may close these issues.
4 participants
@mashoujiang @ilya-lavrenov @myshevts @openvino-pushbot