Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[DO NOT MERGE] [NPU] Using global command queue #28661

Open
wants to merge 13 commits into
base: master
Choose a base branch
from
Open

[DO NOT MERGE] [NPU] Using global command queue #28661

wants to merge 13 commits into from
+571 −163

Conversation

pereanub
Copy link
Contributor

@pereanub pereanub commented Jan 24, 2025 •
edited
Loading

Details:

  • Using a global command queue per core and not creating different queues for each compiled model. The plugin will create a different queue only if the properties for using them are different from a compiled model to another or if the properties(workload type) are changing at runtime

Tickets:

  • E#154336

@pereanub pereanub requested review from a team as code owners January 24, 2025 12:07
@github-actions github-actions bot added the category: NPU OpenVINO NPU plugin label Jan 24, 2025
@pereanub pereanub force-pushed the global_command_queue branch 7 times, most recently from 87a8043 to 21a6985 Compare January 27, 2025 13:46
@pereanub pereanub force-pushed the global_command_queue branch 3 times, most recently from 5eae256 to b4a4c54 Compare January 29, 2025 12:19
pereanub added 10 commits January 29, 2025 17:30
@pereanub
Use global command queues
6b71807 
Signed-off-by: Bogdan Pereanu <[email protected]>
@pereanub
Adding test case
629f02f 
Signed-off-by: Bogdan Pereanu <[email protected]>
@pereanub
Destroy pipeline if it was created but workload type is not supported
458de27 
Signed-off-by: Bogdan Pereanu <[email protected]>
@pereanub
Update tests, command queue is created and set at the first infer
f7c0aa2 
Signed-off-by: Bogdan Pereanu <[email protected]>
@pereanub
Update the names of the variables, methods, classes
619016b 
Signed-off-by: Bogdan Pereanu <[email protected]>
@pereanub
Create a static instance for CommandQueueManager class and lock get a…
3cbf804 
…nd free methods

Signed-off-by: Bogdan Pereanu <[email protected]>
@pereanub
Add new func test
d9002d0 
Signed-off-by: Bogdan Pereanu <[email protected]>
@pereanub
Print correct error message
20e261c 
Signed-off-by: Bogdan Pereanu <[email protected]>
@pereanub
Run test only on newer drivers
f20f391 
Signed-off-by: Bogdan Pereanu <[email protected]>
@pereanub
Create event pool and events only if they are used
4ad0028 
Signed-off-by: Bogdan Pereanu <[email protected]>
@pereanub pereanub force-pushed the global_command_queue branch from 17cb356 to 3d28ec1 Compare January 29, 2025 15:31
@pereanub pereanub force-pushed the global_command_queue branch from 3d28ec1 to 135da9a Compare January 29, 2025 15:47
@pereanub pereanub force-pushed the global_command_queue branch from 484873c to 9c9cc88 Compare January 30, 2025 06:55
@pereanub pereanub mentioned this pull request Jan 30, 2025
Open
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
category: NPU OpenVINO NPU plugin do not merge
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@pereanub