Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

ci: Fix L0_infer--base #7904

Merged
merged 6 commits into from
Jan 3, 2025
Merged

ci: Fix L0_infer--base #7904

merged 6 commits into from
Jan 3, 2025

Conversation

yinggeh
Copy link
Contributor

@yinggeh yinggeh commented Dec 24, 2024

What does the PR do?

  • Update OpenVINO model version
  • Fix model loading issue seen in OpenVINO new API. Set names for model output tensors explicitly as a workaround to this issue.
| openvino_float32_float32_float32                    | 1       | UNAVAILABLE: Internal: ModelInstanceState::Create ov::Exception: Exception from src/core/src/descriptor/tensor.cpp:84: |
|                                                     |         | Attempt to get a name for a Tensor without names                                                                       |

Checklist

  • PR title reflects the change and is of format <commit_type>: <Title>
  • Changes are described in the pull request.
  • Related issues are referenced.
  • Populated github labels field
  • Added test plan and verified test passes.
  • Verified that the PR passes existing CI.
  • Verified copyright is correct on all changed files.
  • Added succinct git squash message before merging ref.
  • All template sections are filled out.
  • Optional: Additional screenshots for behavior/output changes with before/after.

Commit Type:

Check the conventional commit type
box here and add the label to the github PR.

  • ci

Related PRs:

Where should the reviewer start?

Test plan:

  • L0_infer--base

  • L0_infer_cudashm--base

  • L0_infer_reshape--base

  • L0_infer_shm--base

  • L0_infer_valgrind--base

  • L0_infer--compose-cpu-only-onnx-openvino-python--base

  • CI Pipeline ID:
    22052854

Caveats:

Background

Initially we were on 2024.05.0 and CI jobs were broken with errors "Attempt to get a name for a Tensor without names". We temporarily rollbacked the versions in 47971dd and da9b153.

OpenVINO team provides a WA for this error (triton-inference-server/openvino_backend#89). I verified locally it works. So I am bumping up the versions to 2024.05.0 again.

Related Issues: (use one of the action keywords Closes / Fixes / Resolves / Relates to)

@yinggeh yinggeh added the PR: ci Changes to our CI configuration files and scripts label Dec 24, 2024
@yinggeh yinggeh requested a review from oandreeva-nv December 24, 2024 00:35
@yinggeh yinggeh self-assigned this Dec 24, 2024
@yinggeh yinggeh requested a review from mc-nv December 24, 2024 00:36
mc-nv
mc-nv previously approved these changes Dec 24, 2024
@yinggeh yinggeh merged commit 48be9ce into main Jan 3, 2025
3 checks passed
@yinggeh yinggeh deleted the yinggeh-DLIS-7722-fix-L0-infer branch January 3, 2025 22:23
@yinggeh yinggeh restored the yinggeh-DLIS-7722-fix-L0-infer branch January 14, 2025 21:35
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
PR: ci Changes to our CI configuration files and scripts
Development

Successfully merging this pull request may close these issues.

2 participants