Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Added fixes to support chat mode #29051

Merged

Conversation

AsyaPronina
Copy link
Contributor

@AsyaPronina AsyaPronina commented Feb 18, 2025

Details:

  • Reverted reset_state() change (no changes regarding reset_state() is presented here regardless of branch name)
  • Added initialization of tensors in LLMInferRequest
  • Fixed copy of attention_mask

Tickets:

  • ticket-id

@AsyaPronina AsyaPronina requested a review from a team as a code owner February 18, 2025 13:09
@github-actions github-actions bot added the category: inference OpenVINO Runtime library - Inference label Feb 18, 2025
@AsyaPronina AsyaPronina requested review from a team as code owners February 18, 2025 13:32
@github-actions github-actions bot added category: NPU OpenVINO NPU plugin category: NPUW NPUW plugin labels Feb 18, 2025
@AsyaPronina AsyaPronina force-pushed the reset_state_in_infreq_impl branch from 0b492d7 to e62eb43 Compare February 18, 2025 13:33
@AsyaPronina AsyaPronina changed the title Added reset_state API into developer IInferRequest interface Added fixes to support chat mode Feb 18, 2025
@TolyaTalamanov
Copy link
Contributor

@AsyaPronina I've tested w/o f87c748 and it works. Let's revert it and merge!

@AsyaPronina
Copy link
Contributor Author

@AsyaPronina I've tested w/o f87c748 and it works. Let's revert it and merge!

Thank you, sure!

@AsyaPronina AsyaPronina force-pushed the reset_state_in_infreq_impl branch from e62eb43 to 221bc4b Compare February 20, 2025 12:49
@github-actions github-actions bot removed the category: inference OpenVINO Runtime library - Inference label Feb 20, 2025
@TolyaTalamanov TolyaTalamanov added this pull request to the merge queue Feb 20, 2025
Merged via the queue into openvinotoolkit:master with commit 55ac9b3 Feb 20, 2025
164 checks passed
ilya-lavrenov added a commit to openvinotoolkit/openvino.genai that referenced this pull request Feb 21, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
category: NPU OpenVINO NPU plugin category: NPUW NPUW plugin
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants