Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[TESTS] WhoWhatBench version update #3241

Open
wants to merge 13 commits into
base: develop
Choose a base branch
from
Open

[TESTS] WhoWhatBench version update #3241

wants to merge 13 commits into from
+61 −65

Conversation

kshpv
Copy link
Collaborator

@kshpv kshpv commented Feb 3, 2025

Changes

Update whowhatbench version to the latest from GenAI

Reason for changes

To use the latest features from whowhatbench

@github-actions github-actions bot added the NNCF PTQ Pull requests that updates NNCF PTQ label Feb 3, 2025
@github-actions github-actions bot added the documentation Improvements or additions to documentation label Feb 4, 2025
@kshpv
Copy link
Collaborator Author

kshpv commented Feb 4, 2025 •
edited
Loading

WC job - https://github.com/openvinotoolkit/nncf/actions/runs/13132288960/job/36639837303 - passed
test examples - /job/nightly/job/test_examples/667/ - passed
test_examples - https://github.com/openvinotoolkit/nncf/actions/runs/13133078206 - failed, looks like the issue with the jobs (Windows part passed)
PTQ - job/manual/job/post_training_quantization/588/ - in progress

UPD:
test_examples - https://github.com/openvinotoolkit/nncf/actions/runs/13133078206 - passed
PTQ - failed; one model is under investigation hf/hf-internal-testing/tiny-random-GPTNeoXForCausalLM_stateless

UPD:
PTQ - added xfail on hf/hf-internal-testing/tiny-random-GPTNeoXForCausalLM_stateless - the fix should be added in the 2025.1 OpenVINO
test_examples - https://github.com/openvinotoolkit/nncf/actions/runs/13202112767 - passed
WC - https://github.com/openvinotoolkit/nncf/actions/runs/13202110425 - passed
ptq - job/manual/job/post_training_quantization/598 - in progress

@kshpv kshpv marked this pull request as ready for review February 4, 2025 13:36
@kshpv kshpv requested a review from a team as a code owner February 4, 2025 13:36
@kshpv kshpv requested a review from alexsu52 February 4, 2025 13:36
@alexsu52 alexsu52 self-assigned this Feb 7, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@alexsu52 alexsu52 Awaiting requested review from alexsu52

At least 1 approving review is required to merge this pull request.

Assignees

@alexsu52 alexsu52

Labels
documentation Improvements or additions to documentation NNCF PTQ Pull requests that updates NNCF PTQ
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@kshpv @alexsu52