Skip to content

[BugFix] Fix GGUF tp>1 models when vocab_size is not divisible by 64 #2814

[BugFix] Fix GGUF tp>1 models when vocab_size is not divisible by 64

[BugFix] Fix GGUF tp>1 models when vocab_size is not divisible by 64 #2814

Triggered via pull request January 21, 2025 02:35
@Isotr0pyIsotr0py
edited #12230
Status Success
Total duration 14s
Artifacts

cleanup_pr_body.yml

on: pull_request_target
update-description
5s
update-description
Fit to window
Zoom out
Zoom in

Annotations

1 warning
update-description
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636