Skip to content
Back to pull request #12003

[V1][Prefix Cache] Move the logic of num_computed_tokens into KVCacheManager #6623

Sign in to view logs

[V1][Prefix Cache] Move the logic of num_computed_tokens into KVCacheManager

[V1][Prefix Cache] Move the logic of num_computed_tokens into KVCacheManager #6623

Triggered via pull request January 15, 2025 01:37
@heheda12345heheda12345
synchronize #12003
heheda12345:hit_last_block
Status Success
Total duration 24s
Artifacts –

codespell.yml

on: pull_request
Matrix: codespell
Fit to window
Zoom out
Zoom in

Annotations

1 warning
codespell (3.12)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636