Skip to content
Back to pull request #12003

[V1][Prefix Cache] Move the logic of num_computed_tokens into KVCacheManager #32461

Sign in to view logs

[V1][Prefix Cache] Move the logic of num_computed_tokens into KVCacheManager

[V1][Prefix Cache] Move the logic of num_computed_tokens into KVCacheManager #32461

Run time

Learn about OS pricing on GitHub Actions
Job Run time
ruff (3.12)
14s
14s