[V1][Prefix Cache] Move the logic of num_computed_tokens into KVCacheManager#12003
Merged
comaniac merged 4 commits intovllm-project:mainfrom heheda12345:hit_last_blockJan 15, 2025
+61-35
Commits
Commits on Jan 13, 2025
- committed
Commits on Jan 14, 2025
- committed
- committed
Commits on Jan 15, 2025
- committed