Skip to content

add cache_config's info to prometheus metrics.#3100

Merged
simon-mo merged 2 commits intovllm-project:mainfrom AllenDou:cache_config_metricsFeb 29, 2024

Commits

Commits on Feb 29, 2024