[https://nvbugs/5972362][fix] Avoid counting KV cache uses during warmup for Prometheus KV cache metrics - #12132

[https://nvbugs/5972362][fix] Avoid counting KV cache uses during warmup for Prometheus KV cache metrics#12132

taylor-yb-lee merged 3 commits into

NVIDIA:mainNVIDIA/TensorRT-LLM:mainfrom

yijingl-nvidia:fix_prometheus_cache_metricsyijingl-nvidia/TensorRT-LLM:fix_prometheus_cache_metricsCopy head branch name to clipboard