[https://nvbugs/6758245][fix] Keep /metrics from blocking the serving event loop - #20429

[https://nvbugs/6758245][fix] Keep /metrics from blocking the serving event loop#20429

JunyiXu-nv merged 9 commits into

NVIDIA:release/1.3NVIDIA/TensorRT-LLM:release/1.3from

JunyiXu-nv:dev-junyix-fix-metrics-nonblockingJunyiXu-nv/TensorRT-LLM:dev-junyix-fix-metrics-nonblockingCopy head branch name to clipboard