[TRTLLM-16186][feat] Add KV cache lending API for transfer backends - #19722

[TRTLLM-16186][feat] Add KV cache lending API for transfer backends#19722

Shixiaowei02 merged 1 commit into

NVIDIA:mainNVIDIA/TensorRT-LLM:mainfrom

Shixiaowei02:feat/kv-cache-lenderShixiaowei02/TensorRT-LLM:feat/kv-cache-lenderCopy head branch name to clipboard