Repository navigation

[#15735][feat] KV-cache transfer/staging between two TRT-LLM instances - #15736

Open

nafis271 wants to merge 3 commits into

NVIDIA:mainfrom

deepinfra:kv-transfer-api

Open

[#15735][feat] KV-cache transfer/staging between two TRT-LLM instances#15736
nafis271 wants to merge 3 commits into
NVIDIA:mainfrom
deepinfra:kv-transfer-api

Commits on Jun 29, 2026
- [#15735][feat] KV-cache transfer/staging between two TRT-LLM instances
  Md Nafis Ul Haque Shifat
  committed
  1a5565b
- [#15735][test] Unit tests for the /v1/kv_transfer endpoint
  Md Nafis Ul Haque Shifat
  committed
  2fc17f8
Commits on Jun 30, 2026
- [#15735][fix] address review: skip wasted forward, fail-closed allowlist, robust transfer failures
  Md Nafis Ul Haque Shifat
  committed
  3490f71