Repository navigation

[TRTLLM-17083][feat] Cancel paired GEN on CTX failure or cancellation - #20491

Merged

chienchunhung merged 2 commits into

NVIDIA:mainfrom

chienchunhung:dev/pact-early-paired-cancellation

Oct 31, 2026

Merged

[TRTLLM-17083][feat] Cancel paired GEN on CTX failure or cancellation#20491
chienchunhung merged 2 commits into
NVIDIA:mainfrom
chienchunhung:dev/pact-early-paired-cancellation

Commits on Oct 28, 2026
- test: cover early cancellation of paired disaggregated requests
  chienchunhung
  committed
  c497014
Commits on Oct 30, 2026
- fix: close paired generation requests when context terminates
  chienchunhung
  committed
  ca7ca1e