Skip to content

[TRTLLM-17083][feat] Cancel paired GEN on CTX failure or cancellation - #20491

Merged
chienchunhung merged 2 commits into
NVIDIA:mainfrom
chienchunhung:dev/pact-early-paired-cancellation
Oct 31, 2026
Merged

[TRTLLM-17083][feat] Cancel paired GEN on CTX failure or cancellation#20491
chienchunhung merged 2 commits into
NVIDIA:mainfrom
chienchunhung:dev/pact-early-paired-cancellation

fix: close paired generation requests when context terminates

ca7ca1e
Select commit
Loading
Failed to load commit list.
Sign in for the full log view

Annotations

1 notice
PR Base Freshness
succeeded Oct 30, 2026 in 15s