Skip to content

[TRTLLM-17603][feat] Fail unsupported non-generation requests and executor loops cleanly instead of mid-run - #21584

Merged
lori-ren merged 6 commits into
NVIDIA:mainfrom
lori-ren:fix/no-kv-guards
Nov 4, 2026
Merged

[TRTLLM-17603][feat] Fail unsupported non-generation requests and executor loops cleanly instead of mid-run#21584
lori-ren merged 6 commits into
NVIDIA:mainfrom
lori-ren:fix/no-kv-guards

[TRTLLM-17603][fix] Compare the whole prompt with the CP-scaled limit…

d691934
Select commit
Loading
Failed to load commit list.
DCO / DCO succeeded Nov 4, 2026 in 1s

DCO

All commits are signed off!

View more details on DCO