Repository navigation

[https://nvbugs/6443620][fix] Reserve overlap-scheduler slack in gen KV capacity for one-model spec decode - #16280

Closed

dc3671 wants to merge 2 commits into

NVIDIA:mainfrom

dc3671:fix-mtp-overlap-kv-capacity

Closed

[https://nvbugs/6443620][fix] Reserve overlap-scheduler slack in gen KV capacity for one-model spec decode#16280
dc3671 wants to merge 2 commits into
NVIDIA:mainfrom
dc3671:fix-mtp-overlap-kv-capacity

Commits on Jul 12, 2026
- [None][fix] Reserve overlap-scheduler slack in gen KV capacity for one-model spec decode
  dc3671
  committed
  479d5f9
- [None][fix] Reclaim per-iter overlap-scheduler KV slack in kv_cache_manager_v2
  dc3671
  committed
  683a71e