Repository navigation

[TRTLLM-16944][refactor] Simplify TorchSampler strategy grouping and fast path around the fused sampling kernel - #20188

Merged

lori-ren merged 6 commits into

NVIDIA:mainfrom

lori-ren:refactor/simplify-fused-sampler-strategies

Oct 15, 2026

Merged

[TRTLLM-16944][refactor] Simplify TorchSampler strategy grouping and fast path around the fused sampling kernel#20188
lori-ren merged 6 commits into
NVIDIA:mainfrom
lori-ren:refactor/simplify-fused-sampler-strategies

Commits on Oct 12, 2026
- [TRTLLM-16944][refactor] Simplify TorchSampler strategy grouping and fast path around the fused sampling kernel
  lori-ren
  committed
  cfb55d0
- [TRTLLM-16944][refactor] Replace TorchSampler's strategy layer with per-slot sampling params
  lori-ren
  committed
  966c3f9
Commits on Oct 13, 2026
- [TRTLLM-16944][fix] Key beam-search groups by row stride
  lori-ren
  committed
  0b8c27d
Commits on Oct 14, 2026
- Merge remote-tracking branch 'upstream/main' into refactor/simplify-fused-sampler-strategies
  lori-ren
  committed
  27285e7
- [TRTLLM-16944][fix] Assert slot admission before reading sampling params
  lori-ren
  committed
  170b9f8
Commits on Oct 15, 2026
- [TRTLLM-16944][fix] Ban single-token stop words below min_tokens
  lori-ren
  committed
  506d344