Repository navigation

[https://nvbugs/6577736][perf] cache embedding biases (PR to be merged after #19412) - #19729

Open

ixlmar wants to merge 4 commits into

NVIDIA:release/1.3from

ixlmar:perf/logitbias-part2b

Open

[https://nvbugs/6577736][perf] cache embedding biases (PR to be merged after #19412)#19729
ixlmar wants to merge 4 commits into
NVIDIA:release/1.3from
ixlmar:perf/logitbias-part2b

Commits on Sep 30, 2026
- perf: do not materialize embedding bias rows on host
  ixlmar
  committed
  afd104c
- fix SMG test
  ixlmar
  committed
  8a4c95b
- cache embedding biases
  ixlmar
  committed
  28bda08
- fix return value
  ixlmar
  committed
  f1657b3