Repository navigation

[TRTLLM-17360][feat] Add Beam StairCase operators and model components - #21471

Merged

Mgluhovskoi merged 30 commits into

NVIDIA:mainfrom

Mgluhovskoi:mergeback/beam-1-trtllm-17360

Nov 12, 2026

Merged

[TRTLLM-17360][feat] Add Beam StairCase operators and model components#21471
Mgluhovskoi merged 30 commits into
NVIDIA:mainfrom
Mgluhovskoi:mergeback/beam-1-trtllm-17360

Commits on Nov 2, 2026
- [TRTLLM-17360][feat] Add Beam StairCase operators and baseline model
  Mgluhovskoi
  committed
  7e8fe51
Commits on Nov 3, 2026
- [TRTLLM-17360][fix] Integrate Beam routing and attention with current main
  Mgluhovskoi
  committed
  1152d96
Commits on Nov 4, 2026
- fix: tighten Beam baseline engine and checkpoint contracts
  Mgluhovskoi
  committed
  5c27f5c
- fix: keep Beam component boundary separate from serving registration
  Mgluhovskoi
  committed
  878b140
Commits on Nov 6, 2026
- Scope Beam operators to its model family and cover TP4 shapes
  Mgluhovskoi
  committed
  cabd549
- Merge main to refresh Beam component CI
  Mgluhovskoi
  committed
  2aa5c08
- Use explicit FP32 cuBLAS for Beam router projection
  Mgluhovskoi
  committed
  ab57605
- Move shared Beam attention and dispatch helpers to family scope
  Mgluhovskoi
  committed
  81d6a8b
Commits on Nov 7, 2026
- Annotate Beam component and checkpoint loader contracts
  Mgluhovskoi
  committed
  f9f3c32
Commits on Nov 9, 2026

Navigation Menu

Repository navigation

[TRTLLM-17360][feat] Add Beam StairCase operators and model components - #21471

[TRTLLM-17360][feat] Add Beam StairCase operators and model components#21471
Mgluhovskoi merged 30 commits into
NVIDIA:mainfrom
Mgluhovskoi:mergeback/beam-1-trtllm-17360

Commits on Nov 2, 2026

[TRTLLM-17360][feat] Add Beam StairCase operators and baseline model

Commits on Nov 3, 2026

[TRTLLM-17360][fix] Integrate Beam routing and attention with current main

Commits on Nov 4, 2026

fix: tighten Beam baseline engine and checkpoint contracts

fix: keep Beam component boundary separate from serving registration

Commits on Nov 6, 2026

Scope Beam operators to its model family and cover TP4 shapes

Merge main to refresh Beam component CI

Use explicit FP32 cuBLAS for Beam router projection

Move shared Beam attention and dispatch helpers to family scope

Commits on Nov 7, 2026

Annotate Beam component and checkpoint loader contracts

Commits on Nov 9, 2026

Include Beam operator packages in installed wheels

Merge main and retain Beam CPU coverage after test consolidation

fix: report all rank-local Beam checkpoint load failures

docs: clarify repeated Beam diagnostic validation costs

docs: correct Beam position validation and cache reuse contracts

fix: validate Beam direct-call devices positions and checkpoint metadata

docs: distinguish TP1 Beam component numerics from TP4 serving

refactor: remove unused Beam load ledgers and diagnostic work

refactor: name Beam component default layer indices explicitly

refactor: share Beam router normalization epsilon

refactor: reuse shared logit softcap without mutating Beam inputs

perf: release uncaptured Beam dense MLP intermediates before down projection

style: format Beam review fixes and clarify diagnostic documentation

Fix Beam component test selection after upstream CI changes

Reject unsupported Beam RoPE configuration keys

Share Beam component initialization loading and attention

Centralize Beam configuration and hardware constants

Document Beam direct component and diagnostic interfaces

Move Beam bring-up components to checkout-only tests

Keep Beam weight-state inspection in checkpoint tests

Clarify Beam helper packages and dispatch names