Skip to content

[https://nvbugs/6731978][test] unwaive B200 Qwen3-235B NVFP4 TRTLLM MoE test - #19916

Merged
xxi-nv merged 1 commit into
NVIDIA:release/1.3from
jiahanc:unwaive-b200-qwen3-235b-nvfp4-6731978
Oct 13, 2026
Merged

xxi-nv merged 1 commit into
NVIDIA:release/1.3from
jiahanc:unwaive-b200-qwen3-235b-nvfp4-6731978

Conversation

@jiahanc

@jiahanc jiahanc commented Oct 7, 2026 •

Copy link
Copy Markdown
Collaborator

Description

Remove the B200 waiver for TestQwen3_235B_A22B::test_nvfp4[latency_moe_trtllm] (NVBug 6731978).

Test Coverage

  • uvx pre-commit run --files tests/integration/test_lists/waives.txt (passed)
  • Manual 8x B200 validation on release 1.3.0rc29: 1 passed; MMLU 85.356 >= 83.683; GSM8K 84.951 >= 82.577
  • CI target: l0_gb200_multi_nodes.yml, TIMEOUT (90), ISOLATION

PR Checklist

Please review the following before submitting your PR:

  • PR description clearly explains what and why. If using CodeRabbit's summary, please make sure it makes sense.

  • PR Follows TRT-LLM CODING GUIDELINES to the best of your knowledge.

  • Test cases are provided for new code paths (see test instructions)

  • If PR introduces API changes, an appropriate PR label is added - either api-compatible or api-breaking. For api-breaking, include BREAKING in the PR title.

  • Any new dependencies have been scanned for license and vulnerabilities

  • CODEOWNERS updated if ownership changes

  • Documentation updated as needed

  • Update tava architecture diagram if there is a significant design change in PR.

  • The reviewers assigned automatically/manually are appropriate for the PR.

  • Please check this after reviewing the above items as appropriate for this PR.

GitHub Bot Help

To see a list of available CI bot commands, please comment /bot help.

Dev Engineer Review

The change removes the B200 waiver for TestQwen3_235B_A22B::test_nvfp4[latency_moe_trtllm] (NVBug 6731978). The test remains in the B200 multi-node CI list with TIMEOUT (90) ISOLATION, so the test can run when that list is selected. No source-code changes are reported.

QA Engineer Review

Only a test-list file changed. The removed waiver changes test selection; no test function or test ID changed. The test remains in test-db/l0_gb200_multi_nodes.yml and in two manual-QA lists. The author reports that pre-commit passed and manual validation on 8x B200 passed on release 1.3.0rc29, with MMLU and GSM8K scores above their stated thresholds. The reported post-merge runs had mixed outcomes: one was aborted and one succeeded; the associated pipeline was marked Partly Tested. Coverage verdict: needs follow-up.

Per-File QA Perspective

  • tests/integration/test_lists/waives.txt: Removes the waiver for the B200 Qwen3-235B NVFP4 TRTLLM MoE test. Verify the test in current-main CI; the reported manual run used release 1.3.0rc29.

@coderabbitai

coderabbitai Bot commented Oct 7, 2026 •

Copy link
Copy Markdown
Contributor

Review in Change Stack →

No actionable comments were generated in the recent review. 🎉

ℹ️ Recent review info
⚙️ Run configuration
  • Configuration used: Repository: NVIDIA/TensorRT-LLM/.coderabbit.yaml
  • Review profile: CHILL
  • Plan: Enterprise
  • Run ID: 95ed058b-bd3f-43e9-ac24-12b4bde9e8c9

📥 Commits

Reviewing files that changed from the base of the PR and between eb2fa46 and 3540ac1.


📒 Files selected for processing (1)
  • tests/integration/test_lists/waives.txt

💤 Files with no reviewable changes (1)
  • tests/integration/test_lists/waives.txt

Included review availability: This review used your included allowance. Your plan provides up to 12 included reviews per hour; 11 remain after this review.



Walkthrough

The B200 TestQwen3_235B_A22B::test_nvfp4[latency_moe_trtllm] entry was removed from the integration skip list.

Changes

Test waiver

Layer / File(s) Summary
Remove the test waiver
tests/integration/test_lists/waives.txt
Removed the B200 Qwen3 NVFP4 latency test entry tracked by NVBUG 6731978.

Priority: ⬇️ Low

Estimated code review effort: 1 (Trivial) | ~5 minutes

Change: Other

Merge Risk: ⚪ Minimal · up to 3540a

No actionable issue is identified with enabling this test. Merge readiness remains subject to normal validation.

Pre-merge checks | Passed 5
✅ Passed checks (5 passed)
Check name Status Explanation
Title check Passed The title clearly identifies NVBug 6731978, the test-related change, and the specific B200 Qwen3-235B NVFP4 TRTLLM MoE waiver removal.
Description check Passed The description explains the change and rationale, lists pre-commit and manual validation results, identifies the CI target, and marks the checklist as reviewed.
Docstring Coverage Passed No functions found in the changed files to evaluate docstring coverage. Skipping docstring coverage check. Docstring coverage is scoped to functions touched by this diff. Analyzed 0 functions across 0…
Linked Issues check Passed Check skipped because no linked issues were found for this pull request.
Out of Scope Changes check Passed Check skipped because no linked issues were found for this pull request.

✨ Finishing Touches
🧪 Generate unit tests (beta)
  • Create a new PR

  • Autopilot · Keep fixing CodeRabbit findings and required CI, and resolving merge conflicts

Comment @coderabbitai help to get the list of available commands.

@github-actions

github-actions Bot commented Oct 7, 2026

Copy link
Copy Markdown

Removed the "ci: full pre-merge approved" label because @jiahanc could not be verified as an active member of NVIDIA/trt-llm-ci-approvers. Ask a member of that team to apply it.

@jiahanc

jiahanc commented Oct 7, 2026

Copy link
Copy Markdown
Collaborator Author

/bot run --stage-list "GB200-8_GPUs-2_Nodes-PyTorch-Post-Merge-1, GB200-8_GPUs-2_Nodes-PyTorch-Post-Merge-2, GB200-8_GPUs-2_Nodes-PyTorch-Post-Merge-3" --disable-fail-fast

@xxi-nv

xxi-nv commented Oct 7, 2026

Copy link
Copy Markdown
Collaborator

/bot run --stage-list "GB200-8_GPUs-2_Nodes-PyTorch-Post-Merge-1, GB200-8_GPUs-2_Nodes-PyTorch-Post-Merge-2, GB200-8_GPUs-2_Nodes-PyTorch-Post-Merge-3" --disable-fail-fast

@github-actions

github-actions Bot commented Oct 7, 2026

Copy link
Copy Markdown

Automatically added "ci: full pre-merge approved" because this PR has satisfied the required GitHub review approvals. Unresolved review conversations and other required checks remain independent merge requirements.

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator

PR_Github #76473 [ run ] triggered by Bot. Commit: eb2fa46 Link to invocation

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator

PR_Github #76474 [ run ] triggered by Bot. Commit: eb2fa46 Link to invocation

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator

PR_Github #76473 [ run ] completed with state ABORTED. Commit: eb2fa46

Link to invocation

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator

PR_Github #76474 [ run ] completed with state SUCCESS. Commit: eb2fa46
/LLM/main/L0_MergeRequest_PR pipeline #63057 (Partly Tested) completed with status: 'SUCCESS'

CI Report

Link to invocation

@jiahanc
jiahanc changed the base branch from main to release/1.3 October 12, 2026 11:29
@jiahanc
jiahanc requested review from a team as code owners October 12, 2026 11:29
…oE test

Signed-off-by: jiahanc <173873397+jiahanc@users.noreply.github.com>
@jiahanc
jiahanc force-pushed the unwaive-b200-qwen3-235b-nvfp4-6731978 branch from eb2fa46 to 3540ac1 Compare October 12, 2026 11:36
@yuxianq
yuxianq removed the request for review from a team October 12, 2026 11:43

@Barry-Delaney Barry-Delaney left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Reviewed 3540ac1: this only removes the B200 Qwen3-235B NVFP4 TRTLLM MoE waiver. The exact test ID remains in the multi-node test list with its existing timeout and isolation settings. No runtime-code change or blocking code issue.

@mikeiovine mikeiovine left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Stamp on behalf of runtime devs

@xxi-nv

xxi-nv commented Oct 12, 2026

Copy link
Copy Markdown
Collaborator

/bot run --disable-fail-fast

@xxi-nv
xxi-nv enabled auto-merge (squash) October 12, 2026 23:36
@tensorrt-cicd

Copy link
Copy Markdown
Collaborator

PR_Github #77356 [ run ] triggered by Bot. Commit: 3540ac1 Link to invocation

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator

PR_Github #77356 [ run ] completed with state SUCCESS. Commit: 3540ac1
/LLM/release-1.3/L0_MergeRequest_PR pipeline #171 completed with status: 'SUCCESS'

CI Report

Link to invocation

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

8 participants