Repository navigation
Conversation
…ease 1.3 Signed-off-by: Dongfeng Yu <dongfengy@nvidia.com>
Collaborator
Author
|
/bot run --disable-fail-fast |
Contributor
Collaborator
|
PR_Github #79040 [ run ] triggered by Bot. Commit: |
BowenFu
approved these changes
Oct 20, 2026
|
Automatically added "ci: full pre-merge approved" because this PR has satisfied the required GitHub review approvals. Unresolved review conversations and other required checks remain independent merge requirements. |
Collaborator
|
PR_Github #79040 [ run ] completed with state |
QiJune
added a commit
to QiJune/TensorRT-LLM
that referenced
this pull request
Oct 20, 2026
Remove 5 waive entries on release/1.3 whose NVBugs are closed and whose tests passed on the waived platform in pre-merge CI (L0_MergeRequest_PR NVIDIA#342 and NVIDIA#375, with post-merge extra stages): 6481323, 6428057, 6762288 (triton variant), 6700265, 6075431. Handled by other release/1.3 PRs: 6893730 (NVIDIA#20592), the 6762288 cutlass variant and 6672360 (NVIDIA#20632), 6278337 (NVIDIA#20585). Waives for the other closed bugs (6435097, 6695515, 6812288, 6432818, 6428092, 6432826) are kept: their tests did not run on the waived platform in that CI run, so the unwaive is not verified yet. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> Signed-off-by: junq <22017000+QiJune@users.noreply.github.com>
QiJune
added a commit
to QiJune/TensorRT-LLM
that referenced
this pull request
Oct 20, 2026
Remove 5 waive entries on release/1.3 whose NVBugs are closed and whose tests passed on the waived platform in pre-merge CI (L0_MergeRequest_PR 6481323, 6428057, 6762288 (triton variant), 6700265, 6075431. Handled by other release/1.3 PRs: 6893730 (NVIDIA#20592), the 6762288 cutlass variant and 6672360 (NVIDIA#20632), 6278337 (NVIDIA#20585). Waives for the other closed bugs (6435097, 6695515, 6812288, 6432818, 6428092, 6432826) are kept: their tests did not run on the waived platform in that CI run, so the unwaive is not verified yet. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> Signed-off-by: junq <22017000+QiJune@users.noreply.github.com>
1 task done
QiJune
added a commit
to QiJune/TensorRT-LLM
that referenced
this pull request
Oct 20, 2026
Remove the remaining 6 waive entries on release/1.3 whose NVBugs are closed. PRs NVIDIA#20585, NVIDIA#20590, NVIDIA#20592 and NVIDIA#20632 handle the other closed-bug entries. - 6428092, 6432826: pipeline-parallel TorchSampler IndexError, fixed by NVIDIA#16163, which is on release/1.3. - 6435097, 6432818: closed as fixed by NVIDIA#16163, but their B200 / GB300 waivers were added later from runs on those GPUs; only QA lists run these tests there. - 6695515, 6812288: closed as not reproducible. The 6428092 entry waives the whole `-m "gpu2"` selection of test_llm_multi_gpu_pytorch.py, which also holds test_llm_rpc_tp2, test_llm_rpc_streaming_tp2 and test_llm_return_logprobs_streaming_tp2. main waives those three under 6859934 because it does not have the fix in NVIDIA#19847 yet; release/1.3 has it. Signed-off-by: junq <22017000+QiJune@users.noreply.github.com>
1 task done
QiJune
added a commit
to QiJune/TensorRT-LLM
that referenced
this pull request
Oct 22, 2026
Remove 5 waive entries on release/1.3 whose NVBugs are closed and whose tests passed on the waived platform in pre-merge CI (L0_MergeRequest_PR 6481323, 6428057, 6762288 (triton variant), 6700265, 6075431. Handled by other release/1.3 PRs: 6893730 (NVIDIA#20592), the 6762288 cutlass variant and 6672360 (NVIDIA#20632), 6278337 (NVIDIA#20585). Waives for the other closed bugs (6435097, 6695515, 6812288, 6432818, 6428092, 6432826) are kept: their tests did not run on the waived platform in that CI run, so the unwaive is not verified yet. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> Signed-off-by: junq <22017000+QiJune@users.noreply.github.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Dev Engineer Review
The change removes seven GPT-OSS accuracy waivers from
tests/integration/test_lists/waives.txt: six platform-specific entries and the global CUTLASS Eagle3 2-GPU entry. The global Triton Eagle3 waiver remains, so that variant stays skipped. Removing the global CUTLASS waiver enables the matching case on other configured platforms as well as RTX PRO 6000. No test code or assertions changed.The provided test results report that all six selected cases passed on the release branch. The reported runs do not establish coverage for every platform and case combination enabled by the waiver changes.
QA Engineer Review
The waiver list changes enable existing GPT-OSS accuracy cases; they do not add or alter test functions, IDs, or selectors. The available results report six passing cases with no skips, errors, or failures. Release CI does not run all six hardware and case combinations in its current premerge configuration, so broader coverage needs follow-up in release CI. Coverage verdict: needs follow-up.
Per-File QA Perspective
tests/integration/test_lists/waives.txt: Removes six platform-specific GPT-OSS accuracy waivers and the global CUTLASS Eagle3 2-GPU waiver. The corresponding cases are present in the relevant test lists, but current premerge CI does not cover all enabled hardware and case combinations.Description
Restore six GPT-OSS accuracy cases on
release/1.3by removing seven waiver entries: the six platform-specific entries and the overlapping all-platform CUTLASS Eagle3 2-GPU waiver. Removing only the RTX entry would leave that case skipped by the global rule. The global Triton variant remains waived.Related tracking: https://nvbugs/6672360, https://nvbugs/6649739, and https://nvbugs/6762288.
This change intentionally re-enables the global CUTLASS case on other configured CI platforms. The manual validation below covers the listed hardware; broader coverage is left to release CI.
Test Coverage
All six original tests passed on
release/1.3@e2be0074b6a8129486bb9c683bad54d439dcc9a2, using wheels built from that source and release-Dockerfile devel images. No test assertions, model inputs, or sample counts were changed. The PR based40f019da251d52d783e3176f343e7b39d4d18e8differs only by three unrelated DeepSeek waiver deletions.test_w4_1gpu[v2_kv_cache-True-True-trtllm-fp8]test_w4_4gpus[v1_kv_cache-tp4-trtllm-auto]test_eagle3_2gpus[cutlass-one_model-overlap_scheduler]test_eagle3_4gpus[v1_kv_cache-cutlass-one_model-overlap_scheduler]test_eagle3_4gpus[v2_kv_cache-cutlass-one_model-overlap_scheduler]test_eagle3_vswa_reuse_4gpus[v1_kv_cache-one_model]Every case used all 1,319 GSM8K samples; the five GPQA cases used all 198 samples. Every accuracy exceeded its original threshold, with exactly one expected test and no skips/errors/failures per run. VSWA also passed the original cold/warm reuse and identical 8-token output assertions.
Release CI should validate the enabled selections. Its current premerge configuration does not execute all six hardware/case combinations above.
PR Checklist