Skip to content

feat : reduce trt engine build time in testing - #3014

Merged
QiJune merged 1 commit into
NVIDIA:mainfrom
peaceh-nv:reduce-time
Mar 26, 2025
Merged

QiJune merged 1 commit into
NVIDIA:mainfrom
peaceh-nv:reduce-time

Conversation

@peaceh-nv

Copy link
Copy Markdown
Collaborator

The default max tactic number to autotune is (when builder_config.trt_builder_config.max_num_tactics == -1 and trt will choose heuristic path):
100 for SM90
60 for other architectures
This number may have slight impact on the e2e perf, but no impact on the functional tests and would save nearly 50% test time on related tests.

@peaceh-nv
peaceh-nv requested a review from QiJune March 24, 2025 08:01
@peaceh-nv

Copy link
Copy Markdown
Collaborator Author

/bot run

@niukuo

niukuo commented Mar 24, 2025

Copy link
Copy Markdown
Collaborator

PR_Github #261 [ run ] triggered by Bot

@QiJune QiJune left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@niukuo

niukuo commented Mar 24, 2025

Copy link
Copy Markdown
Collaborator

PR_Github #261 [ run ] completed with state SUCCESS
/LLM/main/L0_MergeRequest_PR pipeline #252 completed with status: 'FAILURE'

@QiJune

QiJune commented Mar 24, 2025

Copy link
Copy Markdown
Collaborator

/bot run

@niukuo

niukuo commented Mar 24, 2025

Copy link
Copy Markdown
Collaborator

PR_Github #317 [ run ] triggered by Bot

@niukuo

niukuo commented Mar 24, 2025

Copy link
Copy Markdown
Collaborator

PR_Github #317 [ run ] completed with state SUCCESS
/LLM/main/L0_MergeRequest_PR pipeline #301 completed with status: 'FAILURE'

@peaceh-nv

Copy link
Copy Markdown
Collaborator Author

/bot run

@niukuo

niukuo commented Mar 25, 2025

Copy link
Copy Markdown
Collaborator

PR_Github #351 [ run ] triggered by Bot

@niukuo

niukuo commented Mar 25, 2025

Copy link
Copy Markdown
Collaborator

PR_Github #351 [ run ] completed with state SUCCESS
/LLM/main/L0_MergeRequest_PR pipeline #322 completed with status: 'FAILURE'

@peaceh-nv

Copy link
Copy Markdown
Collaborator Author

/bot run

@niukuo

niukuo commented Mar 25, 2025

Copy link
Copy Markdown
Collaborator

PR_Github #374 [ run ] triggered by Bot

@niukuo

niukuo commented Mar 25, 2025

Copy link
Copy Markdown
Collaborator

PR_Github #374 [ run ] completed with state SUCCESS
/LLM/main/L0_MergeRequest_PR pipeline #338 completed with status: 'FAILURE'

@QiJune

QiJune commented Mar 25, 2025

Copy link
Copy Markdown
Collaborator

/bot run

@niukuo

niukuo commented Mar 25, 2025

Copy link
Copy Markdown
Collaborator

PR_Github #476 [ run ] triggered by Bot

@niukuo

niukuo commented Mar 26, 2025

Copy link
Copy Markdown
Collaborator

PR_Github #476 [ run ] completed with state SUCCESS
/LLM/main/L0_MergeRequest_PR pipeline #409 completed with status: 'SUCCESS'

@peaceh-nv
peaceh-nv enabled auto-merge (squash) March 26, 2025 02:22
@peaceh-nv
peaceh-nv disabled auto-merge March 26, 2025 02:24
Signed-off-by: peaceh <103117813+peaceh-nv@users.noreply.github.com>
@peaceh-nv

Copy link
Copy Markdown
Collaborator Author

/bot reuse-pipeline

@niukuo

niukuo commented Mar 26, 2025

Copy link
Copy Markdown
Collaborator

PR_Github #506 [ reuse-pipeline ] triggered by Bot

@niukuo

niukuo commented Mar 26, 2025

Copy link
Copy Markdown
Collaborator

PR_Github #506 [ reuse-pipeline ] completed with state SUCCESS
Reusing PR_Github #476 for commit 2794aad

@QiJune
QiJune merged commit 5e272ee into NVIDIA:main Mar 26, 2025
wu1du2 pushed a commit to wu1du2/TensorRT-LLM that referenced this pull request May 11, 2025
Signed-off-by: peaceh <103117813+peaceh-nv@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants