Skip to content

📖 [Story] Performance improvements/gaps in Torch-TensorRT #3627

Open
17 of 19 issues completed
Open
📖 [Story] Performance improvements/gaps in Torch-TensorRT#3627
17 of 19 issues completed
Assignees
zewenli98cehongwang
Labels
StoryIssues proposing a new Storystory: Performance & BenchmarkingPerformance gaps vs ONNX-TRT, engine size, reformatting overhead, profiling tools, and throughput re

Description

@peri044
peri044
opened on Jun 26, 2025

TL;DR

This story tracks all the known perf bugs and fixes for them in Torch-TensorRT compared to ONNX-TRT and TS-TRT

Goal(s)

Close the gap between ONNX-TensorRT and Torch-TensorRT. Identify the existing performance culprit during engine compilation and record them here.

Tasks

### Tasks

Additional context

Activity

  1. peri044
    added
    StoryIssues proposing a new Story
    on Jun 26, 2025
  2. peri044
    added a sub-issue on Jun 26, 2025
  3. peri044
    assigned
    cehongwang
    and
    zewenli98
    on Jun 26, 2025
  4. zewenli98
    added a sub-issue on Jun 30, 2025
  5. cehongwang
    added a sub-issue on Jul 1, 2025
  6. cehongwang
    added sub-issues on Jul 24, 2025
  7. zewenli98
    added sub-issues on Jul 30, 2025
  8. narendasan
    added
    story: Performance & BenchmarkingPerformance gaps vs ONNX-TRT, engine size, reformatting overhead, profiling tools, and throughput re
    on Mar 24, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

Labels

StoryIssues proposing a new Storystory: Performance & BenchmarkingPerformance gaps vs ONNX-TRT, engine size, reformatting overhead, profiling tools, and throughput re

Type

No type

Projects

No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions