Skip to content

模型编码器tensorrt测试是用的fp16模式吗 #142

Open

Description

@13213085

mkdir -p assets/export_models/efficientvit_sam/tensorrt/

Export Encoder

trtexec --onnx=assets/export_models/efficientvit_sam/onnx/efficientvit_sam_xl1_encoder.onnx --minShapes=input_image:1x3x1024x1024 --optShapes=input_image:4x3x1024x1024 --maxShapes=input_image:4x3x1024x1024 --saveEngine=assets/export_models/efficientvit_sam/tensorrt/efficientvit_sam_xl1_encoder.engine
部署tensorrt模型的时候导入编码器的时候没有指定fp16模式,是否用fp16模式测过,结果是否正确,论文里面测试的fp16结果编码器用的是fp16模型吗,还是只有解码器用fp16模型

Activity

  1. zhuoyang20 commented on Oct 24, 2024

    @zhuoyang20
    Collaborator

    Hi,

    Setting all parameters to FP16 in the encoder leads to overflow in the LayerNorm layers. We suggest you to enable FP16 mode while forcing the LayerNorm layers to FP32 precision. This approach has been verified by us. I hope this addresses your question. Please feel free to reach out if you have additional concerns.

    Best,
    Zhuoyang

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No type

Projects

No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions