[TRTLLM-17679][feat] KernelBuilder and the autotuner's build state: build kernels on worker threads while the weights load - #21628

[TRTLLM-17679][feat] KernelBuilder and the autotuner's build state: build kernels on worker threads while the weights load#21628

chenfeiz0326 wants to merge 11 commits into

NVIDIA:mainNVIDIA/TensorRT-LLM:mainfrom

chenfeiz0326:chenfeiz/linear-prebuildchenfeiz0326/TensorRT-LLM:chenfeiz/linear-prebuildCopy head branch name to clipboard