Repository navigation
[Bug] [CUDA] not compilable with CUDA 11.4 due to missing symbols #17771
Description
TVM is not compilable with CUDA 11.4 due to missing symbols
CUDA_R_8F_E4M3 and CUBLASLT_MATMUL_DESC_A_SCALE_POINTER
(Which have been introduced in CUDA 12.x afaik)
Expected behavior
successful compile
Actual behavior
406.2 /opt/tvm/src/runtime/contrib/cublas/cublas.cc:169:15: error: 'CUDA_R_8F_E4M3' was not declared in this scope
406.2 169 | ab_type = CUDA_R_8F_E4M3;
406.2 | ^~~~~~~~~~~~~~
406.2 In file included from /opt/tvm/src/runtime/contrib/cublas/cublas.cc:29:
406.2 /opt/tvm/src/runtime/contrib/cublas/cublas.cc:199:64: error: 'CUBLASLT_MATMUL_DESC_A_SCALE_POINTER' was not declared in this scope; did you mean 'CUBLASLT_MATMUL_DESC_BIAS_POINTER'?
406.2 199 | CHECK_CUBLAS_ERROR(cublasLtMatmulDescSetAttribute(op_desc, CUBLASLT_MATMUL_DESC_A_SCALE_POINTER,
406.2 | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
406.2 /opt/tvm/src/runtime/contrib/cublas/cublas_utils.h:69:34: note: in definition of macro 'CHECK_CUBLAS_ERROR'
406.2 69 | int error = static_cast<int>(fn); \
406.2 | ^~
406.2 /opt/tvm/src/runtime/contrib/cublas/cublas.cc:204:64: error: 'CUBLASLT_MATMUL_DESC_B_SCALE_POINTER' was not declared in this scope; did you mean 'CUBLASLT_MATMUL_DESC_BIAS_POINTER'?
406.2 204 | CHECK_CUBLAS_ERROR(cublasLtMatmulDescSetAttribute(op_desc, CUBLASLT_MATMUL_DESC_B_SCALE_POINTER,
406.2 | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
406.2 /opt/tvm/src/runtime/contrib/cublas/cublas_utils.h:69:34: note: in definition of macro 'CHECK_CUBLAS_ERROR'
406.2 69 | int error = static_cast(fn);
Environment
should not really matter, but:
Ubuntu 20.04 in docker (x86_64)
CUDA 11.4
- needs-triage
Activity
Kokoro2336 commentedon Apr 23, 2026
Hi, can i work on this issue?
[Fix][CUDA] Version compatibility of CUDA symbols (#19432)