ValueError: gemm_fp8_nt_groupwise is only supported on SM100, SM103 in trtllm backend.
#3 opened 5 months ago
by
Fernanda24
Make a gguf?
➕ 2
#2 opened 5 months ago
by
drmcbride
DeepSeek-V3.2-Speciale
➕ 3
#1 opened 5 months ago
by
sasa2000