QuantTrio
/

GLM-4.5-AWQ

Text Generation

4-bit precision

Model card Files Files and versions

Resources

View closed (0)

Endless response

#6 opened 3 months ago by

NVfp4 request with 16bit activations

#5 opened 6 months ago by

chriswritescode

do we need new quants for vllm 10.1?

#4 opened 8 months ago by

Does it possible to create a version without MTP layer to save some VRAM

#3 opened 8 months ago by

how did you make it

#2 opened 8 months ago by

How many GPU Memory AWQ need?

#1 opened 8 months ago by