Hugging Face's logo

cerebras
/
GLM-4.5-Air-REAP-82B-A12B

Text Generation
Transformers
Safetensors
English
glm4_moe
glm
MOE
pruning
compression
conversational
Model card Files
xet
 Community
17

FP8 quant?

#10
by Daemontatox - opened
Discussion
Daemontatox

Is it possible to get the fp8 version of this model similar to the glm 4.6 and qwen coder models?
vithursant
 Cerebras org

@Daemontatox we plan to release the FP8 checkpoint soon as well. Thanks!

Daemontatox changed discussion status to closed
lazarevich
 Cerebras org

@Daemontatox we've just uploaded the FP8 variant: https://hf.co/cerebras/GLM-4.5-Air-REAP-82B-A12B-FP8
Daemontatox

@lazarevich Cerebras team sure is cooking , thank alot for the had work

Sign up or log in to comment