Hope to see a 4bits AWQ version
#25
by leflak - opened
Sorry for pollution but this model is amazing and I think many peope still expect to see an AWQ version (in case any llm compressor expert see this). Thank ou stepfun-ai for this model!
leflak changed discussion title from Hope to see an AWQ version to Hope to see a 4bits AWQ version