On MAC?
#3
by diveren2010 - opened
Thanks for your great effort. Trying now on a mac m4 max with 36GB unified memory but it is extremely slow. Normal QWEN and QWEN image edit works ok. This is about 10x slower than normal unfortunately.
Guess it is because of fp8 which is not supported.
Maybe gguf will come after some days...?