quantized and RSA
#5
by ainz - opened
hey thank you for releasing this model, can you please release a quantized version and some more details on the RSA and your workflow especially how you managed to hit sonnet 4.5 level using RSA
Details for RSA are in Section VI of the paper (https://arxiv.org/abs/2605.05365). We don't have a quantized version at the moment
Details for RSA are in Section VI of the paper (https://arxiv.org/abs/2605.05365). We don't have a quantized version at the moment
i quantized - 8 bits & 4 bits and it kept outputting html tags , #, ive been on it throughout today, i wanted to do little LoRA on it from my coding sessions but i couldn't cus of the problem above