Smartest RP Mistral 24B I've tested
It checks all the boxes! ✅
Why it is dumb :\ triedQ8,Q6,Q6-imat but still.. :
it's creative but dumb.
Did u compare to the non - MPOA version? The scale used was 1.3 so maybe ablation trimmed some brain cells. But I think in general 24B has limits and anything this small is going to seem dumb in some ways
if u notice that finetunes work better it coud just be the way della handles vectors and scrambles osme things it shouldnt
What's the KL rate? and One thing i used Static Q6 and idk why but it's better than the imat Q6 or the static Q8 lol. It's Intelligent enough and Creativity is peak. Also I'll say thanks for the MPOA it's the first model which gives right answer in my nsfw rp without any refusals. other AI models in 24B just refuses (still being in character) this one gets the job done easily. Peak.
Not sure, I have to set up some tools to check KL divergence since Heretic is too slow on my PC. Glad the MPOA works for you. v1.1 is also abliterated and may have a baked in 'higher temperature' like effect. I usually test with Q6 static and either IQ4_XS or IQ4_NL depending on the model arch.
Did u compare to the non - MPOA version? The scale used was 1.3 so maybe ablation trimmed some brain cells. But I think in general 24B has limits and anything this small is going to seem dumb in some ways
I actually did compare the two and repeated the test three times, because I couldn’t believe the results… MPOA was smarter, at least regarding my private test suite. Though I later found out, that the original Magidonia 4.3 is also quite capable, but hadn’t tested it before. Overall, I like the MPOA better, writing style seems more… unusual in a good way. I’ll be back in action soon, meanwhile keep up the good work 👍