mudler/Minerva-3B-Instruct-v1.0-Q8_0-GGUF
Text Generation • 3B • Updated • 6
Quants
Models quantized for LocalAI and llama.cpp
-
-
mudler/Minerva-3B-Instruct-v1.0-Q6_K-GGUF
Text Generation • 3B • Updated • 12 -
mudler/Minerva-3B-Instruct-v1.0-Q4_0-GGUF
Text Generation • 3B • Updated • 14 -
mudler/prem-1B-chat-Q8_0-GGUF
Text Generation • 1B • Updated • 2 -
mudler/prem-1B-chat-Q6_K-GGUF
Text Generation • 1B • Updated • 7 -
mudler/Minerva-3B-base-v1.0-Q2_K-GGUF
Text Generation • 3B • Updated • 15 -
mudler/Minerva-3B-Instruct-v1.0-Q4_K_M-GGUF
Text Generation • 3B • Updated • 22 -
mudler/prem-1B-chat-Q5_0-GGUF
Text Generation • 1B • Updated • 10 • 1 -
mudler/Minerva-1B-base-v1.0-Q5_K_M-GGUF
Text Generation • 1B • Updated • 8 -
mudler/Minerva-1B-base-v1.0-Q4_0-GGUF
Text Generation • 1B • Updated • 9 -
mudler/prem-1B-chat-Q4_0-GGUF
Text Generation • 1B • Updated • 6 -
mudler/Minerva-350M-base-v1.0-Q8_0-GGUF
Text Generation • 0.4B • Updated • 4 -
mudler/Minerva-350M-base-v1.0-Q5_0-GGUF
Text Generation • 0.4B • Updated • 9 -
mudler/Minerva-350M-base-v1.0-Q4_0-GGUF
Text Generation • 0.4B • Updated • 12 -
mudler/Llama-3-8b-ita-ties2-Q4_K_M-GGUF
8B • Updated • 6 • 1 -
mudler/L3-8B-Stheno-v3.1-Q4_K_M-GGUF
8B • Updated • 60 • 2 -
mudler/llama-3-Stheno-Mahou-8B-Q4_K_M-GGUF
8B • Updated • 13 • 2