MoE models quantized with the APEX Quantization technique ( https://github.com/mudler/apex-quant )
mudler
mudler
AI & ML interests
LocalAI Creator ( https://localai.io )
Website: https://mudler.pm
Recent Activity
updated a model about 1 hour ago
mudler/Huihui3.5-67B-A3B-APEX-GGUF published a model about 1 hour ago
mudler/Huihui3.5-67B-A3B-APEX-GGUF updated a collection about 4 hours ago
APEX Quants (GGUF)Organizations
Fine-tuned models for LocalAI finetuned by me
-
mudler/LocalAI-functioncall-phi-4-v0.3
Text Generation • Updated • 7 • 8 -
mudler/LocalAI-functioncall-llama3.2-1b-v0.4
Text Generation • 1B • Updated • 5 -
mudler/Mirai-Nova-Llama3-LocalAI-8B-v0.1
Text Generation • 8B • Updated • 4 • 1 -
mudler/LocalAI-Llama3-8b-Function-Call-v0.2
Text Generation • 8B • Updated • 9 • 10
MoE models quantized with the APEX Quantization technique ( https://github.com/mudler/apex-quant )
Fine-tuned models for LocalAI finetuned by me
-
mudler/LocalAI-functioncall-phi-4-v0.3
Text Generation • Updated • 7 • 8 -
mudler/LocalAI-functioncall-llama3.2-1b-v0.4
Text Generation • 1B • Updated • 5 -
mudler/Mirai-Nova-Llama3-LocalAI-8B-v0.1
Text Generation • 8B • Updated • 4 • 1 -
mudler/LocalAI-Llama3-8b-Function-Call-v0.2
Text Generation • 8B • Updated • 9 • 10
models 87
mudler/Huihui3.5-67B-A3B-APEX-GGUF
67B • Updated
mudler/Qwen3.5-397B-A17B-APEX-GGUF
396B • Updated • 2
mudler/NVIDIA-Nemotron-3-Super-120B-A12B-APEX-GGUF
121B • Updated • 748
mudler/Nemotron-3-Nano-30B-A3B-APEX-GGUF
32B • Updated • 1.72k
mudler/LFM2-24B-A2B-APEX-GGUF
24B • Updated • 622 • 2
mudler/Mistral-Small-4-119B-2603-APEX-GGUF
119B • Updated • 933
mudler/gemma-4-26B-A4B-it-Claude-Opus-Distill-APEX-GGUF
25B • Updated • 7.54k • 4
mudler/Qwen3-Coder-Next-APEX-GGUF
80B • Updated • 1.7k • 6
mudler/Qwen3.5-35B-A3B-APEX-TQ-GGUF
35B • Updated • 2.66k • 10
mudler/gemma-4-26B-A4B-it-heretic-APEX-GGUF
25B • Updated • 8.39k • 10