gustavokch/granite-speech-3.3-8b-GGUF
Updated
• 1
Gruber
gruber
AI & ML interests
None yet
Recent Activity
liked
a model 1 day ago
gustavokch/granite-speech-3.3-8b-GGUF liked
a model 1 day ago
ibm-granite/granite-speech-3.3-8b liked
a model 3 months ago
distil-whisper/distil-large-v3.5 Organizations
None yet
liked 2 models 1 day ago
liked a model 3 months ago
reacted to danielhanchen's post with 🚀🔥❤️ 4 months ago
Post
4455
You can now run Kimi K2 Thinking locally with our Dynamic 1-bit GGUFs: unsloth/Kimi-K2-Thinking-GGUF
We shrank the 1T model to 245GB (-62%) & retained ~85% of accuracy on Aider Polyglot. Run on >247GB RAM for fast inference.
We also collaborated with the Moonshot AI Kimi team on a system prompt fix! 🥰
Guide + fix details: https://docs.unsloth.ai/models/kimi-k2-thinking-how-to-run-locally
We shrank the 1T model to 245GB (-62%) & retained ~85% of accuracy on Aider Polyglot. Run on >247GB RAM for fast inference.
We also collaborated with the Moonshot AI Kimi team on a system prompt fix! 🥰
Guide + fix details: https://docs.unsloth.ai/models/kimi-k2-thinking-how-to-run-locally
liked 2 models 6 months ago
liked 2 models 8 months ago
liked a Space 9 months ago
liked 2 models 10 months ago
upvoted a collection 10 months ago
liked a Space 11 months ago
liked 3 models about 1 year ago
liked a Space about 1 year ago
liked a dataset about 1 year ago