YAML Metadata Warning:empty or missing yaml metadata in repo card
Check out the documentation for more information.
Models we need for benchmark test Qwen3/3.5 Q4
Based on repos:
- https://huggingface.co/Qwen/Qwen/Qwen3-1.7B
- https://huggingface.co/Qwen/Qwen3-4B-GGUF
- https://huggingface.co/Qwen/Qwen3.5-4B
Qwen3-1.7B and Qwen3.5-4B has been converted to GGUF and Quantized to Q4_K_M
- Downloads last month
- 231
Hardware compatibility
Log In to add your hardware
4-bit
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support