neuralmagic 's Collections DeepSeek-R1-Distill Quantized
updated
RedHatAI/DeepSeek-R1-Distill-Llama-8B-FP8-dynamic
Text Generation
• Updated • 205
• 5
RedHatAI/DeepSeek-R1-Distill-Llama-70B-FP8-dynamic
Text Generation
• 71B • Updated • 2.91k
• 10
RedHatAI/DeepSeek-R1-Distill-Qwen-32B-FP8-dynamic
Text Generation
• 33B • Updated • 1.53k
• 10
RedHatAI/DeepSeek-R1-Distill-Llama-70B-quantized.w8a8
Text Generation
• 71B • Updated • 142
• 2
RedHatAI/DeepSeek-R1-Distill-Qwen-14B-FP8-dynamic
Text Generation
• Updated • 247
• 3
RedHatAI/DeepSeek-R1-Distill-Qwen-7B-FP8-dynamic
Text Generation
• 8B • Updated • 320
• 1
RedHatAI/DeepSeek-R1-Distill-Qwen-1.5B-quantized.w8a8
Text Generation
• 2B • Updated • 3.55k
• 2
RedHatAI/DeepSeek-R1-Distill-Qwen-1.5B-FP8-dynamic
Text Generation
• 2B • Updated • 140
RedHatAI/DeepSeek-R1-Distill-Qwen-14B-quantized.w8a8
Text Generation
• 15B • Updated • 2.3k
• 2
RedHatAI/DeepSeek-R1-Distill-Qwen-7B-quantized.w8a8
Text Generation
• 8B • Updated • 2.78k
• 5
RedHatAI/DeepSeek-R1-Distill-Llama-8B-quantized.w4a16
Text Generation
• 2B • Updated • 462
RedHatAI/DeepSeek-R1-Distill-Llama-8B-quantized.w8a8
Text Generation
• 8B • Updated • 2.66k
• 2
RedHatAI/DeepSeek-R1-Distill-Qwen-14B-quantized.w4a16
Text Generation
• 3B • Updated • 452
• 1
RedHatAI/DeepSeek-R1-Distill-Qwen-7B-quantized.w4a16
Text Generation
• 2B • Updated • 138
• 2
RedHatAI/DeepSeek-R1-Distill-Qwen-1.5B-quantized.w4a16
Text Generation
• 0.6B • Updated • 122
• 1
RedHatAI/DeepSeek-R1-Distill-Llama-70B-quantized.w4a16
Text Generation
• 11B • Updated • 787
• 6
RedHatAI/DeepSeek-R1-Distill-Qwen-32B-quantized.w4a16
Text Generation
• 6B • Updated • 580
• 5
RedHatAI/DeepSeek-R1-Distill-Qwen-32B-quantized.w8a8
Text Generation
• Updated • 2.19k
• 13