RedHatAI/DeepSeek-R1-Distill-Llama-8B-FP8-dynamic
Text Generation • 8B • Updated • 45 • 5
DeepSeek-R1-Distill Quantized
-
-
RedHatAI/DeepSeek-R1-Distill-Llama-70B-quantized.w8a8
Text Generation • 71B • Updated • 293 • 2 -
RedHatAI/DeepSeek-R1-Distill-Llama-8B-quantized.w4a16
Text Generation • 8B • Updated • 6.19k -
RedHatAI/DeepSeek-R1-Distill-Llama-8B-quantized.w8a8
Text Generation • 8B • Updated • 161 • 2 -
RedHatAI/DeepSeek-R1-Distill-Qwen-1.5B-FP8-dynamic
Text Generation • 2B • Updated • 326 -
RedHatAI/DeepSeek-R1-Distill-Qwen-14B-FP8-dynamic
Text Generation • 15B • Updated • 985 • 3 -
RedHatAI/DeepSeek-R1-Distill-Qwen-14B-quantized.w4a16
Text Generation • 15B • Updated • 252 • 1 -
RedHatAI/DeepSeek-R1-Distill-Qwen-14B-quantized.w8a8
Text Generation • 15B • Updated • 108 • 2 -
RedHatAI/DeepSeek-R1-Distill-Qwen-32B-FP8-dynamic
Text Generation • 33B • Updated • 7.69k • 10 -
RedHatAI/DeepSeek-R1-Distill-Qwen-32B-quantized.w4a16
Text Generation • 33B • Updated • 471 • 5 -
RedHatAI/DeepSeek-R1-Distill-Llama-70B-FP8-dynamic
Text Generation • 71B • Updated • 19.6k • 10 -
RedHatAI/DeepSeek-R1-Distill-Qwen-7B-FP8-dynamic
Text Generation • 8B • Updated • 459 • 1 -
RedHatAI/DeepSeek-R1-Distill-Qwen-7B-quantized.w4a16
Text Generation • 8B • Updated • 39 • 2 -
RedHatAI/DeepSeek-R1-Distill-Qwen-1.5B-quantized.w8a8
Text Generation • 2B • Updated • 114 • 2 -
RedHatAI/DeepSeek-R1-Distill-Qwen-7B-quantized.w8a8
Text Generation • 8B • Updated • 175 • 5 -
RedHatAI/DeepSeek-R1-Distill-Qwen-32B-quantized.w8a8
Text Generation • 33B • Updated • 248 • 13 -
RedHatAI/DeepSeek-R1-Distill-Llama-70B-quantized.w4a16
Text Generation • 71B • Updated • 2.62k • 6 -
RedHatAI/DeepSeek-R1-Distill-Qwen-1.5B-quantized.w4a16
Text Generation • 2B • Updated • 63 • 1