RedHatAI/Qwen3.8-27B-INT4
Image-Text-to-Text • 27B • Updated • 306k • 41
Edit Models filters
Model Tree
Apps
Inference Providers
One-click Deployment
Models
636
Active filters: llm-compressor
RedHatAI/GLM-5.3-Flash-NVFP4
Image-Text-to-Text • 169B • Updated • 49.8k • 38
RedHatAI/Qwen3.8-Flash-Next-NVFP4
Image-Text-to-Text • 180B • Updated • 138 • 3
RedHatAI/GLM-5.3-MXFP4
Text Generation • 753B • Updated • 2k • 3
RedHatAI/gemma-4-26B-A4B-it-NVFP4
Image-Text-to-Text • 26B • Updated • 136k • 43
RedHatAI/Muse-Glimmer-30B-INT4
Image-Text-to-Text • 8B • Updated • 10.6k • 8
pearsonkyle/Qwen3.8-27B-GPTQ-W4A16
Image-Text-to-Text • 27B • Updated • 48.6k • 7
RedHatAI/Qwen3-VL-32B-Instruct-NVFP4
Text Generation • 20B • Updated • 3.91k • 8
RedHatAI/Qwen3.5-4B-quantized.w4a16
Image-Text-to-Text • 5B • Updated • 10.3k • 2
kumar2235/Qwen3.5-4B-AWQ
Text Generation • 4B • Updated • 1.69k • 4
sahilchachra/LocateAnything-3B-AWQ-W4A16
Image-Text-to-Text • 4B • Updated • 39 • 1
RedHatAI/GLM-5.2-NVFP4-FP8
Text Generation • 425B • Updated • 8.06k • 25
RedHatAI/Inkling-NVFP4-FP8-BLOCK
Image-Text-to-Text • 952B • Updated • 126 • 1
kaitchup/Muse-Glimmer-30B-autoscheme-3.5bit-XS
6B • Updated • 55 • 1
nex-agi/Nex-N2-Mini-NVFP4
Text Generation • 22B • Updated • 146 • 1
TelperionAI/Huihui-Qwen3.8-27B-abliterated-INT4-AWQ-GPTQ
Image-Text-to-Text • 8B • Updated • 9.77k • 5
amd/Phi-4-mini-instruct-w4a16-llmcompressor
Text Generation • 4B • Updated • 148 • 1
soyrsoyr/Nemotron-3.5-Lightning-1.4B-A0.1B-MTP-NVFP4
Text Generation • 1B • Updated • 328 • 1
KoliaNik/Qwen3-Reranker-4B-NVFP4
Text Ranking • 4B • Updated • 304 • 1
sakamakismile/MiniCPM5-2B-NVFP4
Text Generation • 3B • Updated • 485 • 1
RedHatAI/Qwen2.5-0.5B-quantized.w8a16
Text Generation • 0.6B • Updated • 421
RedHatAI/Qwen2.5-1.5B-quantized.w8a16
Text Generation • 2B • Updated • 167
RedHatAI/Qwen2.5-3B-quantized.w8a16
Text Generation • 3B • Updated • 95
RedHatAI/Qwen2.5-7B-quantized.w8a16
Text Generation • 8B • Updated • 105 • 1
RedHatAI/Qwen2.5-32B-quantized.w8a16
Text Generation • 33B • Updated • 25
RedHatAI/Qwen2.5-72B-quantized.w8a16
Text Generation • 73B • Updated • 24
RedHatAI/Qwen2.5-Coder-14B-Instruct-FP8-dynamic
Text Generation • 15B • Updated • 480 • 1
RedHatAI/Phi-4-mini-instruct-FP8-dynamic
Text Generation • 4B • Updated • 435 • 1
divish/M-Prometheus-3B-FP8-Dynamic
Text Generation • 3B • Updated • 8
textgeflecht/Devstral-Small-2505-FP8-llmcompressor
Text Generation • 24B • Updated • 20