Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

51

Base only

Active filters: rdna4

julianmb/Qwen-3.8-27B-ROCmFP4-FAST-GGUF

Text Generation • 27B • Updated 8 days ago • 26.2k • 24

tcclaviger/Qwen3.8-Flash-Next-MXFP4-FP8

Image-Text-to-Text • 188B • Updated 2 days ago • 221 • 2

JohnTdi/Qwen3-14B-INT4-Mixed-GPTQ

Text Generation • Updated Mar 11

JohnTdi/Qwen3-14B-INT4-Pure-GPTQ

Text Generation • Updated Mar 11

JohnTdi/Qwen3.5-Unsloth-GGUF-R9700-Benchmark

27B • Updated Mar 27 • 53 • 1

djdeniro/Qwen3.5-35B-A3B-MXFP4

Image-Text-to-Text • 20B • Updated Apr 10 • 7 • 1

djdeniro/Qwen3.5-397B-A17B-MXFP4

Image-Text-to-Text • 215B • Updated Apr 11 • 10 • 2

mattbucci/gemma-4-31B-it-AutoRound-AWQ

31B • Updated May 11 • 1.75k

mattbucci/Devstral-24B-AWQ

24B • Updated Apr 29 • 8

mattbucci/Qwen3.5-27B-AWQ

Text Generation • 27B • Updated Apr 29 • 22 • 1

mattbucci/Qwen3-Coder-30B-A3B-AWQ

31B • Updated May 26 • 47

mattbucci/gemma-4-26B-AWQ

26B • Updated May 31 • 9.21k • 1

pahajokiconsulting/Qwen3.6-35B-A3B-MXFP4

Image-Text-to-Text • 20B • Updated Apr 17 • 969 • 7

mattbucci/Qwen3.6-35B-A3B-AWQ-CT

35B • Updated Apr 26 • 118 • 2

mattbucci/Qwen3.6-27B-AWQ-CT

27B • Updated Apr 26 • 279 • 1

mattbucci/Qwen3.6-27B-AWQ

27B • Updated May 1 • 3.75k • 5

mattbucci/Qwen3-Coder-REAP-25B-A3B-AWQ

25B • Updated Apr 29 • 1.77k • 1

mattbucci/Qwen3.6-REAM-A3B-AWQ

Image-Text-to-Text • 27B • Updated May 29 • 182

mattbucci/Qwen3-Coder-30B-A3B-REAM-AWQ

23B • Updated May 9 • 17

mattbucci/gemma-4-31B-AWQ

31B • Updated May 31 • 266

LJTSG/webgpu-for-amd-ai-pcs

Updated Jun 3 • 1

djdeniro/MiniMax-M2.7-MXFP416

Text Generation • 130B • Updated Jun 9 • 36

Capicua25x/Qwen3.6-35B-A3B-DSV4Pro-Thinking-Distill-MXFP4

Text Generation • 35B • Updated Jun 17 • 12

Capicua25x/Qwen3.6-35B-A3B-DSV4Pro-Thinking-Distill-MXFP4-Vision

Image-Text-to-Text • 35B • Updated Jun 17 • 38

Launch80/Qwen3.6_27B-RFP458

Text Generation • 17B • Updated Jun 25 • 13 • 2

maczzinatui/Ornith-1.0-9b-ROCmFPX-STRIX_LEAN-GGUF

9B • Updated Jun 29 • 49

maczzinatui/Qwen3.6-14B-A3B-vibetuned-ROCmFPX-STRIX_LEAN-GGUF

14B • Updated Jun 29 • 1.93k • 1

maczzinatui/GLM-4.7-Flash-REAP-23B-A3B-ROCmFPX-STRIX_LEAN-GGUF

23B • Updated Jun 29 • 66 • 1

maczzinatui/Ornstein-3.5-9B-V2-ROCmFPX-STRIX_LEAN-GGUF

9B • Updated Jun 29 • 22

Capicua25x/Ornith-1.0-9B-MXFP4-Vision-MTP

Image-Text-to-Text • 10B • Updated Jul 14 • 31 • 2