Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

28

Base only

Active filters: gemma-4-12b

mlx-community/gemma-4-12B-it-qat-assistant-4bit

Text Generation • 0.4B • Updated Jun 5 • 618 • 3

mlx-community/gemma-4-12B-it-qat-assistant-5bit

Text Generation • 0.4B • Updated Jun 5 • 57

mlx-community/gemma-4-12B-it-qat-assistant-8bit

Text Generation • 0.4B • Updated Jun 5 • 104

mlx-community/gemma-4-12B-it-qat-assistant-6bit

Text Generation • 0.4B • Updated Jun 5 • 62

mlx-community/gemma-4-12B-it-qat-assistant-bf16

Text Generation • 0.4B • Updated Jun 5 • 89

mlx-community/gemma-4-12B-it-qat-assistant-mxfp4

Text Generation • 0.4B • Updated Jun 5 • 68

mlx-community/gemma-4-12B-it-qat-assistant-nvfp4

Text Generation • 0.4B • Updated Jun 5 • 71

mlx-community/gemma-4-12B-it-qat-assistant-mxfp8

Text Generation • 0.4B • Updated Jun 5 • 55

toandev/Gemma4-12B-Uncensored

Any-to-Any • 12B • Updated Jun 11 • 105 • 3

toandev/Gemma4-12B-Uncensored-GGUF

Image-Text-to-Text • 12B • Updated Jun 11 • 779 • 2

mradermacher/Gemma4-12B-Uncensored-GGUF

Image-Text-to-Text • 12B • Updated Jun 12 • 1.01k • 1

mradermacher/Gemma4-12B-Uncensored-i1-GGUF

Image-Text-to-Text • 12B • Updated Jul 3 • 2.61k • 1

naazimsnh02/FabGemma

Text Generation • 12B • Updated Jun 18 • 49 • 5

mradermacher/FabGemma-GGUF

12B • Updated Jun 18 • 407 • 1

mradermacher/FabGemma-i1-GGUF

12B • Updated Jul 3 • 1.72k • 1

Mungus451/Gemma4-12b-Svelte5-Assistant

Text Generation • Updated Jun 19 • 2

sequelbox/gemma-4-12B-it-Tachibana-Agent

Any-to-Any • 12B • Updated Aug 19 • 49 • 4

ValiantLabs/gemma-4-12B-it-Esper4

Image-Text-to-Text • 12B • Updated Aug 25 • 65 • 14

ValiantLabs/gemma-4-12B-it-Guardpoint

Image-Text-to-Text • 12B • Updated Jul 15 • 43 • 5

mradermacher/gemma-4-12B-it-Esper4-GGUF

12B • Updated Jul 16 • 1.03k • 3

mradermacher/gemma-4-12B-it-Guardpoint-GGUF

12B • Updated Jul 16 • 729 • 3

mradermacher/gemma-4-12B-it-Esper4-i1-GGUF

12B • Updated Jul 16 • 1.71k • 1

mradermacher/gemma-4-12B-it-Guardpoint-i1-GGUF

12B • Updated Jul 16 • 1.67k • 3

mradermacher/gemma-4-12B-it-Tachibana-Agent-GGUF

12B • Updated Jul 17 • 770 • 3

mradermacher/gemma-4-12B-it-Tachibana-Agent-i1-GGUF

12B • Updated Jul 17 • 2.46k • 2

bartowski/ValiantLabs_gemma-4-12B-it-Esper4-GGUF

Any-to-Any • 12B • Updated Jul 20 • 2.3k • 1

QUASAR-QAT/gemma-4-12B-it-QUASAR-Q4_0-GGUF

Image-Text-to-Text • 12B • Updated 16 days ago • 1.45k • 4

QUASAR-QAT/gemma-4-12B-it-QUASAR-W4A16-G64

Any-to-Any • 12B • Updated 20 days ago • 104 • 1