majentik/gemma-4-26B-A4B-it-RotorQuant-GGUF-IQ4_XS
Image-Text-to-Text • 25B • Updated • 392
Gemma 4 — quantized (GGUF + MLX)
Quantized GGUF and MLX packs of the Gemma 4 family (dense and MoE variants) for local inference.
-
-
majentik/gemma-4-26B-A4B-it-RotorQuant-GGUF-Q2_K
Image-Text-to-Text • 25B • Updated • 205 -
majentik/gemma-4-26B-A4B-it-RotorQuant-GGUF-Q3_K_M
Image-Text-to-Text • 25B • Updated • 159 -
majentik/gemma-4-26B-A4B-it-RotorQuant-GGUF-Q4_K_M
Image-Text-to-Text • 25B • Updated • 250 • 1 -
majentik/gemma-4-26B-A4B-it-RotorQuant-GGUF-Q5_K_M
Image-Text-to-Text • 25B • Updated • 216 -
majentik/gemma-4-26B-A4B-it-RotorQuant-GGUF-Q8_0
Image-Text-to-Text • 25B • Updated • 134 • 1 -
majentik/gemma-4-26B-A4B-it-RotorQuant-MLX-2bit
Image-Text-to-Text • 26B • Updated • 214 -
majentik/gemma-4-26B-A4B-it-RotorQuant-MLX-4bit
Image-Text-to-Text • 26B • Updated • 146 -
majentik/gemma-4-26B-A4B-it-RotorQuant-MLX-8bit
Image-Text-to-Text • 26B • Updated • 165 • 1 -
majentik/gemma-4-26B-A4B-RotorQuant-GGUF-IQ4_XS
Image-Text-to-Text • 25B • Updated • 361 -
majentik/gemma-4-26B-A4B-RotorQuant-GGUF-Q2_K
Image-Text-to-Text • 25B • Updated • 155 -
majentik/gemma-4-26B-A4B-RotorQuant-GGUF-Q3_K_M
Image-Text-to-Text • 25B • Updated • 513 -
majentik/gemma-4-26B-A4B-RotorQuant-GGUF-Q4_K_M
Image-Text-to-Text • 25B • Updated • 546 • 5 -
majentik/gemma-4-26B-A4B-RotorQuant-GGUF-Q5_K_M
Image-Text-to-Text • 25B • Updated • 150 -
majentik/gemma-4-26B-A4B-RotorQuant-GGUF-Q8_0
Image-Text-to-Text • 25B • Updated • 102 -
majentik/gemma-4-26B-A4B-RotorQuant-MLX-2bit
Image-Text-to-Text • 26B • Updated • 160 -
majentik/gemma-4-26B-A4B-RotorQuant-MLX-4bit
Image-Text-to-Text • 26B • Updated • 62 -
majentik/gemma-4-26B-A4B-RotorQuant-MLX-8bit
Image-Text-to-Text • 26B • Updated • 55 -
majentik/gemma-4-31B-it-RotorQuant-GGUF-IQ4_XS
Image-Text-to-Text • 31B • Updated • 334 -
majentik/gemma-4-31B-it-RotorQuant-GGUF-Q2_K
Image-Text-to-Text • 31B • Updated • 113 -
majentik/gemma-4-31B-it-RotorQuant-GGUF-Q3_K_M
Image-Text-to-Text • 31B • Updated • 119 -
majentik/gemma-4-31B-it-RotorQuant-GGUF-Q4_K_M
Image-Text-to-Text • 31B • Updated • 96 -
majentik/gemma-4-31B-it-RotorQuant-GGUF-Q5_K_M
Image-Text-to-Text • 31B • Updated • 229 -
majentik/gemma-4-31B-it-RotorQuant-GGUF-Q8_0
Image-Text-to-Text • 31B • Updated • 103 • 1 -
majentik/gemma-4-31B-it-RotorQuant-MLX-2bit
Image-Text-to-Text • 31B • Updated • 98 -
majentik/gemma-4-31B-it-RotorQuant-MLX-4bit
Image-Text-to-Text • 31B • Updated • 122 • 2 -
majentik/gemma-4-31B-it-TurboQuant-MLX-8bit
Image-Text-to-Text • 31B • Updated • 186 • 3 -
majentik/gemma-4-31B-RotorQuant-GGUF-IQ4_XS
Image-Text-to-Text • 31B • Updated • 357 -
majentik/gemma-4-31B-RotorQuant-GGUF-Q2_K
Image-Text-to-Text • 31B • Updated • 101 -
majentik/gemma-4-31B-RotorQuant-GGUF-Q3_K_M
Image-Text-to-Text • 31B • Updated • 87 -
majentik/gemma-4-31B-RotorQuant-GGUF-Q4_K_M
Image-Text-to-Text • 31B • Updated • 104 -
majentik/gemma-4-31B-RotorQuant-GGUF-Q5_K_M
Image-Text-to-Text • 31B • Updated • 131 -
majentik/gemma-4-31B-RotorQuant-GGUF-Q8_0
Image-Text-to-Text • 31B • Updated • 98 • 1 -
majentik/gemma-4-31B-TurboQuant-MLX-2bit
Image-Text-to-Text • 31B • Updated • 116 • 1 -
majentik/gemma-4-31B-TurboQuant-MLX-4bit
Image-Text-to-Text • 31B • Updated • 152 • 2 -
majentik/gemma-4-31B-TurboQuant-MLX-8bit
Image-Text-to-Text • 31B • Updated • 105 • 1 -
majentik/gemma-4-E2B-it-RotorQuant-GGUF-IQ4_XS
Image-Text-to-Text • 5B • Updated • 346 • 1 -
majentik/gemma-4-E2B-it-RotorQuant-GGUF-Q2_K
Image-Text-to-Text • 5B • Updated • 141 -
majentik/gemma-4-E2B-it-RotorQuant-GGUF-Q3_K_M
Image-Text-to-Text • 5B • Updated • 101 -
majentik/gemma-4-E2B-it-RotorQuant-GGUF-Q4_K_M
Image-Text-to-Text • 5B • Updated • 153 • 2 -
majentik/gemma-4-E2B-it-RotorQuant-GGUF-Q5_K_M
Image-Text-to-Text • 5B • Updated • 114 • 2 -
majentik/gemma-4-E2B-it-RotorQuant-GGUF-Q8_0
Image-Text-to-Text • 5B • Updated • 213 • 2 -
majentik/gemma-4-E2B-it-RotorQuant-MLX-2bit
Image-Text-to-Text • 5B • Updated • 91 -
majentik/gemma-4-E2B-it-RotorQuant-MLX-4bit
Image-Text-to-Text • 5B • Updated • 80 • 1 -
majentik/gemma-4-E2B-it-TurboQuant-MLX-8bit
Image-Text-to-Text • 5B • Updated • 112