Siddharth63/Qwen2.5-32B-Instruct-AutoRound-GPTQ-2bit
33B
•
Updated
•
5
Quantised-models
-
-
Siddharth63/Qwen2.5-14B-Instruct-AutoRound-GPTQ-2bit
15B • Updated • 5 -
Siddharth63/Qwen2.5-14B-Instruct-AutoRound-GPTQ-4bit
15B • Updated • 5 -
Siddharth63/Granite-2b-8bits-Autoround-GPTQ-sym
3B • Updated • 3 -
Siddharth63/Granite-8b-4bits-Autoround-GPTQ-sym
8B • Updated • 2 -
Siddharth63/Qwen3-1.7B-8bits-GPTQ-Autoround-sym
2B • Updated • 7 -
Siddharth63/Qwen3-1.7B-8bits-Autoround-sym
0.7B • Updated • 3 -
Siddharth63/Qwen3-1.7B-Base-8bits-Autoround-sym
0.7B • Updated • 2 -
Siddharth63/Qwen3-1.7B-Base-8bits-Autoround-GPTQ-sym
2B • Updated • 8 -
Siddharth63/Qwen3-4B-Base-4bit-Autoround-GPTQ-sym
4B • Updated • 3 -
Siddharth63/Qwen3-4B-Base-4bit-Autoround-sym
0.9B • Updated • 2 -
Siddharth63/Qwen3-4B-Base-4bit-Autoround-asym
0.9B • Updated • 3 -
Siddharth63/Qwen3-4B-base-AWQ
4B • Updated • 7 -
Siddharth63/Qwen3-1.7B-base-AWQ
2B • Updated • 3 -
Siddharth63/Qwen3-8B-Base-AWQ
8B • Updated • 9 -
Siddharth63/Qwen3-8B-Base-4bits-AutoRound-asym
2B • Updated • 5 -
Siddharth63/Qwen3-14B-Base-AWQ
15B • Updated • 16 -
Siddharth63/Qwen3-8B-Base-2bits-AutoRound-GPTQ-sym
8B • Updated • 7 -
Siddharth63/Qwen3-8B-Base-4bits-AutoRound-sym
2B • Updated • 7 -
Siddharth63/Qwen3-8B-Base-2bits-AutoRound-sym
2B • Updated • 6 -
Siddharth63/MiMo-7B-Base-4bit-Autoround-GPTQ-sym
8B • Updated • 4 -
Siddharth63/Qwen3-0.6B-Base-4bits-AutoRound-sym-GPTQ
0.6B • Updated • 4 -
Siddharth63/Qwen3-1.7B-Base-4bits-AutoRound-sym-GPTQ
2B • Updated • 2