Hyun9junn/Llama-2-7b-hf-W4A4KV4-FlatQuant
4B • Updated • 17
Edit Models filters
Model Tree
Apps
Inference Providers
One-click Deployment
Models
15
Active filters: flatquant
Hyun9junn/Meta-Llama-3-8B-W4A4KV4-FlatQuant
5B • Updated • 22
Hyun9junn/Meta-Llama-3-8B-Instruct-W4A4KV4-FlatQuant
5B • Updated • 23
Hyun9junn/Llama-3.1-8B-Instruct-W4A4KV4-FlatQuant
5B • Updated • 175
Hyun9junn/Llama-3.3-70B-Instruct-W4A4KV4-FlatQuant
36B • Updated • 13
Hyun9junn/Meta-Llama-3-70B-W4A4KV4-FlatQuant
36B • Updated • 14
Hyun9junn/Llama-3.1-8B-W4A4KV4-FlatQuant
5B • Updated • 15
Hyun9junn/Llama-3.1-70B-Instruct-W4A4KV4-FlatQuant
36B • Updated • 7
Hyun9junn/EXAONE-4.5-33B-FlatQuant-W4A16
Image-Text-to-Text • 7B • Updated • 11
mesiu650/GR00T-N1.6-LIBERO-llm-w4a4-flatquant-tf32
Updated • 7
ewin-reg/WeMM-Embedding-2B-GGUF
Feature Extraction • 2B • Updated • 1.23k • 2
chiruan/Qwen3-4B-RECAP-W4A4KV4-Prefix12K
Text Generation • 4B • Updated • 284
chiruan/DeepSeek-R1-Distill-Qwen-1.5B-FlatQuant-Prefix12K-W4A8KV4
Text Generation • 2B • Updated • 250
chiruan/DeepSeek-R1-Distill-Qwen-1.5B-FlatQuant-W4A8KV4
Text Generation • 2B • Updated • 358
chris320211/flatquant-phi3-mini-4k-g52xlarge
Text Generation • Updated • 554