CPU-Hybrid-MoE

community

AI & ML interests

Quantized MoE models for inference on CPU and hybrid CPU-GPU

updated 4 models 3 months ago

CPU-Hybrid-MoE/MiniMax-M2.7-CPU-NUMA4-AMXINT8

Text Generation • Updated Apr 13 • 12

CPU-Hybrid-MoE/GLM-5.1-CPU-NUMA4-AMXINT8

Text Generation • Updated Apr 13 • 3 • 1

CPU-Hybrid-MoE/GLM-5-CPU-NUMA4-AMXINT8

Text Generation • Updated Apr 13 • 5 • 1

CPU-Hybrid-MoE/MiniMax-M2.5-CPU-NUMA4-AMXINT8

Text Generation • Updated Apr 13 • 6 • 3

published 2 models 3 months ago

CPU-Hybrid-MoE/MiniMax-M2.7-CPU-NUMA4-AMXINT8

Text Generation • Updated Apr 13 • 12

CPU-Hybrid-MoE/GLM-5.1-CPU-NUMA4-AMXINT8

Text Generation • Updated Apr 13 • 3 • 1

updated 2 models 4 months ago

CPU-Hybrid-MoE/DeepSeek-V3.2-CPU-NUMA4-AMXINT8

Text Generation • Updated Mar 24 • 10 • 1

CPU-Hybrid-MoE/DeepSeek-R1-0528-CPU-NUMA4-AMXINT8

Text Generation • Updated Mar 24 • 9

published 3 models 4 months ago

CPU-Hybrid-MoE/DeepSeek-R1-0528-CPU-NUMA4-AMXINT8

Text Generation • Updated Mar 24 • 9

CPU-Hybrid-MoE/DeepSeek-V3.2-CPU-NUMA4-AMXINT8

Text Generation • Updated Mar 24 • 10 • 1

CPU-Hybrid-MoE/GLM-5-CPU-NUMA4-AMXINT8

Text Generation • Updated Apr 13 • 5 • 1

published a model 5 months ago

CPU-Hybrid-MoE/MiniMax-M2.5-CPU-NUMA4-AMXINT8

Text Generation • Updated Apr 13 • 6 • 3

updated 2 models 8 months ago

CPU-Hybrid-MoE/DeepSeek-R1-0528-GPU-FP8-GPTQ4

Text Generation • 678B • Updated Nov 12, 2025 • 4

CPU-Hybrid-MoE/DeepSeek-V3-0324-GPU-FP8-GPTQ4

Text Generation • 678B • Updated Nov 12, 2025 • 8

published a model 9 months ago

CPU-Hybrid-MoE/DeepSeek-R1-0528-GPU-FP8-GPTQ4

Text Generation • 678B • Updated Nov 12, 2025 • 4

updated 2 models 9 months ago

CPU-Hybrid-MoE/DeepSeek-V3-0324-CPU-NUMA4-AMXINT8

Text Generation • Updated Oct 26, 2025 • 6

CPU-Hybrid-MoE/DeepSeek-V3-0324-CPU-NUMA4-AMXINT4

Text Generation • Updated Oct 26, 2025 • 6

updated a model 9 months ago

CPU-Hybrid-MoE/DeepSeek-V3-0324-CPU-NUMA4-AMXINT8

Text Generation • Updated Oct 26, 2025 • 6

published a model 9 months ago

CPU-Hybrid-MoE/DeepSeek-V3-0324-CPU-NUMA4-AMXINT8

Text Generation • Updated Oct 26, 2025 • 6

updated a model 9 months ago

CPU-Hybrid-MoE/DeepSeek-V3-0324-CPU-NUMA4-AMXINT4

Text Generation • Updated Oct 26, 2025 • 6