Youssofal/MiMo-V2.6-Qwen-9B-MTPLX-Optimized-Speed

MTPLX: the fastest way to run MiMo-V2.6-Distill-Qwen-9B on a Mac. Native multi-token-prediction speculative decoding on Apple Silicon, exact at any temperature.

MiMo V2.6 Qwen 9B Optimized Speed

6-bit quantization. Xiaomi's agentic coding distill of Qwen 3.5 9B.

Xiaomi MiMo retrained Qwen 3.5 9B for coding, agent work, visual coding and security tasks, and the result is a big step up from the model it started from. This pack runs it on MTPLX with a multi-token-prediction head drafting ahead, on any Apple Silicon Mac with 16 GB or more.

Available from MTPLX 2.12.0. The Mac app lists it, and on M3, M4 and M5 Macs with 16 to 31 GB it is the second suggestion, right after Bonsai 2 27B.

Why this model

This is the MiMo-V2.6-Distill-Qwen-9B MLX pack for MTPLX, the fastest way to run MiMo V2.6 on a Mac. Xiaomi's results against the Qwen 3.5 9B it started from, from Xiaomi's model card:

Benchmark	Qwen3.5-9B	MiMo-V2.6-Distill-Qwen-9B
SWE Pro	32.0	44.6
Terminal Bench 2.1	27.0	37.1
Toolathlon-Verified	25.9	35.2
SWE Verified	60.0	61.1

Same size as Qwen 3.5 9B, a much stronger coding and agent model.

How it is built

• 6-bit quantization with 64-weight groups across the model, the recipe of our Qwen 3.5 9B Optimized Speed. Against the full-precision model it keeps 97.3 percent top-1 agreement, with a KL divergence of 0.0054.
• The Qwen 3.5 9B multi-token-prediction head drafts ahead, and the full model verifies its drafts in one pass.

Download	8.7 GB
Peak while serving	8.7 GiB at a 15K-token context
Recommended Macs	16 GB+ unified memory (18 GB+ for agent clients such as OpenCode)
Context window	20,480 tokens on 16 GB, 45,056 on 18 GB, 192,512 on 24 GB, up to 262,144
MTP depth	2
Sampling	temperature 0.6, top-p 0.95, top-k 20 (Xiaomi's settings)

The serving contract ships inside mtplx_runtime.json. MTPLX reads it on load. Drafts are accepted with the probability-ratio rule plus residual resampling, so the output follows the model's own distribution at any temperature.

Use it

Mac app (MTPLX 2.12.0 or later): download at mtplx.com, pick "MiMo V2.6 Qwen 9B Optimized Speed".

Command line (MTPLX 2.12.0 or later):

pip install mtplx
mtplx serve --model Youssofal/MiMo-V2.6-Qwen-9B-MTPLX-Optimized-Speed

Siblings: Qwen 3.5 9B Optimized Speed and Bonsai 2 27B Optimized Speed (a 27B-class model in about the same memory).

Base model: XiaomiMiMo/MiMo-V2.6-Distill-Qwen-9B (MIT), a fine-tune of Qwen/Qwen3.5-9B (Apache 2.0), whose draft head this pack uses.