How to launch (Apple Silicon / MLX)

python3 -m venv .venv
source .venv/bin/activate
pip install "dflash[local] @ git+https://github.com/z-lab/dflash.git@07ebd93db9f472af339b644bb70221ad8428328a"

dflash generate mlx "Write a Python function that checks whether a string is a palindrome." \
  --model vvsotnikov/Qwen3.8-27B-test-MLX-4bit \
  --draft vvsotnikov/Qwen3.8-27B-test-DFlash2-v0.3 \
  --draft-bits 4 --block-size 8 \
  --reasoning low --temperature 1.0 --top-p 0.95 --top-k 20 \
  --max-new-tokens 256

Use with the target above, not vanilla Qwen. This repository contains BF16 draft weights; --draft-bits 4 quantizes the drafter at load time.

Downloads last month: 72

Safetensors

Model size

2B params

Tensor type

BF16

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for vvsotnikov/Qwen3.8-27B-test-DFlash2-v0.3

Finetunes

2 models

Quantizations

1 model