Instructions to use Qwen/Qwen3-Coder-Next with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use Qwen/Qwen3-Coder-Next with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="Qwen/Qwen3-Coder-Next") messages = [ {"role": "user", "content": "Who are you?"}, ] pipe(messages)# Load model directly from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("Qwen/Qwen3-Coder-Next") model = AutoModelForCausalLM.from_pretrained("Qwen/Qwen3-Coder-Next") messages = [ {"role": "user", "content": "Who are you?"}, ] inputs = tokenizer.apply_chat_template( messages, add_generation_prompt=True, tokenize=True, return_dict=True, return_tensors="pt", ).to(model.device) outputs = model.generate(**inputs, max_new_tokens=40) print(tokenizer.decode(outputs[0][inputs["input_ids"].shape[-1]:])) - Inference
- HuggingChat
- Notebooks
- Google Colab
- Kaggle
- Local Apps
- vLLM
How to use Qwen/Qwen3-Coder-Next with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "Qwen/Qwen3-Coder-Next" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Qwen/Qwen3-Coder-Next", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/Qwen/Qwen3-Coder-Next
- SGLang
How to use Qwen/Qwen3-Coder-Next with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "Qwen/Qwen3-Coder-Next" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Qwen/Qwen3-Coder-Next", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "Qwen/Qwen3-Coder-Next" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Qwen/Qwen3-Coder-Next", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }' - Docker Model Runner
How to use Qwen/Qwen3-Coder-Next with Docker Model Runner:
docker model run hf.co/Qwen/Qwen3-Coder-Next
Any news on the next iteration of Qwen3-Coder?
π₯ 3
#48 opened 22 days ago
by
bsarpel
KV CACHE
#47 opened 27 days ago
by
Indrajeet040
Request: DOI
#46 opened 28 days ago
by
Tanakagee123
Code generation for agentic workflows
π₯ 1
#45 opened about 2 months ago
by
O96a
Add link to paper
#44 opened 2 months ago
by
nielsr
Add evaluation results
#43 opened 2 months ago
by
nielsr
Install & run Qwen/Qwen3-Coder-Next easily using llmpm
π₯ 1
#42 opened 2 months ago
by
sarthak-saxena
Add link to technical report and improve metadata
β€οΈ 1
#41 opened 3 months ago
by
nielsr
Amazing , it works with open claw
2
#39 opened 3 months ago
by
infinityai
fix error: No module named 'vllm.entrypoints.openai.protocol', which is cause by refactor of the upstream VLLM project
#37 opened 3 months ago
by
bigmao2012
Qwen3-Coder-Nextε 载樑εθͺεΈ¦ηqwen3coder_tool_parser_vllm.pyοΌζ₯ιNo module named 'vllm.entrypoints.openai.protocol'
1
#36 opened 3 months ago
by
bigmao2012
SVG improve needed
#35 opened 3 months ago
by
kq
[WORKING] Enable Reasoning/Thinking for Qwen3-Coder-Next
β€οΈπ 6
#34 opened 3 months ago
by
evilperson068
Works perfectly
#33 opened 3 months ago
by
rchmd
Upload 2 files
#32 opened 3 months ago
by
Grizzzlittle
Create ai model
#30 opened 3 months ago
by
SPORstudio
License Qwen3-Coder-Next?
1
#29 opened 3 months ago
by
originx
Qwen3-Coder-Next-Hybrid-GGUF
#27 opened 3 months ago
by
gopi87
Good Job
π 1
1
#26 opened 3 months ago
by
akmam86
AI IS THE FUTURE
1
#25 opened 3 months ago
by
julvina05
Update README.md
1
#24 opened 3 months ago
by
Kkhjj
Create TEST
#23 opened 3 months ago
by
Kkhjj
Update README.md
#22 opened 3 months ago
by
Kkhjj
Zero GPU or H200
3
#21 opened 3 months ago
by
rahul7star
where is 3.5
#20 opened 3 months ago
by
Simon716
Discuss About Me
3
#18 opened 3 months ago
by
Xnclair
recommended vllm tool call parser?
π 1
6
#17 opened 3 months ago
by
lightenup
I find this to be quite interesting π€
3
#16 opened 3 months ago
by
Anon7272728472
local setup with a coding agent
ππ 6
3
#15 opened 3 months ago
by
lightenup
Very specific json formatting issue in tool calls
β 1
4
#14 opened 3 months ago
by deleted
Guide to Run Qwen3-Coder-Next Locally via GGUF and FP8. π
β€οΈ 6
2
#13 opened 3 months ago
by
danielhanchen
Check in here for tok/s and benchmarks for local gguf models
π₯ 4
#11 opened 3 months ago
by
ykarout
Update README.md
1
#10 opened 3 months ago
by
oql
FIM support?
1
#9 opened 3 months ago
by
homorunner
Cursor ai
1
#8 opened 3 months ago
by
jungheekim
Great for home assistant!
π 1
6
#6 opened 3 months ago
by
ztsvvstz
model with thinking?
β 3
6
#5 opened 3 months ago
by
pypry
Expressing Gratitude. :3
π₯ 7
#4 opened 3 months ago
by
i6od
Installation Video and Testing - Step by Step
β€οΈ 1
1
#3 opened 3 months ago
by
fahdmirzac
Why no mtp layer?
π 5
#2 opened 3 months ago
by
CHNtentes
AWQ quantization
π 1
9
#1 opened 3 months ago
by
dr-e