Instructions to use starkdmi/Qwen3-Embedding-0.6B-mlx-5bit with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use starkdmi/Qwen3-Embedding-0.6B-mlx-5bit with MLX:
# Download the model from the Hub pip install huggingface_hub[hf_xet] hf download starkdmi/Qwen3-Embedding-0.6B-mlx-5bit --local-dir Qwen3-Embedding-0.6B-mlx-5bit
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- LM Studio
- Atomic Chat
5-bit MLX conversion of Qwen/Qwen3-Embedding-0.6B, licensed under Apache-2.0 as the original.
- Downloads last month
- 163
Model size
0.6B params
Tensor type
U32
ยท
F16 ยท
Hardware compatibility
Log In to add your hardware
Quantized