Instructions to use onnx-community/DeepSeek-R1-Distill-Qwen-1.5B-ONNX with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers.js
How to use onnx-community/DeepSeek-R1-Distill-Qwen-1.5B-ONNX with Transformers.js:
// npm i @huggingface/transformers import { pipeline } from '@huggingface/transformers'; // Allocate pipeline const pipe = await pipeline('text-generation', 'onnx-community/DeepSeek-R1-Distill-Qwen-1.5B-ONNX');
Almost all dtype conversions are not working! Something wrong with the conversion?
2
#12 opened over 1 year ago
by
AxolsWebAI
Running issue: when running the model as the steps of the model card
#11 opened almost 2 years ago
by
buyiasd
Mismatchs in model.onnx
#10 opened almost 2 years ago
by
Runnerman
How to run this model on mobile device
5
#9 opened almost 2 years ago
by
sadaqathunzai
NVIDIA Triton Inference Server Compatibility?
#8 opened almost 2 years ago
by
RohanAdwankar
Missing file when using q4f16, q4, int8, uint8, and others via transformers.js
#7 opened almost 2 years ago
by
sroussey
Compatibility with transformers in Python
#6 opened almost 2 years ago
by
Fractalapps
q4f16 ONXX model issue
4
#5 opened almost 2 years ago
by
mrniamster