# Qwen embedding mode inference does not work

**URL:** <https://discuss.huggingface.co/t/qwen-embedding-mode-inference-does-not-work/161372>\
**Category:** Site Feedback\
**Created:** [July 1, 2025, 6:13pm UTC](https://discuss.huggingface.co/t/qwen-embedding-mode-inference-does-not-work/161372 "2025-07-01T18:13:40Z")\
**Posts on this page:** 6\
**Page:** 1

<div class="post-metadata">

**Author:** ![drawal-rl](https://avatars.discourse-cdn.com/v4/letter/d/ba8739/32.png) [@drawal-rl](https://discuss.huggingface.co/u/drawal-rl)\
**Post date:** [July 1, 2025, 6:13pm UTC](https://discuss.huggingface.co/t/qwen-embedding-mode-inference-does-not-work/161372/1 "2025-07-01T18:13:40Z")

</div>

Tried the Qwen embedding 8B with Nebius. Get errors!

---

<div class="post-metadata">

**Author:** ![John6666](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/john6666/32/27664_2.png) [@John6666](https://discuss.huggingface.co/u/John6666)\
**Post date:** [July 1, 2025, 8:22pm UTC](https://discuss.huggingface.co/t/qwen-embedding-mode-inference-does-not-work/161372/2 "2025-07-01T20:22:37Z")

</div>

Hmm… Seems just not deployed…?

> **[Qwen/Qwen3-Embedding-8B · Hugging Face](https://huggingface.co/Qwen/Qwen3-Embedding-8B)**
>
> We’re on a journey to advance and democratize artificial intelligence through open source and open science.

---

<div class="post-metadata">

**Author:** ![drawal-rl](https://avatars.discourse-cdn.com/v4/letter/d/ba8739/32.png) [@drawal-rl](https://discuss.huggingface.co/u/drawal-rl)\
**Post date:** [July 1, 2025, 9:54pm UTC](https://discuss.huggingface.co/t/qwen-embedding-mode-inference-does-not-work/161372/3 "2025-07-01T21:54:58Z")

</div>

I was using Nebius as the inference provider. Do I still have to deploy??

---

<div class="post-metadata">

**Author:** ![John6666](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/john6666/32/27664_2.png) [@John6666](https://discuss.huggingface.co/u/John6666)\
**Post date:** [July 1, 2025, 10:29pm UTC](https://discuss.huggingface.co/t/qwen-embedding-mode-inference-does-not-work/161372/4 "2025-07-01T22:29:11Z")

</div>

Oh. True. But seems working…?

 ![nebius1](https://us1.discourse-cdn.com/hellohellohello/original/3X/0/9/098e76190615d7be7d550ce27d3419851e88696d.png)

---

<div class="post-metadata">

**Author:** ![drawal-rl](https://avatars.discourse-cdn.com/v4/letter/d/ba8739/32.png) [@drawal-rl](https://discuss.huggingface.co/u/drawal-rl)\
**Post date:** [July 2, 2025, 1:51am UTC](https://discuss.huggingface.co/t/qwen-embedding-mode-inference-does-not-work/161372/5 "2025-07-02T01:51:11Z")

</div>

Does not work when I use the sample code

---

<div class="post-metadata">

**Author:** ![John6666](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/john6666/32/27664_2.png) [@John6666](https://discuss.huggingface.co/u/John6666)\
**Post date:** [July 2, 2025, 7:05am UTC](https://discuss.huggingface.co/t/qwen-embedding-mode-inference-does-not-work/161372/6 "2025-07-02T07:05:18Z")

</div>

Hmm… How about updating library?

```auto
pip install -U huggingface_hub

```