Henry

hdnh2006's activity

• All
• Models
• Datasets
• Spaces
• Buckets
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

New activity in unsloth/Qwen3.6-27B-NVFP4 4 days ago

Impossible to run in a 5090 with any context window, no even 8192.

#2 opened 4 days ago by

hdnh2006

New activity in RedHatAI/gemma-4-26B-A4B-it-NVFP4 8 days ago

Impossible to deploy using vLLM 0.20.0

2

#6 opened 8 days ago by

hdnh2006

New activity in HauhauCS/Qwen3.6-27B-Uncensored-HauhauCS-Aggressive 20 days ago

safetensor?

👀 3

10

#4 opened 23 days ago by

MRU4913

New activity in Qwen/Qwen3.5-35B-A3B-GPTQ-Int4 2 months ago

Working vLLM setup on RTX 5090 — 194-197 tok/s with image/video

👍🚀 2

5

#3 opened 2 months ago by

8055izham

New activity in unsloth/Qwen3.5-35B-A3B-GGUF 3 months ago

Is there some helpful regex to offload all MoE layers to the CPU?

4

#7 opened 3 months ago by

hdnh2006

New activity in zai-org/GLM-4.7-Flash 4 months ago

Off reasoning

👀 2

4

#56 opened 4 months ago by

kmahdi

New activity in GritLM/GritLM-7B 6 months ago

is it commercial use allowed?

1

#12 opened 6 months ago by

hdnh2006

New activity in Linq-AI-Research/Linq-Embed-Mistral 6 months ago

is it commercial use allowed?

1

#8 opened 6 months ago by

hdnh2006

New activity in nvidia/llama-embed-nemotron-8b 6 months ago

Any plan to upload GGUF models?

1

#11 opened 6 months ago by

hdnh2006

New activity in unsloth/gpt-oss-20b-GGUF 9 months ago

ollama load error

➕👍 8

10

#17 opened 9 months ago by

kwangtek

New activity in BSC-LT/salamandra-7b-instruct 12 months ago

I'm unable to make these models work

🤯 1

#8 opened over 1 year ago by

hdnh2006

New activity in unsloth/Llama-4-Scout-17B-16E-Instruct-unsloth-bnb-4bit about 1 year ago

What is the mininmum VRAM required to deploy this model?

7

#6 opened about 1 year ago by

GradAscend

assert self.quant_method is not None

4

#5 opened about 1 year ago by

Seri0usLee

New activity in unsloth/Qwen2.5-VL-72B-Instruct-unsloth-bnb-4bit about 1 year ago

Does the model support inference deployment using VLLM?

2

#1 opened about 1 year ago by

classdemo

New activity in deepseek-ai/deepseek-vl2-small over 1 year ago

прочитай что написано

5

#2 opened over 1 year ago by

anikiss4

New activity in BSC-LT/salamandra-7b-instruct over 1 year ago

Recommended ollama modelfile to install?

3

#7 opened over 1 year ago by

arivero

New activity in BSC-LT/salamandra-2b-instruct over 1 year ago

issues to convert to GGUF

7

#2 opened over 1 year ago by

robbiemu

New activity in BSC-LT/salamandra-7b-instruct over 1 year ago

ggufing it

2

#1 opened over 1 year ago by

KnutJaegersberg

How to prompt this model for its (initial) translation task?

2

#5 opened over 1 year ago by

alexcardo

New activity in Deci/DeciLM-7B-instruct over 2 years ago

Can you add chat template to the `tokenizer_config.json`file?

5

#3 opened over 2 years ago by

hdnh2006