Henry

hdnh2006's activity

• All
• Models
• Datasets
• Spaces
• Buckets
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

updated a model 1 day ago

NeuralNet-Hub/Qwen3.6-35B-A3B-NVFP4

21B • Updated 1 day ago • 87

published a model 2 days ago

NeuralNet-Hub/Qwen3.6-35B-A3B-NVFP4

21B • Updated 1 day ago • 87

New activity in unsloth/Qwen3.6-27B-NVFP4 3 days ago

Impossible to run in a 5090 with any context window, no even 8192.

#2 opened 3 days ago by

hdnh2006

liked a model 4 days ago

RedHatAI/Qwen3.5-122B-A10B-NVFP4

71B • Updated Apr 3 • 103k • 41

New activity in RedHatAI/gemma-4-26B-A4B-it-NVFP4 8 days ago

Impossible to deploy using vLLM 0.20.0

2

#6 opened 8 days ago by

hdnh2006

New activity in HauhauCS/Qwen3.6-27B-Uncensored-HauhauCS-Aggressive 20 days ago

safetensor?

👀 3

10

#4 opened 23 days ago by

MRU4913

updated a model 2 months ago

hdnh2006/BSC-LT-salamandra-7b-instruct-gguf

Text Generation • 8B • Updated Mar 11 • 220 • 2

New activity in Qwen/Qwen3.5-35B-A3B-GPTQ-Int4 2 months ago

Working vLLM setup on RTX 5090 — 194-197 tok/s with image/video

👍🚀 2

5

#3 opened 2 months ago by

8055izham

New activity in unsloth/Qwen3.5-35B-A3B-GGUF 3 months ago

Is there some helpful regex to offload all MoE layers to the CPU?

4

#7 opened 3 months ago by

hdnh2006

New activity in zai-org/GLM-4.7-Flash 4 months ago

Off reasoning

👀 2

4

#56 opened 4 months ago by

kmahdi

New activity in GritLM/GritLM-7B 6 months ago

is it commercial use allowed?

1

#12 opened 6 months ago by

hdnh2006

New activity in Linq-AI-Research/Linq-Embed-Mistral 6 months ago

is it commercial use allowed?

1

#8 opened 6 months ago by

hdnh2006

New activity in nvidia/llama-embed-nemotron-8b 6 months ago

Any plan to upload GGUF models?

1

#11 opened 6 months ago by

hdnh2006

New activity in unsloth/gpt-oss-20b-GGUF 9 months ago

ollama load error

➕👍 8

10

#17 opened 9 months ago by

kwangtek

New activity in BSC-LT/salamandra-7b-instruct 12 months ago

I'm unable to make these models work

🤯 1

#8 opened over 1 year ago by

hdnh2006

updated 2 models 12 months ago

hdnh2006/DeepSeek-R1-Distill-Qwen-1.5B-GGUF

Text Generation • 2B • Updated Jun 2, 2025 • 201 • 3

hdnh2006/BSC-LT-salamandra-2b-instruct-gguf

Text Generation • 2B • Updated Jun 2, 2025 • 80 • 2

New activity in unsloth/Llama-4-Scout-17B-16E-Instruct-unsloth-bnb-4bit about 1 year ago

What is the mininmum VRAM required to deploy this model?

7

#6 opened about 1 year ago by

GradAscend

assert self.quant_method is not None

4

#5 opened about 1 year ago by

Seri0usLee

New activity in unsloth/Qwen2.5-VL-72B-Instruct-unsloth-bnb-4bit about 1 year ago

Does the model support inference deployment using VLLM?

2

#1 opened about 1 year ago by

classdemo