Christian Otto Stelter PRO

stelterlab's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

New activity in RedHatAI/Qwen3.5-397B-A17B-FP8-dynamic 1 day ago

Which transformer version did you use?

#3 opened 1 day ago by

stelterlab

New activity in stelterlab/NVIDIA-Nemotron-3-Nano-30B-A3B-AWQ 2 days ago

tokenizer_config.json missing chat_template field (tool calling broken without workaround)

1

#1 opened 2 days ago by

seanthomaswilliams

Updated tokenizer_config.json now w/ chat_template included

#2 opened 2 days ago by

stelterlab

updated a model 24 days ago

stelterlab/NVIDIA-Nemotron-3-Nano-30B-A3B-AWQ

Text Generation • 5B • Updated 2 days ago • 25.7k • 3

published a model 25 days ago

stelterlab/NVIDIA-Nemotron-3-Nano-30B-A3B-AWQ

Text Generation • 5B • Updated 2 days ago • 25.7k • 3

New activity in mistralai/Ministral-3-14B-Instruct-2512 3 months ago

NVFP4 / AWQ Quants or llm-compressor recipe

🤗 1

1

#1 opened 3 months ago by

stelterlab

New activity in cyankiwi/Kimi-Linear-48B-A3B-Instruct-AWQ-4bit 3 months ago

vLLM v0.11.1 seems to work, but v0.11.2 fails

👍 ❤️ 2

9

#3 opened 3 months ago by

stelterlab

New activity in cyankiwi/Qwen3-Next-80B-A3B-Instruct-AWQ-4bit 6 months ago

Error when running in VLLM

👍 2

21

#1 opened 6 months ago by

d8rt8v

liked a model 7 months ago

janhq/Jan-v1-4B-GGUF

Text Generation • 4B • Updated Aug 13, 2025 • 12.5k • 138

updated a model 7 months ago

stelterlab/Qwen3-30B-A3B-Instruct-2507-AWQ

Text Generation • 5B • Updated Aug 2, 2025 • 4.34k

published a model 7 months ago

stelterlab/Qwen3-30B-A3B-Instruct-2507-AWQ

Text Generation • 5B • Updated Aug 2, 2025 • 4.34k

updated a model 7 months ago

stelterlab/Qwen3-Coder-30B-A3B-Instruct-AWQ

Text Generation • 5B • Updated Aug 2, 2025 • 39.2k • 4

New activity in stelterlab/Qwen3-Coder-30B-A3B-Instruct-AWQ 7 months ago

Unable to run the model in VLLM: KeyError: 'layers.14.mlp.gate.qweight'

3

#1 opened 7 months ago by

fredericodeveloper

published a model 7 months ago

stelterlab/Qwen3-Coder-30B-A3B-Instruct-AWQ

Text Generation • 5B • Updated Aug 2, 2025 • 39.2k • 4

updated a model 7 months ago

stelterlab/UIGEN-X-32B-0727-AWQ

Text Generation • 33B • Updated Jul 28, 2025 • 10 • 1

published a model 7 months ago

stelterlab/UIGEN-X-32B-0727-AWQ

Text Generation • 33B • Updated Jul 28, 2025 • 10 • 1

New activity in stelterlab/DeepSeek-R1-0528-Qwen3-8B-AWQ 7 months ago

Rope Scaling pre-applied?

6

#1 opened 8 months ago by

the1dv

New activity in mistralai/Mistral-Small-3.2-24B-Instruct-2506 7 months ago

AWQ version

👍 14

13

#8 opened 8 months ago by

celsowm

updated a model 8 months ago

stelterlab/Devstral-Small-2507-FP8

Text Generation • Updated Jul 11, 2025 • 179 • 2

published a model 8 months ago

stelterlab/Devstral-Small-2507-FP8

Text Generation • Updated Jul 11, 2025 • 179 • 2