will

willfalco's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

New activity in syntheticlab/Kimi-K2.5-NVFP4A16 about 11 hours ago

6 x RTX 6000?

#1 opened about 11 hours ago by

willfalco

New activity in lukealonso/GLM-5-NVFP4 about 14 hours ago

Possible to run on six RTX Pro 6000 Blackwell with vLLM oder SGLang?

👍 2

5

#2 opened 7 days ago by

FabianHeller

New activity in INC4AI/GLM-5-int4-mixed-AutoRound 6 days ago

SGLang startup errors

4

#1 opened 12 days ago by

fpjnijweide

New activity in XiaomiMiMo/MiMo-V2-Flash 2 months ago

Great Model! - sglang mtp support for triton backend

👍 3

4

#19 opened 2 months ago by

chriswritescode

New activity in QuantTrio/DeepSeek-V3.1-AWQ-Lite 2 months ago

[request] DeepSeek-V3.1-Terminus

4

#3 opened 2 months ago by

willfalco

New activity in lukealonso/MiniMax-M2-NVFP4 2 months ago

you know which nightly it worked with? because it does not with current one

31

#1 opened 3 months ago by

willfalco

New activity in QuantTrio/DeepSeek-V3.1-AWQ-Lite 2 months ago

random atrifacts on larger outputs

2

#4 opened 2 months ago by

willfalco

New activity in Firworks/INTELLECT-3-nvfp4 3 months ago

is NVFP4 supported on sm120 (blackwell rtx pro 6000, rtx 5090 etc)?

10

#4 opened 3 months ago by

Fernanda24

New activity in tencent/DeepSeek-V3.1-Terminus-W4AFP8 3 months ago

4 x RTX PRO 6000

👍 1

2

#1 opened 3 months ago by

willfalco

New activity in eousphoros/DeepSeek-V3.2-NVFP4 3 months ago

Is it possible to make smaller NVFP4 quant at 340-360GB to fit in 4x96gb?

👍 1

68

#1 opened 3 months ago by

Fernanda24

New activity in Intel/DeepSeek-V3.1-Terminus-int4-mixed-AutoRound 3 months ago

Question will it work in vllm or sglang with rtx 6000 blackwells? cuda arch sm120

6

#1 opened 4 months ago by

Fernanda24

New activity in QuantTrio/DeepSeek-V3.1-AWQ-Lite 3 months ago

ooof this fits in 4x96gb can we get this for the new 3.2 Speciale ase well please :)

16

#2 opened 3 months ago by

Fernanda24

New activity in QuantTrio/DeepSeek-V3.2-AWQ 3 months ago

Aww Man!

20

#1 opened 3 months ago by

mtcl

New activity in QuantTrio/DeepSeek-V3.2-Exp-AWQ-Lite 3 months ago

anyone ran this on blackwell?

🔥 1

#2 opened 3 months ago by

willfalco

New activity in lukealonso/MiniMax-M2-NVFP4 3 months ago

you know which nightly it worked with? because it does not with current one

31

#1 opened 3 months ago by

willfalco

you know which nightly it worked with? because it does not with current one

31

#1 opened 3 months ago by

willfalco