will

willfalco's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

New activity in turboderp/Qwen3.5-35B-A3B-exl3 1 day ago

vision?

7

#2 opened 8 days ago by

willfalco

New activity in Intel/Qwen3.5-397B-A17B-int4-AutoRound 5 days ago

sglang vllm?

1

#2 opened 5 days ago by

willfalco

New activity in turboderp/Qwen3.5-35B-A3B-exl3 6 days ago

Exl3

1

#1 opened 20 days ago by

mazuj2

New activity in Ex0bit/Kimi-K2.5-PRISM-REAP-530B-A32B 6 days ago

Anyone get this working on 4x RTX 6000 Pro?

👀 2

3

#1 opened 26 days ago by

zenmagnets

New activity in steampunque/Qwen3.5-35B-A3B-MP-GGUF 17 days ago

is it the same as other mixed ones?

1

#1 opened 17 days ago by

willfalco

New activity in GadflyII/Qwen3-Coder-Next-NVFP4 23 days ago

MMLU PRO Benchmark

3

#3 opened about 1 month ago by

sevapru

New activity in syntheticlab/Kimi-K2.5-NVFP4A16 27 days ago

6 x RTX 6000?

#1 opened 27 days ago by

willfalco

New activity in lukealonso/GLM-5-NVFP4 27 days ago

Possible to run on six RTX Pro 6000 Blackwell with vLLM oder SGLang?

👍 3

7

#2 opened about 1 month ago by

FabianHeller

New activity in XiaomiMiMo/MiMo-V2-Flash 3 months ago

Great Model! - sglang mtp support for triton backend

👍 3

4

#19 opened 3 months ago by

chriswritescode

New activity in QuantTrio/DeepSeek-V3.1-AWQ-Lite 3 months ago

[request] DeepSeek-V3.1-Terminus

4

#3 opened 3 months ago by

willfalco

New activity in lukealonso/MiniMax-M2-NVFP4 3 months ago

you know which nightly it worked with? because it does not with current one

31

#1 opened 4 months ago by

willfalco

New activity in QuantTrio/DeepSeek-V3.1-AWQ-Lite 3 months ago

random atrifacts on larger outputs

2

#4 opened 3 months ago by

willfalco

New activity in Firworks/INTELLECT-3-nvfp4 3 months ago

is NVFP4 supported on sm120 (blackwell rtx pro 6000, rtx 5090 etc)?

10

#4 opened 4 months ago by

Fernanda24

New activity in tencent/DeepSeek-V3.1-Terminus-W4AFP8 4 months ago

4 x RTX PRO 6000

👍 1

2

#1 opened 4 months ago by

willfalco

New activity in eousphoros/DeepSeek-V3.2-NVFP4 4 months ago

Is it possible to make smaller NVFP4 quant at 340-360GB to fit in 4x96gb?

👍 1

68

#1 opened 4 months ago by

Fernanda24

New activity in Intel/DeepSeek-V3.1-Terminus-int4-mixed-AutoRound 4 months ago

Question will it work in vllm or sglang with rtx 6000 blackwells? cuda arch sm120

6

#1 opened 5 months ago by

Fernanda24

New activity in QuantTrio/DeepSeek-V3.1-AWQ-Lite 4 months ago

ooof this fits in 4x96gb can we get this for the new 3.2 Speciale ase well please :)

16

#2 opened 4 months ago by

Fernanda24

New activity in QuantTrio/DeepSeek-V3.2-AWQ 4 months ago

Aww Man!

20

#1 opened 4 months ago by

mtcl

New activity in QuantTrio/DeepSeek-V3.2-Exp-AWQ-Lite 4 months ago

anyone ran this on blackwell?

🔥 1

#2 opened 4 months ago by

willfalco

New activity in lukealonso/MiniMax-M2-NVFP4 4 months ago

you know which nightly it worked with? because it does not with current one

31

#1 opened 4 months ago by

willfalco