cpatonn
/

Qwen3-Next-80B-A3B-Instruct-AWQ-4bit

Text Generation

compressed-tensors

Model card Files Files and versions

Resources

View closed (0)

Did anyone get speculative decode working?

#10 opened 3 days ago by

Successfully Running Qwen3-Next-80B-A3B-Instruct-AWQ-4bit on 3x RTX 3090s

#9 opened 13 days ago by

sorta works on vllm now

#8 opened 26 days ago by

Recent update throws error: KeyError: 'layers.30.mlp.shared_expert.down_proj.weight'

#7 opened 28 days ago by

gibberish still persists?

#6 opened about 1 month ago by

MTP Accepted throughput always at 0.00 tokens/s

#5 opened about 1 month ago by

Experiencing excessive response latency.

#4 opened about 1 month ago by

Does this quantized version support running on machines like V100 and V100S?

#3 opened about 1 month ago by

Error on inputting lots of prompts

#2 opened about 1 month ago by

Error when running in VLLM

#1 opened about 1 month ago by