ParoQuant: Pairwise Rotation Quantization for Efficient Reasoning LLM Inference
Paper
• 2511.10645 • Published
• 6
ParoQuant
Pairwise Rotation Quantization for Efficient Reasoning LLM Inference
-
-
z-lab/Qwen3.5-4B-PARO
1B • Updated • 103 • 1 -
z-lab/Qwen3.5-0.8B-PARO
Image-Text-to-Text • 0.4B • Updated • 65 -
z-lab/Qwen3.5-2B-PARO
1B • Updated • 4 -
z-lab/Qwen3.5-9B-PARO
3B • Updated • 4 -
z-lab/Qwen3-8B-PARO
Text Generation • 1B • Updated • 990 -
z-lab/Qwen3-4B-PARO
Text Generation • 0.9B • Updated • 242 -
z-lab/Qwen3-0.6B-PARO
0.2B • Updated • 61 -
z-lab/Qwen3-1.7B-PARO
Text Generation • 0.5B • Updated -
z-lab/Qwen3-14B-PARO
Text Generation • 2B • Updated • 4 -
z-lab/Qwen3-4B-Thinking-2507-PARO
1B • Updated • 7 -
z-lab/Llama-3.1-8B-Instruct-PARO
Text Generation • 1B • Updated -
z-lab/Meta-Llama-3-8B-PARO
1B • Updated • 3 -
z-lab/Llama-2-7b-hf-PARO
Text Generation • 1B • Updated -
z-lab/DeepSeek-R1-Distill-Llama-8B-PARO
1B • Updated • 1 -
z-lab/paroquant-checkpoints
Updated