This collection contains SINQ GGUF models
AI & ML interests
None defined yet.
Recent Activity
View all activity
Papers
SINQ: Sinkhorn-Normalized Quantization for Calibration-Free Low-Precision LLM Weights
Top-Theta Attention: Sparsifying Transformers by Compensated Thresholding
models 22
huawei-csl/Qwen3-0.6B-PreSINQ-GGUF
Text Generation • 0.6B • Updated
• 64
huawei-csl/Qwen3-4B-PreSINQ-GGUF
Text Generation • 4B • Updated
• 124 • 3
huawei-csl/Qwen3-1.7B-PreSINQ-GGUF
Text Generation • 2B • Updated
• 90
huawei-csl/Qwen3-Next-80B-A3B-Instruct-4bit-SINQ
Text Generation • Updated
• 88 • 2
huawei-csl/Qwen3-Next-80B-A3B-Instruct-3bit-SINQ
Text Generation • Updated
• 11 • 2
huawei-csl/Qwen3-32B-3bit-ASINQ
Text Generation • 6B • Updated
• 12 • 5
huawei-csl/Apertus-8B-2509-4bit-SINQ
Text Generation • 5B • Updated
• 9 • 2
huawei-csl/Qwen3-32B-3bit-SINQ
Text Generation • 6B • Updated
• 15 • 6
huawei-csl/Qwen3-1.7B-4bit-SINQ
Text Generation • 1B • Updated
• 11 • 5
huawei-csl/Kimi-Linear-48B-A3B-Instruct-3bit-SINQ
Text Generation • 7B • Updated
• 21 • 1
datasets 0
None public yet