Hugging Face's logo

mradermacher
/
Qwen3-2x6B-TNG-Deckard-Alpha-III-12B-i1-GGUF

Transformers
GGUF
English
programming
code generation
code
coding
coder
chat
brainstorm
qwen
qwen3
qwencoder
brainstorm 20x
creative
all uses cases
Jan-V1
horror
science fiction
fantasy
Star Trek
The Next Generation
TNG
Philip K. Dick
Deckard
finetune
thinking
reasoning
unsloth
Mixture of Experts
mixture of experts
Merge
imatrix
conversational
Model card Files
xet
Community
mradermacher commited on
Commit
483779b
·
verified ·
1 Parent(s): fa358a3

auto-patch README.md

Browse files
Files changed (1) hide show
  1. README.md +8 -0
README.md CHANGED
@@ -73,21 +73,29 @@ more details, including on how to concatenate multi-part files.
73
  | Link | Type | Size/GB | Notes |
74
  |:-----|:-----|--------:|:------|
75
  | [GGUF](https://huggingface.co/mradermacher/Qwen3-2x6B-TNG-Deckard-Alpha-III-12B-i1-GGUF/resolve/main/Qwen3-2x6B-TNG-Deckard-Alpha-III-12B.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own qwuants) |
 
76
  | [GGUF](https://huggingface.co/mradermacher/Qwen3-2x6B-TNG-Deckard-Alpha-III-12B-i1-GGUF/resolve/main/Qwen3-2x6B-TNG-Deckard-Alpha-III-12B.i1-IQ1_M.gguf) | i1-IQ1_M | 2.7 | mostly desperate |
77
  | [GGUF](https://huggingface.co/mradermacher/Qwen3-2x6B-TNG-Deckard-Alpha-III-12B-i1-GGUF/resolve/main/Qwen3-2x6B-TNG-Deckard-Alpha-III-12B.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 3.1 | |
78
  | [GGUF](https://huggingface.co/mradermacher/Qwen3-2x6B-TNG-Deckard-Alpha-III-12B-i1-GGUF/resolve/main/Qwen3-2x6B-TNG-Deckard-Alpha-III-12B.i1-IQ2_XS.gguf) | i1-IQ2_XS | 3.3 | |
 
79
  | [GGUF](https://huggingface.co/mradermacher/Qwen3-2x6B-TNG-Deckard-Alpha-III-12B-i1-GGUF/resolve/main/Qwen3-2x6B-TNG-Deckard-Alpha-III-12B.i1-IQ2_M.gguf) | i1-IQ2_M | 3.8 | |
80
  | [GGUF](https://huggingface.co/mradermacher/Qwen3-2x6B-TNG-Deckard-Alpha-III-12B-i1-GGUF/resolve/main/Qwen3-2x6B-TNG-Deckard-Alpha-III-12B.i1-Q2_K_S.gguf) | i1-Q2_K_S | 3.8 | very low quality |
81
  | [GGUF](https://huggingface.co/mradermacher/Qwen3-2x6B-TNG-Deckard-Alpha-III-12B-i1-GGUF/resolve/main/Qwen3-2x6B-TNG-Deckard-Alpha-III-12B.i1-Q2_K.gguf) | i1-Q2_K | 4.1 | IQ3_XXS probably better |
82
  | [GGUF](https://huggingface.co/mradermacher/Qwen3-2x6B-TNG-Deckard-Alpha-III-12B-i1-GGUF/resolve/main/Qwen3-2x6B-TNG-Deckard-Alpha-III-12B.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 4.2 | lower quality |
 
83
  | [GGUF](https://huggingface.co/mradermacher/Qwen3-2x6B-TNG-Deckard-Alpha-III-12B-i1-GGUF/resolve/main/Qwen3-2x6B-TNG-Deckard-Alpha-III-12B.i1-Q3_K_S.gguf) | i1-Q3_K_S | 4.7 | IQ3_XS probably better |
 
84
  | [GGUF](https://huggingface.co/mradermacher/Qwen3-2x6B-TNG-Deckard-Alpha-III-12B-i1-GGUF/resolve/main/Qwen3-2x6B-TNG-Deckard-Alpha-III-12B.i1-IQ3_M.gguf) | i1-IQ3_M | 4.9 | |
85
  | [GGUF](https://huggingface.co/mradermacher/Qwen3-2x6B-TNG-Deckard-Alpha-III-12B-i1-GGUF/resolve/main/Qwen3-2x6B-TNG-Deckard-Alpha-III-12B.i1-Q3_K_M.gguf) | i1-Q3_K_M | 5.2 | IQ3_S probably better |
86
  | [GGUF](https://huggingface.co/mradermacher/Qwen3-2x6B-TNG-Deckard-Alpha-III-12B-i1-GGUF/resolve/main/Qwen3-2x6B-TNG-Deckard-Alpha-III-12B.i1-Q3_K_L.gguf) | i1-Q3_K_L | 5.6 | IQ3_M probably better |
87
  | [GGUF](https://huggingface.co/mradermacher/Qwen3-2x6B-TNG-Deckard-Alpha-III-12B-i1-GGUF/resolve/main/Qwen3-2x6B-TNG-Deckard-Alpha-III-12B.i1-IQ4_XS.gguf) | i1-IQ4_XS | 5.8 | |
88
  | [GGUF](https://huggingface.co/mradermacher/Qwen3-2x6B-TNG-Deckard-Alpha-III-12B-i1-GGUF/resolve/main/Qwen3-2x6B-TNG-Deckard-Alpha-III-12B.i1-IQ4_NL.gguf) | i1-IQ4_NL | 6.1 | prefer IQ4_XS |
 
89
  | [GGUF](https://huggingface.co/mradermacher/Qwen3-2x6B-TNG-Deckard-Alpha-III-12B-i1-GGUF/resolve/main/Qwen3-2x6B-TNG-Deckard-Alpha-III-12B.i1-Q4_K_S.gguf) | i1-Q4_K_S | 6.1 | optimal size/speed/quality |
90
  | [GGUF](https://huggingface.co/mradermacher/Qwen3-2x6B-TNG-Deckard-Alpha-III-12B-i1-GGUF/resolve/main/Qwen3-2x6B-TNG-Deckard-Alpha-III-12B.i1-Q4_K_M.gguf) | i1-Q4_K_M | 6.4 | fast, recommended |
 
 
 
91
  | [GGUF](https://huggingface.co/mradermacher/Qwen3-2x6B-TNG-Deckard-Alpha-III-12B-i1-GGUF/resolve/main/Qwen3-2x6B-TNG-Deckard-Alpha-III-12B.i1-Q6_K.gguf) | i1-Q6_K | 8.7 | practically like static Q6_K |
92
 
93
  Here is a handy graph by ikawrakow comparing some lower-quality quant
 
73
  | Link | Type | Size/GB | Notes |
74
  |:-----|:-----|--------:|:------|
75
  | [GGUF](https://huggingface.co/mradermacher/Qwen3-2x6B-TNG-Deckard-Alpha-III-12B-i1-GGUF/resolve/main/Qwen3-2x6B-TNG-Deckard-Alpha-III-12B.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own qwuants) |
76
+ | [GGUF](https://huggingface.co/mradermacher/Qwen3-2x6B-TNG-Deckard-Alpha-III-12B-i1-GGUF/resolve/main/Qwen3-2x6B-TNG-Deckard-Alpha-III-12B.i1-IQ1_S.gguf) | i1-IQ1_S | 2.5 | for the desperate |
77
  | [GGUF](https://huggingface.co/mradermacher/Qwen3-2x6B-TNG-Deckard-Alpha-III-12B-i1-GGUF/resolve/main/Qwen3-2x6B-TNG-Deckard-Alpha-III-12B.i1-IQ1_M.gguf) | i1-IQ1_M | 2.7 | mostly desperate |
78
  | [GGUF](https://huggingface.co/mradermacher/Qwen3-2x6B-TNG-Deckard-Alpha-III-12B-i1-GGUF/resolve/main/Qwen3-2x6B-TNG-Deckard-Alpha-III-12B.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 3.1 | |
79
  | [GGUF](https://huggingface.co/mradermacher/Qwen3-2x6B-TNG-Deckard-Alpha-III-12B-i1-GGUF/resolve/main/Qwen3-2x6B-TNG-Deckard-Alpha-III-12B.i1-IQ2_XS.gguf) | i1-IQ2_XS | 3.3 | |
80
+ | [GGUF](https://huggingface.co/mradermacher/Qwen3-2x6B-TNG-Deckard-Alpha-III-12B-i1-GGUF/resolve/main/Qwen3-2x6B-TNG-Deckard-Alpha-III-12B.i1-IQ2_S.gguf) | i1-IQ2_S | 3.5 | |
81
  | [GGUF](https://huggingface.co/mradermacher/Qwen3-2x6B-TNG-Deckard-Alpha-III-12B-i1-GGUF/resolve/main/Qwen3-2x6B-TNG-Deckard-Alpha-III-12B.i1-IQ2_M.gguf) | i1-IQ2_M | 3.8 | |
82
  | [GGUF](https://huggingface.co/mradermacher/Qwen3-2x6B-TNG-Deckard-Alpha-III-12B-i1-GGUF/resolve/main/Qwen3-2x6B-TNG-Deckard-Alpha-III-12B.i1-Q2_K_S.gguf) | i1-Q2_K_S | 3.8 | very low quality |
83
  | [GGUF](https://huggingface.co/mradermacher/Qwen3-2x6B-TNG-Deckard-Alpha-III-12B-i1-GGUF/resolve/main/Qwen3-2x6B-TNG-Deckard-Alpha-III-12B.i1-Q2_K.gguf) | i1-Q2_K | 4.1 | IQ3_XXS probably better |
84
  | [GGUF](https://huggingface.co/mradermacher/Qwen3-2x6B-TNG-Deckard-Alpha-III-12B-i1-GGUF/resolve/main/Qwen3-2x6B-TNG-Deckard-Alpha-III-12B.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 4.2 | lower quality |
85
+ | [GGUF](https://huggingface.co/mradermacher/Qwen3-2x6B-TNG-Deckard-Alpha-III-12B-i1-GGUF/resolve/main/Qwen3-2x6B-TNG-Deckard-Alpha-III-12B.i1-IQ3_XS.gguf) | i1-IQ3_XS | 4.5 | |
86
  | [GGUF](https://huggingface.co/mradermacher/Qwen3-2x6B-TNG-Deckard-Alpha-III-12B-i1-GGUF/resolve/main/Qwen3-2x6B-TNG-Deckard-Alpha-III-12B.i1-Q3_K_S.gguf) | i1-Q3_K_S | 4.7 | IQ3_XS probably better |
87
+ | [GGUF](https://huggingface.co/mradermacher/Qwen3-2x6B-TNG-Deckard-Alpha-III-12B-i1-GGUF/resolve/main/Qwen3-2x6B-TNG-Deckard-Alpha-III-12B.i1-IQ3_S.gguf) | i1-IQ3_S | 4.8 | beats Q3_K* |
88
  | [GGUF](https://huggingface.co/mradermacher/Qwen3-2x6B-TNG-Deckard-Alpha-III-12B-i1-GGUF/resolve/main/Qwen3-2x6B-TNG-Deckard-Alpha-III-12B.i1-IQ3_M.gguf) | i1-IQ3_M | 4.9 | |
89
  | [GGUF](https://huggingface.co/mradermacher/Qwen3-2x6B-TNG-Deckard-Alpha-III-12B-i1-GGUF/resolve/main/Qwen3-2x6B-TNG-Deckard-Alpha-III-12B.i1-Q3_K_M.gguf) | i1-Q3_K_M | 5.2 | IQ3_S probably better |
90
  | [GGUF](https://huggingface.co/mradermacher/Qwen3-2x6B-TNG-Deckard-Alpha-III-12B-i1-GGUF/resolve/main/Qwen3-2x6B-TNG-Deckard-Alpha-III-12B.i1-Q3_K_L.gguf) | i1-Q3_K_L | 5.6 | IQ3_M probably better |
91
  | [GGUF](https://huggingface.co/mradermacher/Qwen3-2x6B-TNG-Deckard-Alpha-III-12B-i1-GGUF/resolve/main/Qwen3-2x6B-TNG-Deckard-Alpha-III-12B.i1-IQ4_XS.gguf) | i1-IQ4_XS | 5.8 | |
92
  | [GGUF](https://huggingface.co/mradermacher/Qwen3-2x6B-TNG-Deckard-Alpha-III-12B-i1-GGUF/resolve/main/Qwen3-2x6B-TNG-Deckard-Alpha-III-12B.i1-IQ4_NL.gguf) | i1-IQ4_NL | 6.1 | prefer IQ4_XS |
93
+ | [GGUF](https://huggingface.co/mradermacher/Qwen3-2x6B-TNG-Deckard-Alpha-III-12B-i1-GGUF/resolve/main/Qwen3-2x6B-TNG-Deckard-Alpha-III-12B.i1-Q4_0.gguf) | i1-Q4_0 | 6.1 | fast, low quality |
94
  | [GGUF](https://huggingface.co/mradermacher/Qwen3-2x6B-TNG-Deckard-Alpha-III-12B-i1-GGUF/resolve/main/Qwen3-2x6B-TNG-Deckard-Alpha-III-12B.i1-Q4_K_S.gguf) | i1-Q4_K_S | 6.1 | optimal size/speed/quality |
95
  | [GGUF](https://huggingface.co/mradermacher/Qwen3-2x6B-TNG-Deckard-Alpha-III-12B-i1-GGUF/resolve/main/Qwen3-2x6B-TNG-Deckard-Alpha-III-12B.i1-Q4_K_M.gguf) | i1-Q4_K_M | 6.4 | fast, recommended |
96
+ | [GGUF](https://huggingface.co/mradermacher/Qwen3-2x6B-TNG-Deckard-Alpha-III-12B-i1-GGUF/resolve/main/Qwen3-2x6B-TNG-Deckard-Alpha-III-12B.i1-Q4_1.gguf) | i1-Q4_1 | 6.7 | |
97
+ | [GGUF](https://huggingface.co/mradermacher/Qwen3-2x6B-TNG-Deckard-Alpha-III-12B-i1-GGUF/resolve/main/Qwen3-2x6B-TNG-Deckard-Alpha-III-12B.i1-Q5_K_S.gguf) | i1-Q5_K_S | 7.3 | |
98
+ | [GGUF](https://huggingface.co/mradermacher/Qwen3-2x6B-TNG-Deckard-Alpha-III-12B-i1-GGUF/resolve/main/Qwen3-2x6B-TNG-Deckard-Alpha-III-12B.i1-Q5_K_M.gguf) | i1-Q5_K_M | 7.5 | |
99
  | [GGUF](https://huggingface.co/mradermacher/Qwen3-2x6B-TNG-Deckard-Alpha-III-12B-i1-GGUF/resolve/main/Qwen3-2x6B-TNG-Deckard-Alpha-III-12B.i1-Q6_K.gguf) | i1-Q6_K | 8.7 | practically like static Q6_K |
100
 
101
  Here is a handy graph by ikawrakow comparing some lower-quality quant