Hugging Face's logo

bobchenyx
/
DeepSeek-V3-0324-MLA-GGUF

Text Generation
Transformers
GGUF
deepseek_v3
deepseek
GGUF
Model card Files
xet
Community
bobchenyx commited on
Commit
9b3f787
·
verified ·
1 Parent(s): e163a75

Upload DeepSeek-V3-0324-MLA-Q2_K quantized model

Browse files
Files changed (10) hide show
  1. .gitattributes +9 -0
  2. DeepSeek-V3-0324-MLA-Q2_K/DeepSeek-V3-0324-MLA-Q2_K-00001-of-00009.gguf +3 -0
  3. DeepSeek-V3-0324-MLA-Q2_K/DeepSeek-V3-0324-MLA-Q2_K-00002-of-00009.gguf +3 -0
  4. DeepSeek-V3-0324-MLA-Q2_K/DeepSeek-V3-0324-MLA-Q2_K-00003-of-00009.gguf +3 -0
  5. DeepSeek-V3-0324-MLA-Q2_K/DeepSeek-V3-0324-MLA-Q2_K-00004-of-00009.gguf +3 -0
  6. DeepSeek-V3-0324-MLA-Q2_K/DeepSeek-V3-0324-MLA-Q2_K-00005-of-00009.gguf +3 -0
  7. DeepSeek-V3-0324-MLA-Q2_K/DeepSeek-V3-0324-MLA-Q2_K-00006-of-00009.gguf +3 -0
  8. DeepSeek-V3-0324-MLA-Q2_K/DeepSeek-V3-0324-MLA-Q2_K-00007-of-00009.gguf +3 -0
  9. DeepSeek-V3-0324-MLA-Q2_K/DeepSeek-V3-0324-MLA-Q2_K-00008-of-00009.gguf +3 -0
  10. DeepSeek-V3-0324-MLA-Q2_K/DeepSeek-V3-0324-MLA-Q2_K-00009-of-00009.gguf +3 -0
.gitattributes CHANGED
@@ -51,3 +51,12 @@ DeepSeek-V3-0324-MLA-IQ1_S/DeepSeek-V3-0324-MLA-IQ1_S-00006-of-00009.gguf filter
51
  DeepSeek-V3-0324-MLA-IQ1_S/DeepSeek-V3-0324-MLA-IQ1_S-00007-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
52
  DeepSeek-V3-0324-MLA-IQ1_S/DeepSeek-V3-0324-MLA-IQ1_S-00008-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
53
  DeepSeek-V3-0324-MLA-IQ1_S/DeepSeek-V3-0324-MLA-IQ1_S-00009-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
 
 
 
51
  DeepSeek-V3-0324-MLA-IQ1_S/DeepSeek-V3-0324-MLA-IQ1_S-00007-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
52
  DeepSeek-V3-0324-MLA-IQ1_S/DeepSeek-V3-0324-MLA-IQ1_S-00008-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
53
  DeepSeek-V3-0324-MLA-IQ1_S/DeepSeek-V3-0324-MLA-IQ1_S-00009-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
54
+ DeepSeek-V3-0324-MLA-Q2_K/DeepSeek-V3-0324-MLA-Q2_K-00001-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
55
+ DeepSeek-V3-0324-MLA-Q2_K/DeepSeek-V3-0324-MLA-Q2_K-00002-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
56
+ DeepSeek-V3-0324-MLA-Q2_K/DeepSeek-V3-0324-MLA-Q2_K-00003-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
57
+ DeepSeek-V3-0324-MLA-Q2_K/DeepSeek-V3-0324-MLA-Q2_K-00004-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
58
+ DeepSeek-V3-0324-MLA-Q2_K/DeepSeek-V3-0324-MLA-Q2_K-00005-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
59
+ DeepSeek-V3-0324-MLA-Q2_K/DeepSeek-V3-0324-MLA-Q2_K-00006-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
60
+ DeepSeek-V3-0324-MLA-Q2_K/DeepSeek-V3-0324-MLA-Q2_K-00007-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
61
+ DeepSeek-V3-0324-MLA-Q2_K/DeepSeek-V3-0324-MLA-Q2_K-00008-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
62
+ DeepSeek-V3-0324-MLA-Q2_K/DeepSeek-V3-0324-MLA-Q2_K-00009-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
DeepSeek-V3-0324-MLA-Q2_K/DeepSeek-V3-0324-MLA-Q2_K-00001-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:42a87c8d95ec44d59a3ff957b01e0547aeb3fe3969be7baee1a9ab00b16fcfbe
3
+ size 22824935712
DeepSeek-V3-0324-MLA-Q2_K/DeepSeek-V3-0324-MLA-Q2_K-00002-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7876638f2096aa5ef4f78eb27f13b66d0c5d573c15cf8e21f3655f902c911d2a
3
+ size 28257074368
DeepSeek-V3-0324-MLA-Q2_K/DeepSeek-V3-0324-MLA-Q2_K-00003-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:987231f524db08bee684572fd8e9db3732c9760adb77fc705cf2e8c54977791e
3
+ size 29479161088
DeepSeek-V3-0324-MLA-Q2_K/DeepSeek-V3-0324-MLA-Q2_K-00004-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:266b3be600b1470ba48981944596a130cd1aa6309370d809c19ce2b436aca453
3
+ size 27848424704
DeepSeek-V3-0324-MLA-Q2_K/DeepSeek-V3-0324-MLA-Q2_K-00005-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4844a4df5ab5cf9b0eda8bd2c4fe3e7d4458f02c7a26dad47facf4e861bf5da8
3
+ size 27837777120
DeepSeek-V3-0324-MLA-Q2_K/DeepSeek-V3-0324-MLA-Q2_K-00006-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8cb382dd426c2736bbb35f976677c4451690d1a1ed7dfd0f730094b1d480fbb0
3
+ size 28324252928
DeepSeek-V3-0324-MLA-Q2_K/DeepSeek-V3-0324-MLA-Q2_K-00007-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4f30085342c61762a98db209f1787486ff98c84bf83c590bd235f1f084a03550
3
+ size 27858986240
DeepSeek-V3-0324-MLA-Q2_K/DeepSeek-V3-0324-MLA-Q2_K-00008-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1317fd901b9e0ab3d47b0808835486054f208208e96c86e8f6475d0f9ab6cb91
3
+ size 29038104832
DeepSeek-V3-0324-MLA-Q2_K/DeepSeek-V3-0324-MLA-Q2_K-00009-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f528472a2579ba614217b3be6f90132928c0887b0aa40cebf2d48fc03c086567
3
+ size 16918961248