Q2_K in revision: user report that 1.1 is giving issues
#5
by realrebelai - opened
I ran a bunch of tests last night with FLF and every generation came out blurry and cooked. Just wanted to let you know! Maybe something happenee during compression?
Strange. What GGUF are you using? Can you share your settings in workflow also? I didn’t get that issues
using the FLF workflow. im using the Q2 gguf!
im not sure what this issue is tbh, the regular 1.0 works great
I need to test that Q2_K but in running the Q3_K_S and its fine
Add: And the quantization its the same used in 1.0
i am using Q4_K_M and its flawless thanks for the quants !!
YarvixPA changed discussion title from 1.1 giving issues to Q2_K in revision: user report that 1.1 is giving issues