Add GGUF quantized models (Q4_0, Q4_K_M, Q5_K_M, Q8_0, F32) 65052e7 aguitauwu commited on 15 days ago