Convert Internvl model to gguf
#1
by
Naruto123321
- opened
Hi. I saw you converted Intervl model to gguf with mmproj. So can you share how to convert Intervl model to gguf including mmproj.
Its not that hard tbh, you just have to follow the documentation in llama.cpp on how to quant models, though the 20b needs a pr that i think is still open /: