Will quantized (GGUF) models be uploaded?
#1
by rookaw - opened
Hi! I'm really excited to try this model out and see how it performs on the nameslop test. Would it be possible to upload GGUF quants so I can run it on my computer? Thank you!
Hi! I'm really excited to try this model out and see how it performs on the nameslop test. Would it be possible to upload GGUF quants so I can run it on my computer? Thank you!