Running 61 Accurate GGUF VRAM Calculator ๐ 61 Calculate VRAM for GGUF models using GPU layers and context
Running on A10G 1.88k GGUF My Repo ๐ฆ 1.88k Quantize a Hugging Face model to GGUF and create a repo