Inference Optimized Checkpoints (with Model Optimizer) Collection A collection of generative models quantized and optimized for inference with Model Optimizer. • 54 items • Updated 1 day ago • 114
Running on A10G 1.88k GGUF My Repo 🦙 1.88k Quantize a Hugging Face model to GGUF and create a repo