
AmpereComputing/glm-4.5-air-gguf
110B
•
Updated
•
13
•
1
Ampere's quantization formats (Q4_K_4 / Q8R16) require Ampere optimized llama.cpp available here: https://hub.docker.com/r/amperecomputingai/llama.cpp