
AmpereComputing/llama-4-scout-16e-17b-instruct-gguf
108B
•
Updated
•
26
Ampere's quantization formats (Q4_K_4 / Q8R16) require Ampere optimized llama.cpp available here: https://hub.docker.com/r/amperecomputingai/llama.cpp