google/gemma-3-4b-it-qat-q4_0-gguf
Image-Text-to-Text
•
4B
•
Updated
•
3.61k
•
204
Gemma 3 QAT
Quantization Aware Trained (QAT) Gemma 3 checkpoints. The model preserves similar quality as half precision while using 3x less memory
-
-
google/gemma-3-4b-pt-qat-q4_0-gguf
Image-Text-to-Text • 4B • Updated • 99 • 23 -
google/gemma-3-1b-it-qat-q4_0-gguf
Text Generation • 1.0B • Updated • 1.83k • 92 -
google/gemma-3-1b-pt-qat-q4_0-gguf
Text Generation • 1.0B • Updated • 75 • 12 -
google/gemma-3-12b-it-qat-q4_0-gguf
Image-Text-to-Text • 12B • Updated • 86.5k • 201 -
google/gemma-3-12b-pt-qat-q4_0-gguf
Image-Text-to-Text • 12B • Updated • 288 • 17 -
google/gemma-3-27b-it-qat-q4_0-gguf
Image-Text-to-Text • 27B • Updated • 182k • 356
google/gemma-3-27b-pt-qat-q4_0-gguf
Image-Text-to-Text • 27B • Updated • 184 • 28Note ^ GGUFs to be used in llama.cpp and Ollama. We strongly recommend using the IT models.
-
google/gemma-3-4b-it-qat-q4_0-unquantized
Image-Text-to-Text • 4B • Updated • 7.33k • 9 -
google/gemma-3-27b-it-qat-q4_0-unquantized
Image-Text-to-Text • 27B • Updated • 1.13k • 36 -
google/gemma-3-12b-it-qat-q4_0-unquantized
Image-Text-to-Text • 12B • Updated • 798 • • 16 -
google/gemma-3-1b-it-qat-q4_0-unquantized
Text Generation • 1.0B • Updated • 1.52k • 9 -
google/gemma-3-4b-it-qat-int4-unquantized
Image-Text-to-Text • 4B • Updated • 598 • 8 -
google/gemma-3-12b-it-qat-int4-unquantized
Image-Text-to-Text • 12B • Updated • 685 • 11
google/gemma-3-1b-it-qat-int4-unquantized
Text Generation • 1.0B • Updated • 399 • 11Note ^ unquantized QAT-based checkpoints that allow quantizing while retaining similar quality to half precision