Heretic_Amoral_Abl-Gemma3-1B

Model creator: Novaciano
Original model: Novaciano/Heretic_Amoral_Abl-Gemma3-1B
GGUF quantization: provided by Novaciano using llama.cpp

Special thanks

๐Ÿ™ Special thanks to Georgi Gerganov and the whole team working on llama.cpp for making all of this possible.

Use with Ollama

ollama run "hf.co/Novaciano/Heretic_Amoral_Abl-Gemma3-1B-GGUF:Q6_K"

Use with LM Studio

lms load "Novaciano/Heretic_Amoral_Abl-Gemma3-1B-GGUF"

Use with llama.cpp CLI

llama-cli --hf "Novaciano/Heretic_Amoral_Abl-Gemma3-1B-GGUF:Q6_K" -p "The meaning to life and the universe is"

Use with llama.cpp Server:

llama-server --hf "Novaciano/Heretic_Amoral_Abl-Gemma3-1B-GGUF:Q6_K" -c 4096
Downloads last month
23
GGUF
Model size
1.0B params
Architecture
gemma3
Hardware compatibility
Log In to view the estimation

6-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for Novaciano/Heretic_Amoral_Abl-Gemma3-1B-GGUF

Quantized
(3)
this model