Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
Edit Models filters
Main
Tasks
Libraries
Languages
Licenses
Other
1
Apps
llama.cpp
LM Studio
Jan
Backyard AI
Draw Things
DiffusionBee
Jellybox
RecurseChat
Msty
Sanctum
Invoke
JoyFusion
LocalAI
vLLM
node-llama-cpp
Ollama
TGI
MLX LM
Docker Model Runner
Inference Providers
Select all
Cerebras
Novita
Nebius AI
Featherless AI
Fireworks
Together AI
Groq
Hyperbolic
Cohere
fal
Nscale
SambaNova
Replicate
HF Inference API
Misc
Reset Misc
llama.cpp
Inference Endpoints
text-generation-inference
Eval Results
Merge
4-bit precision
custom_code
8-bit precision
text-embeddings-inference
Carbon Emissions
Mixture of Experts
Apply filters
Models
238
Full-text search
Edit filters
Sort: Trending
Active filters:
llama.cpp
Clear all
ReallyFloppyPenguin/Dhanishtha-2.0-preview-GGUF
Updated
21 days ago
ReallyFloppyPenguin/DeepSeek-R1-Distill-Qwen-1.5B-GGUF
2B
•
Updated
21 days ago
•
128
ReallyFloppyPenguin/DeepSWE-Preview-GGUF
33B
•
Updated
21 days ago
•
153
JonathanMiddleton/Qwen3-Embedding-8B-GGUF
8B
•
Updated
16 days ago
•
488
Makatia/mistral-7b-instruct-v0.2.Q8_0-Q8_0.gguf
7B
•
Updated
16 days ago
•
29
JonathanMiddleton/Qwen3-Reranker-4B-GGUF
Text Ranking
•
4B
•
Updated
15 days ago
•
100
Arivukkarasu/TinyLlama-1.1B-Chat-GGUF
1B
•
Updated
14 days ago
•
25
Arivukkarasu/Mistral-7B-Instruct-v0.3-GGUF
7B
•
Updated
14 days ago
•
60
PJEDeveloper/Mistral_Nemo_Instruct_2407-F16.gguf-Q4_K_M
12B
•
Updated
6 days ago
•
51
theprint/Zeth-Gemma3-4B-GGUF
Text Generation
•
5B
•
Updated
9 days ago
•
121
HackNetAyush/smollm2-135M-instruct-gguf-q8
Text Generation
•
0.1B
•
Updated
9 days ago
•
366
•
2
sugiv/cardvaultplus-500m-gguf
Image-to-Text
•
0.4B
•
Updated
7 days ago
•
77
PJEDeveloper/mistralai_Mistral-7B-Instruct-v0.3-F16.gguf-Q5_K_M
7B
•
Updated
7 days ago
•
32
Bastion-AI/SmolLM3-3B-GGUF
3B
•
Updated
6 days ago
•
229
PJEDeveloper/mistralai_Mistral-7B-Instruct-v0.2-Q5_K_M
7B
•
Updated
6 days ago
•
24
Darkhn/M3.2-24B-Animus-V6-Exp-GGUF
24B
•
Updated
5 days ago
•
320
Darkhn/L3.3-70B-Animus-V6-Exp-GGUF
71B
•
Updated
3 days ago
•
176
Darkhn/L3.3-70B-Animus-V6.1-Exp-GGUF
71B
•
Updated
3 days ago
•
207
theprint/TiTan-Llama-3.2-1B-GGUF
Text Generation
•
1B
•
Updated
4 days ago
•
151
theprint/TiTan-Gemma3-4B-GGUF
Text Generation
•
5B
•
Updated
4 days ago
•
111
dynomite567/Ministral-8B-Instruct-2410-Q4_K_M-GGUF
8B
•
Updated
4 days ago
•
10
dynomite567/Mistral-7B-Instruct-v0.3-Q4_K_M-GGUF
7B
•
Updated
3 days ago
•
35
Darkhn/M3.2-24B-Animus-V7.1-GGUF
24B
•
Updated
about 2 hours ago
•
127
Darkhn/M3.2-24B-Animus-V7.0-GGUF
24B
•
Updated
12 minutes ago
•
20
theprint/Pythonified-Llama-3.2-3B-Instruct-GGUF
Text Generation
•
3B
•
Updated
3 days ago
•
79
theprint/ReasonableMath-Llama-3.2-3B-Instruct-GGUF
Text Generation
•
3B
•
Updated
3 days ago
•
74
Darkhn/L3.3-70B-Animus-V7.0-GGUF
71B
•
Updated
1 day ago
•
192
theprint/Empathetic-Llama-3.2-3B-Instruct-GGUF
Text Generation
•
3B
•
Updated
1 day ago
•
21
Previous
1
...
6
7
8
Next