Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
Mungert
/
Qwen2.5-0.5B-Instruct-GGUF
like
5
Text Generation
Transformers
GGUF
English
chat
imatrix
conversational
arxiv:
2407.10671
License:
apache-2.0
Model card
Files
Files and versions
xet
Community
1
Deploy
Use this model
main
Qwen2.5-0.5B-Instruct-GGUF
10.6 GB
1 contributor
History:
1 commit
Mungert
Super-squash history to reclaim storage
f1f5eaa
verified
2 months ago
.gitattributes
Safe
3.55 kB
Super-squash history to reclaim storage
2 months ago
Qwen2.5-0.5B-Instruct-bf16-q4_k.gguf
525 MB
xet
Super-squash history to reclaim storage
2 months ago
Qwen2.5-0.5B-Instruct-bf16-q6_k.gguf
633 MB
xet
Super-squash history to reclaim storage
2 months ago
Qwen2.5-0.5B-Instruct-bf16-q8_0.gguf
Safe
659 MB
xet
Super-squash history to reclaim storage
2 months ago
Qwen2.5-0.5B-Instruct-bf16.gguf
994 MB
xet
Super-squash history to reclaim storage
2 months ago
Qwen2.5-0.5B-Instruct-f16-q4_k.gguf
Safe
525 MB
xet
Super-squash history to reclaim storage
2 months ago
Qwen2.5-0.5B-Instruct-f16-q6_k.gguf
633 MB
xet
Super-squash history to reclaim storage
2 months ago
Qwen2.5-0.5B-Instruct-f16-q8_0.gguf
659 MB
xet
Super-squash history to reclaim storage
2 months ago
Qwen2.5-0.5B-Instruct-iq3_m.gguf
300 MB
xet
Super-squash history to reclaim storage
2 months ago
Qwen2.5-0.5B-Instruct-iq3_s.gguf
Safe
296 MB
xet
Super-squash history to reclaim storage
2 months ago
Qwen2.5-0.5B-Instruct-iq3_xs.gguf
296 MB
xet
Super-squash history to reclaim storage
2 months ago
Qwen2.5-0.5B-Instruct-iq3_xxs.gguf
291 MB
xet
Super-squash history to reclaim storage
2 months ago
Qwen2.5-0.5B-Instruct-iq4_nl.gguf
353 MB
xet
Super-squash history to reclaim storage
2 months ago
Qwen2.5-0.5B-Instruct-iq4_xs.gguf
349 MB
xet
Super-squash history to reclaim storage
2 months ago
Qwen2.5-0.5B-Instruct-q3_k_m.gguf
355 MB
xet
Super-squash history to reclaim storage
2 months ago
Qwen2.5-0.5B-Instruct-q3_k_s.gguf
338 MB
xet
Super-squash history to reclaim storage
2 months ago
Qwen2.5-0.5B-Instruct-q4_0.gguf
352 MB
xet
Super-squash history to reclaim storage
2 months ago
Qwen2.5-0.5B-Instruct-q4_1.gguf
375 MB
xet
Super-squash history to reclaim storage
2 months ago
Qwen2.5-0.5B-Instruct-q4_k_m.gguf
398 MB
xet
Super-squash history to reclaim storage
2 months ago
Qwen2.5-0.5B-Instruct-q4_k_s.gguf
385 MB
xet
Super-squash history to reclaim storage
2 months ago
Qwen2.5-0.5B-Instruct-q5_k_m.gguf
420 MB
xet
Super-squash history to reclaim storage
2 months ago
Qwen2.5-0.5B-Instruct-q5_k_s.gguf
413 MB
xet
Super-squash history to reclaim storage
2 months ago
Qwen2.5-0.5B-Instruct-q6_k_m.gguf
506 MB
xet
Super-squash history to reclaim storage
2 months ago
Qwen2.5-0.5B-Instruct-q8_0.gguf
531 MB
xet
Super-squash history to reclaim storage
2 months ago
Qwen2.5-0.5B-Instruct.imatrix
989 kB
xet
Super-squash history to reclaim storage
2 months ago
README.md
Safe
4.92 kB
Super-squash history to reclaim storage
2 months ago
