itlwas/bgGPT-llama-3.1-8B-Q4_K_M-GGUF
8B • Updated • 18
itlwas
itlwas
AI & ML interests
👋 Here you’ll find GGUF models 🗂️ with Q4_K_M quantization ⚙️, optimized for low-resource devices 💻. These models balance size 📏 and performance 🚀. Notice any issues? Message me on Telegram: @itlwas
Organizations
itlwas/Sebushka-llama-3.1-8B-Q4_K_M-GGUF
8B • Updated • 5
itlwas/Llama-3-8B-Web-Q4_K_M-GGUF
8B • Updated • 3
itlwas/Meta-Llama-3.1-8B-Claude-Q4_K_M-GGUF
8B • Updated • 15
itlwas/Ahma-7B-Instruct-Q4_K_M-GGUF
Text Generation • 7B • Updated • 5
itlwas/Ahma-7B-Q4_K_M-GGUF
Text Generation • 7B • Updated • 12
itlwas/Ahma-3B-Instruct-Q4_K_M-GGUF
Text Generation • 4B • Updated • 17
itlwas/Ahma-3B-Q4_K_M-GGUF
Text Generation • 4B • Updated • 13
itlwas/TinyLlama_v1.1_chinese-Q4_K_M-GGUF
1B • Updated • 21
itlwas/TinyLlama_v1.1_math_code-Q4_K_M-GGUF
1B • Updated • 27
itlwas/TinyLlama_v1.1-Q4_K_M-GGUF
1B • Updated • 7
itlwas/TinyLlama-1.1B-Chat-v1.0-Q4_K_M-GGUF
1B • Updated • 26
itlwas/BioMistral-7B-SLERP-Q4_K_M-GGUF
Text Generation • 7B • Updated • 13
itlwas/BioMistral-7B-TIES-Q4_K_M-GGUF
Text Generation • 7B • Updated • 8
itlwas/BioMistral-7B-DARE-Q4_K_M-GGUF
Text Generation • 7B • Updated • 11
itlwas/BioMistral-7B-Q4_K_M-GGUF
Text Generation • 7B • Updated • 219 • 1
itlwas/GWQ-9B-Preview2-Q4_K_M-GGUF
Text Generation • 9B • Updated • 5
itlwas/GWQ-9B-Preview-Q4_K_M-GGUF
Text Generation • 9B • Updated • 10
itlwas/LLaMA-2-13b-GTL-Delta-Q4_K_M-GGUF
13B • Updated • 7
itlwas/LLaMA-2-7b-GTL-Delta-Q4_K_M-GGUF
7B • Updated • 3
itlwas/Orca-2-13b-Q4_K_M-GGUF
Text Generation • 13B • Updated • 9
itlwas/Orca-2-7b-Q4_K_M-GGUF
Text Generation • 7B • Updated • 8
itlwas/phi-1_5-Q4_K_M-GGUF
Text Generation • 1B • Updated • 21 • 1
itlwas/phi-1-Q4_K_M-GGUF
Text Generation • 1B • Updated • 19
itlwas/Phi-3-medium-128k-instruct-Q4_K_M-GGUF
Text Generation • 14B • Updated • 18
itlwas/Phi-3-medium-4k-instruct-Q4_K_M-GGUF
Text Generation • 14B • Updated • 9
itlwas/Phi-3-mini-128k-instruct-Q4_K_M-GGUF
Text Generation • 4B • Updated • 8
itlwas/Phi-3-mini-4k-instruct-Q4_K_M-GGUF
Text Generation • 4B • Updated • 17
itlwas/Phi-3.5-mini-instruct-Q4_K_M-GGUF
Text Generation • 4B • Updated • 12
itlwas/phi-4-Q4_K_M-GGUF
Text Generation • 15B • Updated • 27