Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

4-bit precision

text-generation-inference

Inference Endpoints

8-bit precision

Mixture of Experts

text-embeddings-inference

Carbon Emissions

Models

34,879

Full-text search

Active filters: 4-bit

unsloth/Pixtral-12B-2409-unsloth-bnb-4bit

Image-Text-to-Text • Updated Dec 4, 2024 • 3.14k • 11

internlm/internlm3-8b-instruct-awq

Text Generation • Updated Jan 15 • 34 • 6

unsloth/DeepSeek-R1-Distill-Qwen-7B-unsloth-bnb-4bit

Text Generation • Updated Feb 14 • 16.9k • 20

unsloth/DeepSeek-R1-Distill-Qwen-32B-unsloth-bnb-4bit

Text Generation • Updated Feb 14 • 933 • 10

casperhansen/mistral-small-24b-instruct-2501-awq

Updated Jan 30 • 1.13k • 8

unsloth/Meta-Llama-3.1-8B-Instruct-unsloth-bnb-4bit

Text Generation • Updated Feb 15 • 71.1k • 3

FINGU-AI/Chocolatine-Fusion-14B

Text Generation • Updated Feb 2 • 422 • 6

ahaduzzamanasif/CADLlama

Text Generation • Updated Feb 3 • 139 • 1

lkg67/minicpm4

Image-Text-to-Text • Updated Feb 13 • 8 • 1

Qwen/Qwen2.5-VL-7B-Instruct-AWQ

Image-Text-to-Text • Updated Apr 6 • 192k • 71

nguyen599/deepseek-qwen-14b-aime-awq

Updated Feb 17 • 5 • 1

LGAI-EXAONE/EXAONE-Deep-7.8B-AWQ

Text Generation • Updated Mar 19 • 383 • 14

unsloth/gemma-3-12b-it-unsloth-bnb-4bit

Image-Text-to-Text • Updated 27 days ago • 42k • 13

gaunernst/gemma-3-12b-it-int4-awq

Image-Text-to-Text • Updated Apr 6 • 6.6k • 11

RichardErkhov/thrishala_-_mental_health_chatbot-4bits

Updated Mar 24 • 3 • 1

AIDC-AI/Ovis2-4B-GPTQ-Int4

Image-Text-to-Text • Updated Mar 25 • 681 • 3

Qwen/Qwen2.5-VL-32B-Instruct-AWQ

Image-Text-to-Text • Updated Apr 6 • 65.9k • 44

unsloth/Llama-4-Scout-17B-16E-unsloth-bnb-4bit

Image-Text-to-Text • Updated Apr 6 • 1.72k • 2

gaunernst/gemma-3-4b-it-qat-autoawq

Image-Text-to-Text • Updated Apr 6 • 703 • 1

kishizaki-sci/Llama-4-Scout-17B-16E-Instruct-AWQ

Updated May 4 • 11.1k • 3

GusPuffy/Synthia-S1-27b-bnb-4bit

Image-Text-to-Text • Updated Apr 18 • 824 • 1

wolfofbackstreet/DeepCoder-14B-Preview-int4-qptq-v1

Text Generation • Updated Apr 23 • 96 • 1

Sumo10/Phi-4-mini-instruct-AWQ-4bit

Updated Apr 25 • 15 • 1

kaitchup/GLM-Z1-32B-0414-autoround-gptq-4bit

Updated Apr 28 • 403 • 3

unsloth/Qwen3-4B-unsloth-bnb-4bit

Text Generation • Updated 25 days ago • 91.4k • 6

unsloth/Qwen3-30B-A3B-bnb-4bit

Updated 25 days ago • 30.5k • 12

unsloth/Qwen3-8B-unsloth-bnb-4bit

Updated 25 days ago • 81.9k • 3

unsloth/Qwen3-8B-bnb-4bit

Updated 25 days ago • 12.2k • 1

lmstudio-community/Qwen3-32B-MLX-4bit

Text Generation • Updated Apr 28 • 49k • 3

mlx-community/Qwen3-30B-A3B-4bit

Text Generation • Updated Apr 29 • 1.73k • 10