Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

4-bit precision

text-generation-inference

Inference Endpoints

8-bit precision

Mixture of Experts

text-embeddings-inference

Carbon Emissions

Models

34,890

Full-text search

Active filters: 4-bit

mlx-community/Qwen3-30B-A3B-4bit-DWQ

Text Generation • Updated May 5 • 1.51k • 25

Qwen/Qwen3-30B-A3B-GPTQ-Int4

Text Generation • Updated 18 days ago • 67.6k • 14

Jh0mpis/gemma-3-4b-physics-instruct-alpaca-model

Updated May 6 • 6 • 1

Qwen/Qwen3-235B-A22B-GPTQ-Int4

Text Generation • Updated 18 days ago • 7.6k • 14

mlx-community/gemma-3-27b-it-4bit-DWQ

Text Generation • Updated 24 days ago • 758 • 2

lmstudio-community/Devstral-Small-2505-MLX-4bit

Text Generation • Updated 19 days ago • 206k • 4

unsloth/medgemma-4b-it-unsloth-bnb-4bit

Image-Text-to-Text • Updated 18 days ago • 7.17k • 1

unsloth/Devstral-Small-2505-unsloth-bnb-4bit

Text2Text Generation • Updated 14 days ago • 2.16k • 4

unsloth/Devstral-Small-2505-bnb-4bit

Text2Text Generation • Updated 14 days ago • 2.08k • 3

mlx-community/Devstral-Small-2505-4bit-DWQ

Text Generation • Updated 17 days ago • 797 • 4

Jimmi42/sarvam-m-4bit-mlx

Text Generation • Updated 13 days ago • 27 • 1

lmstudio-community/DeepSeek-R1-0528-Qwen3-8B-MLX-4bit

Text Generation • Updated 9 days ago • 347k • 1

unsloth/DeepSeek-R1-0528-Qwen3-8B-bnb-4bit

Text Generation • Updated 1 day ago • 5.26k • 3

MaziyarPanahi/DeepSeek-R1-0528-Qwen3-8B-GGUF

Text Generation • Updated 9 days ago • 56.7k • 3

hxac/DeepSeek-R1-0528-Qwen3-8B-AWQ-4bit

Text Generation • Updated 8 days ago • 381 • 3

sid22669/Llama-3.2-1b-instruct-bnb-4bit

Text Generation • Updated 8 days ago • 88 • 1

QuantTrio/DeepSeek-R1-0528-GPTQ-Int4-Int8Mix-Lite

Text Generation • Updated 4 days ago • 54 • 1

Intel/DeepSeek-R1-0528-Qwen3-8B-int4-AutoRound-awq-inc

Updated 7 days ago • 835 • 1

MetaphoricalCode/Synthia-S1-27b-exl3-4bpw-hb6

Image-Text-to-Text • Updated 7 days ago • 20 • 1

QuantTrio/DeepSeek-R1-0528-GPTQ-Int4-Int8Mix-Compact

Text Generation • Updated 4 days ago • 351 • 1

ziyingchen1106/Llama-3.2-3B-Instruct-fp16-lora-gptqmodel-4bit

Text Generation • Updated 7 days ago • 28 • 1

mlx-community/Qwen3-4B-4bit-DWQ-053125

Text Generation • Updated 7 days ago • 321 • 1

mlx-community/Qwen3-8B-4bit-DWQ-053125

Text Generation • Updated 6 days ago • 202 • 1

mlx-community/Qwen3-14B-4bit-DWQ-053125

Text Generation • Updated 6 days ago • 187 • 1

xwzagan/Qwen3-14b-windmaster-4bit

Updated 5 days ago • 32 • 1

c1uc/Llama-3.2-3B-Instruct-lora-4bit-g128

Updated 5 days ago • 389 • 1

QuantTrio/DeepSeek-R1-0528-GPTQ-Int4-Int8Mix-Medium

Text Generation • Updated 3 days ago • 85 • 1

mlx-community/Cydonia-24B-v3-4bit

Text Generation • Updated 3 days ago • 95 • 1

Wfiles/MNLP_M3_quantized_model

Text Generation • Updated 2 days ago • 7 • 1

wikeeyang/byt5-xxl-enc-nf4

Text2Text Generation • Updated about 15 hours ago • 1