Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

4-bit precision

text-generation-inference

Inference Endpoints

Mixture of Experts

8-bit precision

Carbon Emissions

text-embeddings-inference

Models

7,125

Full-text search

Active filters: awq

cognitivecomputations/DeepSeek-R1-0528-AWQ

Text Generation • Updated 6 days ago • 1.81k • 12

Tongyi-Zhiwen/QwenLong-L1-32B-AWQ

Updated 10 days ago • 431 • 9

Qwen/Qwen3-32B-AWQ

Text Generation • Updated 18 days ago • 103k • 65

cognitivecomputations/DeepSeek-R1-AWQ

Text Generation • Updated Mar 29 • 8.06k • 81

Qwen/Qwen2.5-VL-72B-Instruct-AWQ

Image-Text-to-Text • Updated Mar 7 • 46.8k • 54

cognitivecomputations/DeepSeek-V3-0324-AWQ

Text Generation • Updated Mar 29 • 8.32k • 20

Qwen/Qwen3-8B-AWQ

Text Generation • Updated 18 days ago • 103k • 7

speakleash/Bielik-11B-v2.6-Instruct-AWQ

Text Generation • Updated 1 day ago • 40 • 2

TheBloke/MythoMax-L2-13B-AWQ

Text Generation • Updated Nov 9, 2023 • 1.57k • 11

TheBloke/LLaMA2-13B-Tiefighter-AWQ

Text Generation • Updated Nov 9, 2023 • 543 • 39

TheBloke/meditron-7B-AWQ

Text Generation • Updated Nov 30, 2023 • 32.9k • 3

TheBloke/Mistral-7B-Instruct-v0.2-AWQ

Text Generation • Updated Dec 11, 2023 • 134k • 45

TheBloke/Mythalion-Kimiko-v2-AWQ

Text Generation • Updated Dec 14, 2023 • 539 • 7

yixuantt/InvestLM-mistral-AWQ

Text Generation • Updated Oct 7, 2024 • 6 • 3

amazon/MistralLite-AWQ

Text Generation • Updated May 20, 2024 • 76 • 4

Qwen/Qwen2-VL-72B-Instruct-AWQ

Image-Text-to-Text • Updated Sep 25, 2024 • 6.26k • 50

Qwen/Qwen2.5-32B-Instruct-AWQ

Text Generation • Updated Oct 9, 2024 • 84.7k • 81

Qwen/Qwen2.5-72B-Instruct-AWQ

Text Generation • Updated Oct 9, 2024 • 101k • 68

TechxGenus/Mistral-Large-Instruct-2411-AWQ

Updated Nov 19, 2024 • 1.03k • 7

internlm/internlm3-8b-instruct-awq

Text Generation • Updated Jan 15 • 34 • 6

casperhansen/mistral-small-24b-instruct-2501-awq

Updated Jan 30 • 1.13k • 8

Qwen/Qwen2.5-VL-7B-Instruct-AWQ

Image-Text-to-Text • Updated Apr 6 • 192k • 71

nguyen599/deepseek-qwen-14b-aime-awq

Updated Feb 17 • 5 • 1

LGAI-EXAONE/EXAONE-Deep-7.8B-AWQ

Text Generation • Updated Mar 19 • 383 • 14

gaunernst/gemma-3-12b-it-int4-awq

Image-Text-to-Text • Updated Apr 6 • 6.6k • 11

Qwen/Qwen2.5-VL-32B-Instruct-AWQ

Image-Text-to-Text • Updated Apr 6 • 65.9k • 44

gaunernst/gemma-3-4b-it-qat-autoawq

Image-Text-to-Text • Updated Apr 6 • 703 • 1

kishizaki-sci/Llama-4-Scout-17B-16E-Instruct-AWQ

Updated May 4 • 11.1k • 3

Sumo10/Phi-4-mini-instruct-AWQ-4bit

Updated Apr 25 • 15 • 1

abhishekchohan/Qwen3-32B-AWQ

Updated Apr 30 • 854 • 1