Models

drush8/Qwen3-0.6B-INT4

Text Generation • Updated Aug 18 • 5

drush8/Qwen3-1.7B-INT4

Text Generation • Updated Aug 18 • 4

torchao-dev/opt-125m-FP8-v2-0.13-dev

Text Generation • Updated Aug 18 • 5

torchao-dev/opt-125m-INT4-v2-0.13-dev

Text Generation • Updated Aug 18 • 6

jerryzh168/Qwen3-8B-FP8

Text Generation • Updated 10 days ago • 12

jerryzh168/Qwen3-8B-INT4-non-hqq

Text Generation • Updated 21 days ago • 18

jerryzh168/Qwen3-8B-INT8-INT4

Text Generation • Updated 10 days ago • 18

torchao-testing/opt-125m-Float8DynamicActivationFloat8WeightConfig-v1-0.13.dev

Text Generation • Updated about 1 month ago • 1.47k

liangel/Qwen3-8B-INT4

Text Generation • 8B • Updated 17 days ago • 21

jerryzh168/Llama-3.3-70B-Instruct-INT4

Text Generation • Updated 28 days ago • 12

TamWaiban/gemma-3-270m-int4

Text Generation • Updated 28 days ago • 31

TamWaiban/gemma-3-270m-autoquant

Text Generation • Updated 28 days ago • 16

q10/Qwen3-8B-Base-FP8

Text Generation • Updated 25 days ago • 19

q10/Qwen3-8B-Base-INT4

Text Generation • Updated 25 days ago • 19

q10/Qwen3-8B-Base-INT8-INT4

Text Generation • Updated 25 days ago • 16

pytorch/gemma-3-12b-it-INT4

Image-Text-to-Text • Updated about 11 hours ago • 51

pytorch/gemma-3-12b-it-FP8

Image-Text-to-Text • Updated about 11 hours ago • 47

pytorch/gemma-3-27b-it-FP8

Image-Text-to-Text • Updated about 11 hours ago • 114

pytorch/gemma-3-27b-it-INT4

Image-Text-to-Text • Updated about 11 hours ago • 93

pytorch/Phi-4-mini-instruct-AWQ-INT4

Text Generation • Updated about 8 hours ago • 925 • 1

cs2764/Huihui-Qwen3-30B-A3B-Instruct-2507-abliterated-ao-int8wo

Text Generation • Updated 21 days ago • 10

cs2764/Huihui-Qwen3-4B-Instruct-2507-abliterated-ao-int8wo

Text Generation • Updated 21 days ago • 13

jerryzh168/Qwen3-8B-INT4

Text Generation • Updated 10 days ago • 144

HuggingFaceH4/SmolLM3-3B-QAT-Baseline-Q

Text Generation • Updated 17 days ago • 100

liangel/Qwen3-8B-FP8

Text Generation • 8B • Updated 17 days ago • 58

smohammadi/qat-llama-3B-int8daint4w

Text Generation • Updated 17 days ago • 20

smohammadi/llama3B-nvfp4w

Text Generation • Updated 17 days ago • 17

smohammadi/qat-nvfp4-llama3B-nvfp4w

Text Generation • Updated 17 days ago • 24

liangel/opt-125m-FP8

Text Generation • 0.2B • Updated 11 days ago • 220

dimitribarbot/Qwen-Image-int8wo

Text-to-Image • Updated 16 days ago • 142