Models

t-tech/T-pro-it-2.0-AWQ

6B • Updated 5 days ago • 880 • 5

RedHatAI/Kimi-K2-Instruct-quantized.w4a16

Text Generation • Updated 5 days ago • 4.85k • 6

allenai/olmOCR-7B-0725-FP8

8B • Updated about 11 hours ago • 3

RedHatAI/Qwen2.5-VL-72B-Instruct-FP8-Dynamic

Image-to-Text • 73B • Updated Apr 25 • 1.87k • 7

RedHatAI/Qwen2.5-VL-7B-Instruct-quantized.w4a16

Image-to-Text • 3B • Updated Apr 3 • 1.55k • 5

RedHatAI/Qwen2.5-VL-72B-Instruct-quantized.w4a16

Image-to-Text • 13B • Updated 13 days ago • 1.33k • 5

RedHatAI/Llama-4-Scout-17B-16E-Instruct-quantized.w4a16

Image-Text-to-Text • 20B • Updated May 30 • 11.1k • 12

RedHatAI/Qwen3-1.7B-quantized.w4a16

Text Generation • 0.8B • Updated May 12 • 14 • 2

ionos/Llama-3.3-70B-Instruct-FP8

Text Generation • 71B • Updated 1 day ago • 103 • 2

RedHatAI/Meta-Llama-3.1-70B-Instruct-quantized.w8a8

Text Generation • 71B • Updated Feb 11 • 7k • 21

RedHatAI/Meta-Llama-3.1-8B-FP8

Text Generation • 8B • Updated Mar 25 • 3.87k • 8

EliasOenal/Mistral-Small-24B-Instruct-2501-W8A8-dynamic

Text Generation • 24B • Updated Feb 12 • 12 • 3

meta-llama/Llama-4-Maverick-17B-128E-Instruct-FP8

Image-Text-to-Text • 402B • Updated May 22 • 110k • • 123

RedHatAI/gemma-3-12b-it-FP8-dynamic

Image-Text-to-Text • 12B • Updated Jun 9 • 564 • 1

RedHatAI/gemma-3-27b-it-FP8-dynamic

Image-Text-to-Text • 27B • Updated Jun 9 • 15.6k • 4

justinjja/Qwen3-235B-A22B-INT4-W4A16

Text Generation • Updated Apr 30 • 944 • 10

RedHatAI/Qwen3-32B-quantized.w4a16

Text Generation • 6B • Updated May 13 • 2.31k • 8

BCCard/Qwen2.5-VL-32B-Instruct-FP8-Dynamic

Image-to-Text • 33B • Updated Jun 20 • 164k • 2

UnicornChan/Kimi-K2-GPTQ-4b-128g-experts

Updated 11 days ago • 152 • 1

RedHatAI/Llama-4-Maverick-17B-128E-Instruct-FP8

Image-Text-to-Text • 402B • Updated May 30 • 1.89k • 2

nm-testing/Devstral-Small-2505-FP8-dynamic

Text Generation • 24B • Updated May 21 • 815 • 1

RedHatAI/gemma-3-12b-it-quantized.w8a8

Image-Text-to-Text • 13B • Updated Jun 9 • 657 • 2

RedHatAI/gemma-3-27b-it-quantized.w8a8

Image-Text-to-Text • 29B • Updated Jun 9 • 1.86k • 7

RedHatAI/gemma-3-27b-it-quantized.w4a16

Image-Text-to-Text • 7B • Updated Jun 9 • 3.23k • 2

boboliu/Qwen3-Embedding-4B-W4A16-G128

Feature Extraction • 0.9B • Updated Jun 7 • 154 • 2

boboliu/Qwen3-Reranker-0.6B-W4A16-G128

Text Classification • 0.2B • Updated Jun 7 • 151 • 1

duydq12/nomic-embed-code-FP8-dynamic

Text Generation • 8B • Updated Jun 9 • 22 • 1

AMead10/GLM-4-32B-0414-awq

6B • Updated Jun 22 • 43 • 1

rednote-hilab/dots.llm1.inst-FP8-dynamic

Text Generation • 1B • Updated 30 days ago • 62 • 5

RedHatAI/Qwen3-32B-NVFP4

Text Generation • 19B • Updated 23 days ago • 1.03k • 2