Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

8-bit precision

Inference Endpoints

text-generation-inference

Misc with no match

4-bit precision

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

30

Full-text search

Active filters: w8a8

RedHatAI/Qwen2.5-VL-7B-Instruct-quantized.w8a8

Image-Text-to-Text • Updated Apr 3 • 1.38k • 5

RedHatAI/gemma-3-27b-it-quantized.w8a8

Image-Text-to-Text • Updated 1 day ago • 6 • 1

zzzmahesh/Meta-Llama-3-8B-Instruct-quantized.w8a8

Text Generation • Updated Sep 7, 2024 • 15

RedHatAI/Llama-3.1-Nemotron-70B-Instruct-HF-quantized.w8a8

Text Generation • Updated Jan 3 • 20

RedHatAI/QwQ-32B-Preview-quantized.w8a8

Text Generation • Updated Jan 3 • 20

NeoChen1024/Dolphin3.0-Llama3.1-8B-W8A8

Updated Apr 18 • 8

NeoChen1024/dolphin-2.9.3-mistral-7B-32k-W8A8

Updated Jan 6 • 3

RedHatAI/granite-3.1-8b-instruct-quantized.w8a8

Text Generation • Updated 8 days ago • 1k • 1

RedHatAI/granite-3.1-2b-instruct-quantized.w8a8

Text Generation • Updated Feb 28 • 755

RedHatAI/granite-3.1-2b-base-quantized.w8a8

Text Generation • Updated Feb 28 • 504

RedHatAI/granite-3.1-8b-base-quantized.w8a8

Text Generation • Updated Feb 28 • 446

NeoChen1024/Ministral-8B-Instruct-2410-W8A8

Updated Jan 17 • 6 • 1

RedHatAI/Qwen2-VL-72B-Instruct-quantized.w8a8

Image-Text-to-Text • Updated May 1 • 26

RedHatAI/Pixtral-Large-Instruct-2411-hf-quantized.w8a8

Image-Text-to-Text • Updated Mar 31 • 55

RedHatAI/Qwen2.5-VL-3B-Instruct-quantized.w8a8

Image-Text-to-Text • Updated May 1 • 1.37k • 2

RedHatAI/Qwen2.5-VL-72B-Instruct-quantized.w8a8

Image-Text-to-Text • Updated May 1 • 555

RedHatAI/pixtral-12b-quantized.w8a8

Image-Text-to-Text • Updated Feb 25 • 377 • 1

EliasOenal/Mistral-Small-24B-Instruct-2501-W8A8-dynamic

Text Generation • Updated Feb 12 • 11 • 2

EliasOenal/Llama-3.1-Nemotron-70B-Instruct-W8A8-dynamic

Text Generation • Updated Feb 12 • 13

RedHatAI/whisper-large-v3-quantized.w8a8

Automatic Speech Recognition • Updated Apr 22 • 36

RedHatAI/whisper-large-v2-quantized.w8a8

Automatic Speech Recognition • Updated Apr 22 • 16

RedHatAI/whisper-large-v3-turbo-quantized.w8a8

Automatic Speech Recognition • Updated Apr 22 • 166 • 2

RedHatAI/whisper-medium-quantized.w8a8

Automatic Speech Recognition • Updated Apr 22 • 22

RedHatAI/whisper-small-quantized.w8a8

Automatic Speech Recognition • Updated Apr 22 • 13

RedHatAI/whisper-tiny-quantized.w8a8

Automatic Speech Recognition • Updated Apr 22 • 19

parasail-ai/Qwen2.5-VL-72B-Instruct-quantized.w8a8

Image-Text-to-Text • Updated Apr 17 • 6

adriabama06/DeepCoder-1.5B-Preview-FP8-W8A8

Text Generation • Updated Apr 13 • 15 • 1

RedHatAI/gemma-3-4b-it-quantized.w8a8

Image-Text-to-Text • Updated 1 day ago • 25

RedHatAI/gemma-3-12b-it-quantized.w8a8

Image-Text-to-Text • Updated 1 day ago • 14

RedHatAI/gemma-3-1b-it-quantized.w8a8

Text Generation • Updated 1 day ago • 3