Whisper Quantized - a RedHatAI Collection

RedHatAI 's Collections

Red Hat AI validated models - October 2025

Red Hat AI validated models - September 2025

Speculator Models

Red Hat AI validated models - May 2025

Gemma-3 Quantized

Whisper Quantized

Llama 4 Quantized

Qwen3 Quantized

Mistral-Small-3.1 (2503) Instruct Quantized

Phi-4 Quantized

Llama 3.3 70B Instruct Quantized

Qwen 2.5 Quantized

Granite Quantized

Whisper Quantized

updated 16 days ago

Collection of quantized whisper models created by OpenAI

RedHatAI/whisper-large-v3-turbo-quantized.w4a16

Automatic Speech Recognition • 0.2B • Updated Oct 13 • 865 • 6
RedHatAI/whisper-large-v3-turbo-quantized.w8a8

Automatic Speech Recognition • 0.9B • Updated Apr 22 • 60 • 4
RedHatAI/whisper-large-v3-turbo-FP8-dynamic

Automatic Speech Recognition • 0.9B • Updated Apr 22 • 346 • 6
RedHatAI/whisper-tiny-FP8-Dynamic

Automatic Speech Recognition • 57.8M • Updated Apr 22 • 10
RedHatAI/whisper-large-v2-W4A16-G128

Automatic Speech Recognition • 0.3B • Updated Jan 31 • 6 • 1
RedHatAI/whisper-large-v2-quantized.w4a16

Automatic Speech Recognition • 0.3B • Updated Apr 22 • 13 • 1
RedHatAI/whisper-tiny-quantized.w8a8

Automatic Speech Recognition • 57.8M • Updated Apr 22 • 9
RedHatAI/whisper-large-v2-quantized.w8a8

Automatic Speech Recognition • 2B • Updated Apr 22 • 18
RedHatAI/whisper-medium-FP8-dynamic

Automatic Speech Recognition • 0.8B • Updated Apr 22 • 11
RedHatAI/whisper-small-FP8-Dynamic

Automatic Speech Recognition • 0.3B • Updated Apr 22 • 8
RedHatAI/whisper-small-quantized.w4a16

Automatic Speech Recognition • 77M • Updated Apr 22 • 13 • 1
RedHatAI/whisper-small-quantized.w8a8

Automatic Speech Recognition • 0.3B • Updated Apr 22 • 21
RedHatAI/whisper-large-v2-FP8-Dynamic

Automatic Speech Recognition • 2B • Updated Apr 22 • 26
RedHatAI/whisper-large-v3-FP8-dynamic

Automatic Speech Recognition • 2B • Updated Apr 22 • 274 • 2
RedHatAI/whisper-large-v3-quantized.w4a16

Automatic Speech Recognition • 0.3B • Updated Apr 22 • 871 • 3
RedHatAI/whisper-large-v3-quantized.w8a8

Automatic Speech Recognition • 2B • Updated Apr 22 • 271 • 1
RedHatAI/whisper-medium-quantized.w4a16

Automatic Speech Recognition • 0.2B • Updated Apr 22 • 8
RedHatAI/whisper-medium-quantized.w8a8

Automatic Speech Recognition • 0.8B • Updated Apr 22 • 21
RedHatAI/whisper-tiny-quantized.w4a16

Updated Apr 1