RedHatAI/Qwen2-1.5B-Instruct-quantized.w8a16
Text Generation
•
0.6B
•
Updated
•
7
RedHatAI/Qwen2-0.5B-Instruct-quantized.w8a16
Text Generation
•
0.2B
•
Updated
•
22
RedHatAI/Llama-2-7b-chat-quantized.w4a16
Text Generation
•
1B
•
Updated
•
230
RedHatAI/Meta-Llama-3-8B-Instruct-quantized.w4a16
Text Generation
•
2B
•
Updated
•
516
•
2
RedHatAI/Llama-2-7b-chat-quantized.w8a16
Text Generation
•
2B
•
Updated
•
42
RedHatAI/Mistral-7B-Instruct-v0.3-quantized.w8a16
Text Generation
•
2B
•
Updated
•
223
RedHatAI/Meta-Llama-3-70B-Instruct-quantized.w8a16
Text Generation
•
19B
•
Updated
•
1.12k
•
5
RedHatAI/Meta-Llama-3-8B-Instruct-quantized.w8a16
Text Generation
•
3B
•
Updated
•
1.24k
•
3
RedHatAI/SparseLLama-2-7b-ultrachat_200k-pruned_50.2of4
Text Generation
•
7B
•
Updated
•
4
RedHatAI/SparseLlama-2-7b-evolcodealpaca-pruned_50.2of4
Text Generation
•
7B
•
Updated
•
3
RedHatAI/Meta-Llama-3-70B-Instruct-FP8-KV
Text Generation
•
71B
•
Updated
•
8
•
2
RedHatAI/Llama-2-7b-gsm8k-pruned_70
Text Generation
•
7B
•
Updated
•
50
RedHatAI/Llama-2-7b-gsm8k-pruned_50
Text Generation
•
7B
•
Updated
•
12
•
1
RedHatAI/Llama-2-7b-gsm8k
Text Generation
•
Updated
•
4.81k
•
5
RedHatAI/Meta-Llama-3-8B-Instruct-FP8-KV
Text Generation
•
8B
•
Updated
•
9.97k
•
•
8
RedHatAI/Mistral-7B-Instruct-v0.3-GPTQ-4bit
Text Generation
•
1B
•
Updated
•
76.2k
•
20
RedHatAI/SparseLlama-2-7b-cnn-daily-mail-pruned_50.2of4
Text Generation
•
7B
•
Updated
•
3
RedHatAI/SparseLlama-2-7b-cnn-daily-mail-pruned_70
Updated
RedHatAI/Llama-2-7b-cnn-daily-mail-pruned_70-quantized-deepsparse
Text Generation
•
Updated
•
3
RedHatAI/Llama-2-7b-cnn-daily-mail-pruned_50-quantized-deepsparse
Text Generation
•
Updated
•
4
RedHatAI/Llama-2-7b-dolphin-open_platypus-pruned_70-quantized-deepsparse
Text Generation
•
Updated
•
5
•
1
RedHatAI/Llama-2-7b-dolphin-open_platypus-pruned_50-quantized-deepsparse
Text Generation
•
Updated
•
5
RedHatAI/Llama-2-7b-cnn-daily-mail-pruned_70
Text Generation
•
7B
•
Updated
•
3
RedHatAI/Llama-2-7b-cnn-daily-mail-pruned_50
Text Generation
•
7B
•
Updated
•
3
RedHatAI/Llama-2-7b-cnn-daily-mail
Text Generation
•
7B
•
Updated
•
3
RedHatAI/Llama-2-7b-ultrachat200k-pruned_70
Text Generation
•
7B
•
Updated
•
13
RedHatAI/Llama-2-7b-ultrachat200k-pruned_70-quantized-deepsparse
Text Generation
•
Updated
•
4
RedHatAI/Llama-2-7b-ultrachat200k-pruned_50
Text Generation
•
7B
•
Updated
•
3
RedHatAI/Llama-2-7b-dolphin-open_platypus-pruned_70
Text Generation
•
7B
•
Updated
•
3
RedHatAI/Llama-2-7b-dolphin-open_platypus
Text Generation
•
7B
•
Updated
•
7