Hugging Face's logo

turboderp
/
Mistral-Small-3.1-24B-Instruct-2503-exl3

Model card Files
xet
Community
Mistral-Small-3.1-24B-Instruct-2503-exl3
File size: 1,310 Bytes 
501f663
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
 
---
license: apache-2.0
---
EXL3 quants of [Mistral-Small-3.1-24B-Instruct-2503](https://huggingface.co/mistralai/Mistral-Small-3.1-24B-Instruct-2503)

[2.00 bits per weight](https://huggingface.co/turboderp/Mistral-Small-3.1-24B-Instruct-2503-exl3/tree/2.0bpw)    
[2.50 bits per weight](https://huggingface.co/turboderp/Mistral-Small-3.1-24B-Instruct-2503-exl3/tree/2.5bpw)    
[3.00 bits per weight](https://huggingface.co/turboderp/Mistral-Small-3.1-24B-Instruct-2503-exl3/tree/3.0bpw)    
[3.50 bits per weight](https://huggingface.co/turboderp/Mistral-Small-3.1-24B-Instruct-2503-exl3/tree/3.5bpw)    
[4.00 bits per weight](https://huggingface.co/turboderp/Mistral-Small-3.1-24B-Instruct-2503-exl3/tree/4.0bpw)    
[5.00 bits per weight](https://huggingface.co/turboderp/Mistral-Small-3.1-24B-Instruct-2503-exl3/tree/5.0bpw)    
[6.00 bits per weight](https://huggingface.co/turboderp/Mistral-Small-3.1-24B-Instruct-2503-exl3/tree/6.0bpw)    
[8.00 bits per weight / H8](https://huggingface.co/turboderp/Mistral-Small-3.1-24B-Instruct-2503-exl3/tree/8.0bpw_H8)    

![image/png](https://cdn-uploads.huggingface.co/production/uploads/6383dc174c48969dcf1b4fce/l8gW7m949Zx6sdHL_y2_f.png)
![image/png](https://cdn-uploads.huggingface.co/production/uploads/6383dc174c48969dcf1b4fce/INHL5c4KEK5beZ8Kf0ptc.png)