turboderp
/

Phi-3-mini-128k-instruct-exl2

Model card Files Files and versions Community

Phi-3-mini-128k-instruct-exl2 / README.md

turboderp's picture

Update README.md

b15b7ad verified over 1 year ago

|

history blame contribute delete

744 Bytes

EXL2 quants of Phi-3 mini 128k instruct

~~2.50 bits per weight~~ (broken)
3.00 bits per weight
4.00 bits per weight
5.00 bits per weight
6.00 bits per weight

measurement.json