turboderp
/

Cat-Llama-3-70B-instruct-exl2

Model card Files Files and versions

Cat-Llama-3-70B-instruct-exl2 / README.md

turboderp's picture

Create README.md

71a8b24 verified over 1 year ago

|

history blame contribute delete

628 Bytes

EXL2 quants of Cat Llama-3 70B instruct

2.50 bits per weight
3.00 bits per weight
4.00 bits per weight
5.00 bits per weight

measurement.json