Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up

turboderp
/
Llama-3-70B-exl2

Model card Files Files and versions Community
1
Llama-3-70B-exl2 / README.md
turboderp's picture
turboderp
Update README.md
e915155 verified over 1 year ago
preview code
|
raw
history blame contribute delete
909 Bytes

EXL2 quants of Llama-3 70B

2.40 bits per weight
2.80 bits per weight
3.00 bits per weight
3.50 bits per weight
4.00 bits per weight
4.50 bits per weight
5.00 bits per weight
6.00 bits per weight

measurement.json