Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up

turboderp
/
Llama-3.1-8B-Instruct-exl2

Model card Files Files and versions Community
2
Llama-3.1-8B-Instruct-exl2 / README.md
turboderp's picture
turboderp
Update README.md
ef372e2 verified about 1 year ago
preview code
|
raw
history blame contribute delete
942 Bytes
metadata
license: llama3.1

EXL2 quants of Llama-3.1 8B instruct

3.00 bits per weight
3.50 bits per weight
4.00 bits per weight
4.50 bits per weight
5.00 bits per weight
6.00 bits per weight
8.00 bits per weight

measurement.json