Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up

turboderp
/
Llama-3-8B-exl2

Model card Files Files and versions Community
Llama-3-8B-exl2 / README.md
turboderp's picture
turboderp
Create README.md
890e1af verified over 1 year ago
preview code
|
raw
history blame contribute delete
628 Bytes

EXL2 quants of Llama-3 8B

2.50 bits per weight
3.00 bits per weight
4.00 bits per weight
5.00 bits per weight
6.00 bits per weight

measurement.json