File size: 504 Bytes
85256e8 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 |
---
base_model: TinyLlama/TinyLlama_v1.1
language: en
license: mit
---
## Metrics
| PPL | arc_easy |arc_challenge| piqa | winogrande | hellaswag |mmlu|QA Avg|
|-------:|------------|-------------|------------|------------|------------|----|-----:|
|47917.22|25.00 ± 0.89|23.89 ± 1.25 |53.43 ± 1.16|50.20 ± 1.41|25.62 ± 0.44|- | 35.63|
Training method based on [BitDistiller Paper](https://arxiv.org/abs/2402.10631)
- **License:** mit
- **Finetuned from:** TinyLlama/TinyLlama_v1.1 |