Update README.md (#1)
Browse files- Update README.md (e479e0274f3c5a2e74436600a46f424daf6ad3e3)
Co-authored-by: Samuele Colombo <FinancialSupport@users.noreply.huggingface.co>
README.md
CHANGED
|
@@ -54,9 +54,13 @@ Please take it with a pinch of salt as we continue to study Modello Italia.
|
|
| 54 |
* The model architecture is **based on GPT-NeoX**.
|
| 55 |
|
| 56 |
## Results
|
| 57 |
-
|
| 58 |
-
|
| 59 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
| 60 |
|
| 61 |
## How to use Modello Italia with Hugging Face transformers
|
| 62 |
|
|
|
|
| 54 |
* The model architecture is **based on GPT-NeoX**.
|
| 55 |
|
| 56 |
## Results
|
| 57 |
+
For a detailed comparison of model performance, check out the [Leaderboard for Italian Language Models](https://huggingface.co/spaces/FinancialSupport/open_ita_llm_leaderboard).
|
| 58 |
+
|
| 59 |
+
Here's a breakdown of the performance metrics:
|
| 60 |
+
|
| 61 |
+
| Metric | hellaswag_it acc_norm | arc_it acc_norm | m_mmlu_it 5-shot acc | Average |
|
| 62 |
+
|:----------------------------|:----------------------|:----------------|:---------------------|:--------|
|
| 63 |
+
| **Accuracy Normalized** | 0.5679 | 0.3849 | 0.3522 | 0.4350 |
|
| 64 |
|
| 65 |
## How to use Modello Italia with Hugging Face transformers
|
| 66 |
|