Update README.md
Browse files
README.md
CHANGED
@@ -6,6 +6,8 @@ license: apache-2.0
|
|
6 |
library_name: transformers
|
7 |
---
|
8 |
|
|
|
|
|
9 |
# Model Description
|
10 |
|
11 |
This model was built by translating the fineweb-edu annotations into 15 languages using a state-of-the-art proprietary LLM for translation, TowerLLM 70B.
|
@@ -33,7 +35,7 @@ from tqdm import tqdm
|
|
33 |
|
34 |
|
35 |
device = "cuda"
|
36 |
-
path = "
|
37 |
model = AutoModelForSequenceClassification.from_pretrained(
|
38 |
path,
|
39 |
device_map=device,
|
@@ -143,3 +145,15 @@ Binary head results:
|
|
143 |
macro avg 0.84 0.84 0.84 37537
|
144 |
weighted avg 0.95 0.95 0.95 37537
|
145 |
```
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
6 |
library_name: transformers
|
7 |
---
|
8 |
|
9 |
+

|
10 |
+
|
11 |
# Model Description
|
12 |
|
13 |
This model was built by translating the fineweb-edu annotations into 15 languages using a state-of-the-art proprietary LLM for translation, TowerLLM 70B.
|
|
|
35 |
|
36 |
|
37 |
device = "cuda"
|
38 |
+
path = "utter-project/EuroFilter-v1"
|
39 |
model = AutoModelForSequenceClassification.from_pretrained(
|
40 |
path,
|
41 |
device_map=device,
|
|
|
145 |
macro avg 0.84 0.84 0.84 37537
|
146 |
weighted avg 0.95 0.95 0.95 37537
|
147 |
```
|
148 |
+
|
149 |
+
## Citation
|
150 |
+
If you use our work, please cite:
|
151 |
+
```
|
152 |
+
@misc{martins2025eurollm9B,
|
153 |
+
title={EuroLLM-9B: Technical Report},
|
154 |
+
author={Pedro Henrique Martins and João Alves and Patrick Fernandes and and Nuno M. Guerreiro and Ricardo Rei and Amin Farajian and Mateusz Klimaszewski and Duarte M. Alves and José Pombal and Manuel Faysse and Pierre Colombo and François Yvon and Barry Haddow and José G. C. de Souza and Alexandra Birch and André F. T. Martins},
|
155 |
+
year={2025},
|
156 |
+
archivePrefix={arXiv},
|
157 |
+
primaryClass={cs.CL},
|
158 |
+
}
|
159 |
+
```
|