File size: 78,541 Bytes
e221d0a
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
---
library_name: transformers
license: other
base_model: nvidia/segformer-b1-finetuned-ade-512-512
tags:
- vision
- image-segmentation
- generated_from_trainer
model-index:
- name: my-fine-tuned-model
  results: []
---

<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->

# my-fine-tuned-model

This model is a fine-tuned version of [nvidia/segformer-b1-finetuned-ade-512-512](https://huggingface.co/nvidia/segformer-b1-finetuned-ade-512-512) on the segments/sidewalk-semantic dataset.
It achieves the following results on the evaluation set:
- Loss: 0.7904
- Mean Iou: 0.1971
- Mean Accuracy: 0.2386
- Overall Accuracy: 0.8024
- Accuracy Unlabeled: nan
- Accuracy Flat-road: 0.8832
- Accuracy Flat-sidewalk: 0.9527
- Accuracy Flat-crosswalk: 0.1578
- Accuracy Flat-cyclinglane: 0.6444
- Accuracy Flat-parkingdriveway: 0.2996
- Accuracy Flat-railtrack: nan
- Accuracy Flat-curb: 0.0548
- Accuracy Human-person: 0.0
- Accuracy Human-rider: 0.0
- Accuracy Vehicle-car: 0.9162
- Accuracy Vehicle-truck: 0.0
- Accuracy Vehicle-bus: 0.0
- Accuracy Vehicle-tramtrain: 0.0
- Accuracy Vehicle-motorcycle: 0.0
- Accuracy Vehicle-bicycle: 0.0
- Accuracy Vehicle-caravan: 0.0
- Accuracy Vehicle-cartrailer: 0.0
- Accuracy Construction-building: 0.9320
- Accuracy Construction-door: 0.0
- Accuracy Construction-wall: 0.0617
- Accuracy Construction-fenceguardrail: 0.0
- Accuracy Construction-bridge: 0.0
- Accuracy Construction-tunnel: nan
- Accuracy Construction-stairs: 0.0
- Accuracy Object-pole: 0.0
- Accuracy Object-trafficsign: 0.0
- Accuracy Object-trafficlight: 0.0
- Accuracy Nature-vegetation: 0.9229
- Accuracy Nature-terrain: 0.8768
- Accuracy Sky: 0.9321
- Accuracy Void-ground: 0.0
- Accuracy Void-dynamic: 0.0
- Accuracy Void-static: 0.0001
- Accuracy Void-unclear: 0.0
- Iou Unlabeled: nan
- Iou Flat-road: 0.7059
- Iou Flat-sidewalk: 0.8170
- Iou Flat-crosswalk: 0.1578
- Iou Flat-cyclinglane: 0.5477
- Iou Flat-parkingdriveway: 0.2484
- Iou Flat-railtrack: nan
- Iou Flat-curb: 0.0545
- Iou Human-person: 0.0
- Iou Human-rider: 0.0
- Iou Vehicle-car: 0.7758
- Iou Vehicle-truck: 0.0
- Iou Vehicle-bus: 0.0
- Iou Vehicle-tramtrain: 0.0
- Iou Vehicle-motorcycle: 0.0
- Iou Vehicle-bicycle: 0.0
- Iou Vehicle-caravan: 0.0
- Iou Vehicle-cartrailer: 0.0
- Iou Construction-building: 0.6064
- Iou Construction-door: 0.0
- Iou Construction-wall: 0.0615
- Iou Construction-fenceguardrail: 0.0
- Iou Construction-bridge: 0.0
- Iou Construction-tunnel: nan
- Iou Construction-stairs: 0.0
- Iou Object-pole: 0.0
- Iou Object-trafficsign: 0.0
- Iou Object-trafficlight: 0.0
- Iou Nature-vegetation: 0.7947
- Iou Nature-terrain: 0.6688
- Iou Sky: 0.8695
- Iou Void-ground: 0.0
- Iou Void-dynamic: 0.0
- Iou Void-static: 0.0001
- Iou Void-unclear: 0.0

## Model description

More information needed

## Intended uses & limitations

More information needed

## Training and evaluation data

More information needed

## Training procedure

### Training hyperparameters

The following hyperparameters were used during training:
- learning_rate: 6e-05
- train_batch_size: 2
- eval_batch_size: 2
- seed: 42
- optimizer: Use adamw_torch with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
- lr_scheduler_type: linear
- num_epochs: 2

### Training results

| Training Loss | Epoch | Step | Validation Loss | Mean Iou | Mean Accuracy | Overall Accuracy | Accuracy Unlabeled | Accuracy Flat-road | Accuracy Flat-sidewalk | Accuracy Flat-crosswalk | Accuracy Flat-cyclinglane | Accuracy Flat-parkingdriveway | Accuracy Flat-railtrack | Accuracy Flat-curb | Accuracy Human-person | Accuracy Human-rider | Accuracy Vehicle-car | Accuracy Vehicle-truck | Accuracy Vehicle-bus | Accuracy Vehicle-tramtrain | Accuracy Vehicle-motorcycle | Accuracy Vehicle-bicycle | Accuracy Vehicle-caravan | Accuracy Vehicle-cartrailer | Accuracy Construction-building | Accuracy Construction-door | Accuracy Construction-wall | Accuracy Construction-fenceguardrail | Accuracy Construction-bridge | Accuracy Construction-tunnel | Accuracy Construction-stairs | Accuracy Object-pole | Accuracy Object-trafficsign | Accuracy Object-trafficlight | Accuracy Nature-vegetation | Accuracy Nature-terrain | Accuracy Sky | Accuracy Void-ground | Accuracy Void-dynamic | Accuracy Void-static | Accuracy Void-unclear | Iou Unlabeled | Iou Flat-road | Iou Flat-sidewalk | Iou Flat-crosswalk | Iou Flat-cyclinglane | Iou Flat-parkingdriveway | Iou Flat-railtrack | Iou Flat-curb | Iou Human-person | Iou Human-rider | Iou Vehicle-car | Iou Vehicle-truck | Iou Vehicle-bus | Iou Vehicle-tramtrain | Iou Vehicle-motorcycle | Iou Vehicle-bicycle | Iou Vehicle-caravan | Iou Vehicle-cartrailer | Iou Construction-building | Iou Construction-door | Iou Construction-wall | Iou Construction-fenceguardrail | Iou Construction-bridge | Iou Construction-tunnel | Iou Construction-stairs | Iou Object-pole | Iou Object-trafficsign | Iou Object-trafficlight | Iou Nature-vegetation | Iou Nature-terrain | Iou Sky | Iou Void-ground | Iou Void-dynamic | Iou Void-static | Iou Void-unclear |
|:-------------:|:-----:|:----:|:---------------:|:--------:|:-------------:|:----------------:|:------------------:|:------------------:|:----------------------:|:-----------------------:|:-------------------------:|:-----------------------------:|:-----------------------:|:------------------:|:---------------------:|:--------------------:|:--------------------:|:----------------------:|:--------------------:|:--------------------------:|:---------------------------:|:------------------------:|:------------------------:|:---------------------------:|:------------------------------:|:--------------------------:|:--------------------------:|:------------------------------------:|:----------------------------:|:----------------------------:|:----------------------------:|:--------------------:|:---------------------------:|:----------------------------:|:--------------------------:|:-----------------------:|:------------:|:--------------------:|:---------------------:|:--------------------:|:---------------------:|:-------------:|:-------------:|:-----------------:|:------------------:|:--------------------:|:------------------------:|:------------------:|:-------------:|:----------------:|:---------------:|:---------------:|:-----------------:|:---------------:|:---------------------:|:----------------------:|:-------------------:|:-------------------:|:----------------------:|:-------------------------:|:---------------------:|:---------------------:|:-------------------------------:|:-----------------------:|:-----------------------:|:-----------------------:|:---------------:|:----------------------:|:-----------------------:|:---------------------:|:------------------:|:-------:|:---------------:|:----------------:|:---------------:|:----------------:|
| 2.2158        | 0.05  | 20   | 2.0002          | 0.1531   | 0.1992        | 0.7335           | nan                | 0.7769             | 0.9394                 | 0.0635                  | 0.1310                    | 0.0121                        | nan                     | 0.0022             | 0.0                   | 0.0                  | 0.8891               | 0.0                    | 0.0                  | 0.0                        | 0.0                         | 0.0                      | 0.0                      | 0.0                         | 0.9233                         | 0.0                        | 0.0267                     | 0.0                                  | 0.0                          | nan                          | 0.0                          | 0.0                  | 0.0                         | 0.0                          | 0.8661                     | 0.7970                  | 0.9466       | 0.0004               | 0.0                   | 0.0004               | 0.0                   | nan           | 0.5303        | 0.7439            | 0.0569             | 0.1245               | 0.0119                   | nan                | 0.0022        | 0.0              | 0.0             | 0.7091          | 0.0               | 0.0             | 0.0                   | 0.0                    | 0.0                 | 0.0                 | 0.0                    | 0.5630                    | 0.0                   | 0.0258                | 0.0                             | 0.0                     | nan                     | 0.0                     | 0.0             | 0.0                    | 0.0                     | 0.7539                | 0.5499             | 0.8267  | 0.0004          | 0.0              | 0.0004          | 0.0              |
| 1.9582        | 0.1   | 40   | 1.7936          | 0.1581   | 0.2009        | 0.7419           | nan                | 0.8227             | 0.9332                 | 0.0754                  | 0.1610                    | 0.0083                        | nan                     | 0.0019             | 0.0                   | 0.0                  | 0.8523               | 0.0                    | 0.0                  | 0.0                        | 0.0                         | 0.0                      | 0.0                      | 0.0                         | 0.9115                         | 0.0                        | 0.0070                     | 0.0                                  | 0.0                          | nan                          | 0.0                          | 0.0                  | 0.0                         | 0.0                          | 0.9078                     | 0.8206                  | 0.9255       | 0.0                  | 0.0                   | 0.0                  | 0.0                   | nan           | 0.5359        | 0.7551            | 0.0746             | 0.1510               | 0.0082                   | nan                | 0.0019        | 0.0              | 0.0             | 0.7279          | 0.0               | 0.0             | 0.0                   | 0.0                    | 0.0                 | 0.0                 | 0.0                    | 0.5676                    | 0.0                   | 0.0070                | 0.0                             | 0.0                     | nan                     | 0.0                     | 0.0             | 0.0                    | 0.0                     | 0.7635                | 0.6241             | 0.8425  | 0.0             | 0.0              | 0.0             | 0.0              |
| 1.6049        | 0.15  | 60   | 1.7152          | 0.1631   | 0.2024        | 0.7411           | nan                | 0.7410             | 0.9535                 | 0.2960                  | 0.2444                    | 0.0052                        | nan                     | 0.0007             | 0.0                   | 0.0                  | 0.8432               | 0.0                    | 0.0                  | 0.0                        | 0.0                         | 0.0                      | 0.0                      | 0.0                         | 0.9100                         | 0.0                        | 0.0026                     | 0.0                                  | 0.0                          | nan                          | 0.0                          | 0.0                  | 0.0                         | 0.0                          | 0.9368                     | 0.6248                  | 0.9179       | 0.0                  | 0.0                   | 0.0                  | 0.0                   | nan           | 0.5505        | 0.7411            | 0.2784             | 0.2050               | 0.0051                   | nan                | 0.0007        | 0.0              | 0.0             | 0.7346          | 0.0               | 0.0             | 0.0                   | 0.0                    | 0.0                 | 0.0                 | 0.0                    | 0.5691                    | 0.0                   | 0.0026                | 0.0                             | 0.0                     | nan                     | 0.0                     | 0.0             | 0.0                    | 0.0                     | 0.7421                | 0.5439             | 0.8453  | 0.0             | 0.0              | 0.0             | 0.0              |
| 1.8093        | 0.2   | 80   | 1.5565          | 0.1622   | 0.2027        | 0.7460           | nan                | 0.8047             | 0.9563                 | 0.2692                  | 0.0750                    | 0.0141                        | nan                     | 0.0009             | 0.0                   | 0.0                  | 0.8348               | 0.0                    | 0.0                  | 0.0                        | 0.0                         | 0.0                      | 0.0                      | 0.0                         | 0.9073                         | 0.0                        | 0.0001                     | 0.0                                  | 0.0                          | nan                          | 0.0                          | 0.0                  | 0.0                         | 0.0                          | 0.9325                     | 0.7803                  | 0.9123       | 0.0                  | 0.0                   | 0.0                  | 0.0                   | nan           | 0.5663        | 0.7517            | 0.2660             | 0.0734               | 0.0140                   | nan                | 0.0009        | 0.0              | 0.0             | 0.7257          | 0.0               | 0.0             | 0.0                   | 0.0                    | 0.0                 | 0.0                 | 0.0                    | 0.5679                    | 0.0                   | 0.0001                | 0.0                             | 0.0                     | nan                     | 0.0                     | 0.0             | 0.0                    | 0.0                     | 0.7579                | 0.6235             | 0.8433  | 0.0             | 0.0              | 0.0             | 0.0              |
| 2.141         | 0.25  | 100  | 1.4687          | 0.1639   | 0.2031        | 0.7411           | nan                | 0.6738             | 0.9693                 | 0.2106                  | 0.2394                    | 0.0116                        | nan                     | 0.0001             | 0.0                   | 0.0                  | 0.8568               | 0.0                    | 0.0                  | 0.0                        | 0.0                         | 0.0                      | 0.0                      | 0.0                         | 0.9066                         | 0.0                        | 0.0001                     | 0.0                                  | 0.0                          | nan                          | 0.0                          | 0.0                  | 0.0                         | 0.0                          | 0.9310                     | 0.7802                  | 0.9198       | 0.0                  | 0.0                   | 0.0                  | 0.0                   | nan           | 0.5383        | 0.7151            | 0.2098             | 0.2324               | 0.0116                   | nan                | 0.0001        | 0.0              | 0.0             | 0.7326          | 0.0               | 0.0             | 0.0                   | 0.0                    | 0.0                 | 0.0                 | 0.0                    | 0.5692                    | 0.0                   | 0.0001                | 0.0                             | 0.0                     | nan                     | 0.0                     | 0.0             | 0.0                    | 0.0                     | 0.7602                | 0.6314             | 0.8440  | 0.0             | 0.0              | 0.0             | 0.0              |
| 1.3787        | 0.3   | 120  | 1.3942          | 0.1714   | 0.2137        | 0.7584           | nan                | 0.8814             | 0.9357                 | 0.3762                  | 0.2179                    | 0.0010                        | nan                     | 0.0                | 0.0                   | 0.0                  | 0.8546               | 0.0                    | 0.0                  | 0.0                        | 0.0                         | 0.0                      | 0.0                      | 0.0                         | 0.8849                         | 0.0                        | 0.0003                     | 0.0                                  | 0.0                          | nan                          | 0.0                          | 0.0                  | 0.0                         | 0.0                          | 0.9329                     | 0.8229                  | 0.9290       | 0.0                  | 0.0                   | 0.0                  | 0.0                   | nan           | 0.5695        | 0.7813            | 0.3723             | 0.2134               | 0.0010                   | nan                | 0.0           | 0.0              | 0.0             | 0.7387          | 0.0               | 0.0             | 0.0                   | 0.0                    | 0.0                 | 0.0                 | 0.0                    | 0.5913                    | 0.0                   | 0.0003                | 0.0                             | 0.0                     | nan                     | 0.0                     | 0.0             | 0.0                    | 0.0                     | 0.7507                | 0.6194             | 0.8474  | 0.0             | 0.0              | 0.0             | 0.0              |
| 2.1678        | 0.35  | 140  | 1.3191          | 0.1665   | 0.2078        | 0.7564           | nan                | 0.8526             | 0.9400                 | 0.1915                  | 0.2378                    | 0.0107                        | nan                     | 0.0                | 0.0                   | 0.0                  | 0.8580               | 0.0                    | 0.0                  | 0.0                        | 0.0                         | 0.0                      | 0.0                      | 0.0                         | 0.9124                         | 0.0                        | 0.0013                     | 0.0                                  | 0.0                          | nan                          | 0.0                          | 0.0                  | 0.0                         | 0.0                          | 0.9345                     | 0.8012                  | 0.9108       | 0.0                  | 0.0                   | 0.0                  | 0.0                   | nan           | 0.5676        | 0.7800            | 0.1913             | 0.2243               | 0.0107                   | nan                | 0.0           | 0.0              | 0.0             | 0.7504          | 0.0               | 0.0             | 0.0                   | 0.0                    | 0.0                 | 0.0                 | 0.0                    | 0.5772                    | 0.0                   | 0.0013                | 0.0                             | 0.0                     | nan                     | 0.0                     | 0.0             | 0.0                    | 0.0                     | 0.7584                | 0.6144             | 0.8521  | 0.0             | 0.0              | 0.0             | 0.0              |
| 1.5235        | 0.4   | 160  | 1.2587          | 0.1605   | 0.2009        | 0.7567           | nan                | 0.9164             | 0.9411                 | 0.0361                  | 0.2337                    | 0.0020                        | nan                     | 0.0                | 0.0                   | 0.0                  | 0.8709               | 0.0                    | 0.0                  | 0.0                        | 0.0                         | 0.0                      | 0.0                      | 0.0                         | 0.9204                         | 0.0                        | 0.0037                     | 0.0                                  | 0.0                          | nan                          | 0.0                          | 0.0                  | 0.0                         | 0.0                          | 0.9095                     | 0.6843                  | 0.9102       | 0.0                  | 0.0                   | 0.0000               | 0.0                   | nan           | 0.5686        | 0.7903            | 0.0361             | 0.2286               | 0.0019                   | nan                | 0.0           | 0.0              | 0.0             | 0.7445          | 0.0               | 0.0             | 0.0                   | 0.0                    | 0.0                 | 0.0                 | 0.0                    | 0.5834                    | 0.0                   | 0.0037                | 0.0                             | 0.0                     | nan                     | 0.0                     | 0.0             | 0.0                    | 0.0                     | 0.7660                | 0.5633             | 0.8495  | 0.0             | 0.0              | 0.0000          | 0.0              |
| 1.2732        | 0.45  | 180  | 1.2095          | 0.1754   | 0.2165        | 0.7714           | nan                | 0.8481             | 0.9572                 | 0.2584                  | 0.3755                    | 0.0225                        | nan                     | 0.0                | 0.0                   | 0.0                  | 0.8876               | 0.0                    | 0.0                  | 0.0                        | 0.0                         | 0.0                      | 0.0                      | 0.0                         | 0.8993                         | 0.0                        | 0.0022                     | 0.0                                  | 0.0                          | nan                          | 0.0                          | 0.0                  | 0.0                         | 0.0                          | 0.9400                     | 0.8131                  | 0.9231       | 0.0                  | 0.0                   | 0.0                  | 0.0                   | nan           | 0.6356        | 0.7788            | 0.2580             | 0.3514               | 0.0223                   | nan                | 0.0           | 0.0              | 0.0             | 0.7521          | 0.0               | 0.0             | 0.0                   | 0.0                    | 0.0                 | 0.0                 | 0.0                    | 0.5918                    | 0.0                   | 0.0022                | 0.0                             | 0.0                     | nan                     | 0.0                     | 0.0             | 0.0                    | 0.0                     | 0.7576                | 0.6086             | 0.8556  | 0.0             | 0.0              | 0.0             | 0.0              |
| 1.5411        | 0.5   | 200  | 1.1710          | 0.1639   | 0.2054        | 0.7589           | nan                | 0.8539             | 0.9510                 | 0.0052                  | 0.3140                    | 0.0310                        | nan                     | 0.0                | 0.0                   | 0.0                  | 0.8670               | 0.0                    | 0.0                  | 0.0                        | 0.0                         | 0.0                      | 0.0                      | 0.0                         | 0.9263                         | 0.0                        | 0.0002                     | 0.0                                  | 0.0                          | nan                          | 0.0                          | 0.0                  | 0.0                         | 0.0                          | 0.8942                     | 0.8270                  | 0.9025       | 0.0                  | 0.0                   | 0.0                  | 0.0                   | nan           | 0.5897        | 0.7696            | 0.0052             | 0.3098               | 0.0308                   | nan                | 0.0           | 0.0              | 0.0             | 0.7592          | 0.0               | 0.0             | 0.0                   | 0.0                    | 0.0                 | 0.0                 | 0.0                    | 0.5790                    | 0.0                   | 0.0002                | 0.0                             | 0.0                     | nan                     | 0.0                     | 0.0             | 0.0                    | 0.0                     | 0.7613                | 0.5892             | 0.8519  | 0.0             | 0.0              | 0.0             | 0.0              |
| 1.062         | 0.55  | 220  | 1.1501          | 0.1693   | 0.2090        | 0.7668           | nan                | 0.7840             | 0.9652                 | 0.0006                  | 0.5111                    | 0.0228                        | nan                     | 0.0001             | 0.0                   | 0.0                  | 0.8914               | 0.0                    | 0.0                  | 0.0                        | 0.0                         | 0.0                      | 0.0                      | 0.0                         | 0.9286                         | 0.0                        | 0.0                        | 0.0                                  | 0.0                          | nan                          | 0.0                          | 0.0                  | 0.0                         | 0.0                          | 0.9232                     | 0.7398                  | 0.9217       | 0.0                  | 0.0                   | 0.0                  | 0.0                   | nan           | 0.6406        | 0.7576            | 0.0006             | 0.4293               | 0.0226                   | nan                | 0.0001        | 0.0              | 0.0             | 0.7549          | 0.0               | 0.0             | 0.0                   | 0.0                    | 0.0                 | 0.0                 | 0.0                    | 0.5749                    | 0.0                   | 0.0                   | 0.0                             | 0.0                     | nan                     | 0.0                     | 0.0             | 0.0                    | 0.0                     | 0.7704                | 0.6130             | 0.8535  | 0.0             | 0.0              | 0.0             | 0.0              |
| 1.5911        | 0.6   | 240  | 1.0884          | 0.1690   | 0.2102        | 0.7700           | nan                | 0.8598             | 0.9490                 | 0.0                     | 0.4066                    | 0.0340                        | nan                     | 0.0                | 0.0                   | 0.0                  | 0.8831               | 0.0                    | 0.0                  | 0.0                        | 0.0                         | 0.0                      | 0.0                      | 0.0                         | 0.9139                         | 0.0                        | 0.0012                     | 0.0                                  | 0.0                          | nan                          | 0.0                          | 0.0                  | 0.0                         | 0.0                          | 0.9403                     | 0.8172                  | 0.9200       | 0.0                  | 0.0                   | 0.0                  | 0.0                   | nan           | 0.6031        | 0.7894            | 0.0                | 0.3861               | 0.0336                   | nan                | 0.0           | 0.0              | 0.0             | 0.7476          | 0.0               | 0.0             | 0.0                   | 0.0                    | 0.0                 | 0.0                 | 0.0                    | 0.5926                    | 0.0                   | 0.0012                | 0.0                             | 0.0                     | nan                     | 0.0                     | 0.0             | 0.0                    | 0.0                     | 0.7638                | 0.6339             | 0.8554  | 0.0             | 0.0              | 0.0             | 0.0              |
| 1.0154        | 0.65  | 260  | 1.0465          | 0.1734   | 0.2163        | 0.7802           | nan                | 0.8796             | 0.9503                 | 0.0                     | 0.5320                    | 0.0414                        | nan                     | 0.0                | 0.0                   | 0.0                  | 0.9026               | 0.0                    | 0.0                  | 0.0                        | 0.0                         | 0.0                      | 0.0                      | 0.0                         | 0.8953                         | 0.0                        | 0.0                        | 0.0                                  | 0.0                          | nan                          | 0.0                          | 0.0                  | 0.0                         | 0.0                          | 0.9402                     | 0.8527                  | 0.9278       | 0.0                  | 0.0                   | 0.0                  | 0.0                   | nan           | 0.6237        | 0.8112            | 0.0                | 0.4723               | 0.0407                   | nan                | 0.0           | 0.0              | 0.0             | 0.7194          | 0.0               | 0.0             | 0.0                   | 0.0                    | 0.0                 | 0.0                 | 0.0                    | 0.6077                    | 0.0                   | 0.0                   | 0.0                             | 0.0                     | nan                     | 0.0                     | 0.0             | 0.0                    | 0.0                     | 0.7606                | 0.6549             | 0.8580  | 0.0             | 0.0              | 0.0             | 0.0              |
| 0.8996        | 0.7   | 280  | 1.0698          | 0.1697   | 0.2101        | 0.7711           | nan                | 0.8725             | 0.9526                 | 0.0                     | 0.3816                    | 0.0707                        | nan                     | 0.0                | 0.0                   | 0.0                  | 0.8963               | 0.0                    | 0.0                  | 0.0                        | 0.0                         | 0.0                      | 0.0                      | 0.0                         | 0.9135                         | 0.0                        | 0.0073                     | 0.0                                  | 0.0                          | nan                          | 0.0                          | 0.0                  | 0.0                         | 0.0                          | 0.9332                     | 0.7679                  | 0.9266       | 0.0                  | 0.0                   | 0.0                  | 0.0                   | nan           | 0.6083        | 0.7907            | 0.0                | 0.3740               | 0.0688                   | nan                | 0.0           | 0.0              | 0.0             | 0.7335          | 0.0               | 0.0             | 0.0                   | 0.0                    | 0.0                 | 0.0                 | 0.0                    | 0.5958                    | 0.0                   | 0.0073                | 0.0                             | 0.0                     | nan                     | 0.0                     | 0.0             | 0.0                    | 0.0                     | 0.7608                | 0.6363             | 0.8548  | 0.0             | 0.0              | 0.0             | 0.0              |
| 1.0455        | 0.75  | 300  | 0.9854          | 0.1772   | 0.2185        | 0.7836           | nan                | 0.8979             | 0.9554                 | 0.0                     | 0.5260                    | 0.1113                        | nan                     | 0.0                | 0.0                   | 0.0                  | 0.8879               | 0.0                    | 0.0                  | 0.0                        | 0.0                         | 0.0                      | 0.0                      | 0.0                         | 0.9399                         | 0.0                        | 0.0071                     | 0.0                                  | 0.0                          | nan                          | 0.0                          | 0.0                  | 0.0                         | 0.0                          | 0.8980                     | 0.8530                  | 0.9158       | 0.0                  | 0.0                   | 0.0002               | 0.0                   | nan           | 0.6647        | 0.8020            | 0.0                | 0.4660               | 0.1059                   | nan                | 0.0           | 0.0              | 0.0             | 0.7598          | 0.0               | 0.0             | 0.0                   | 0.0                    | 0.0                 | 0.0                 | 0.0                    | 0.5839                    | 0.0                   | 0.0071                | 0.0                             | 0.0                     | nan                     | 0.0                     | 0.0             | 0.0                    | 0.0                     | 0.7819                | 0.6468             | 0.8533  | 0.0             | 0.0              | 0.0002          | 0.0              |
| 1.1151        | 0.8   | 320  | 0.9950          | 0.1758   | 0.2160        | 0.7764           | nan                | 0.7947             | 0.9710                 | 0.0                     | 0.5046                    | 0.1048                        | nan                     | 0.0                | 0.0                   | 0.0                  | 0.8942               | 0.0                    | 0.0                  | 0.0                        | 0.0                         | 0.0                      | 0.0                      | 0.0                         | 0.9235                         | 0.0                        | 0.0114                     | 0.0                                  | 0.0                          | nan                          | 0.0                          | 0.0                  | 0.0                         | 0.0                          | 0.9203                     | 0.8627                  | 0.9265       | 0.0                  | 0.0                   | 0.0000               | 0.0                   | nan           | 0.6554        | 0.7652            | 0.0                | 0.4549               | 0.0997                   | nan                | 0.0           | 0.0              | 0.0             | 0.7722          | 0.0               | 0.0             | 0.0                   | 0.0                    | 0.0                 | 0.0                 | 0.0                    | 0.5932                    | 0.0                   | 0.0114                | 0.0                             | 0.0                     | nan                     | 0.0                     | 0.0             | 0.0                    | 0.0                     | 0.7800                | 0.6352             | 0.8593  | 0.0             | 0.0              | 0.0000          | 0.0              |
| 0.9324        | 0.85  | 340  | 0.9678          | 0.1777   | 0.2180        | 0.7848           | nan                | 0.9175             | 0.9396                 | 0.0                     | 0.5899                    | 0.0978                        | nan                     | 0.0                | 0.0                   | 0.0                  | 0.8888               | 0.0                    | 0.0                  | 0.0                        | 0.0                         | 0.0                      | 0.0                      | 0.0                         | 0.9113                         | 0.0                        | 0.0016                     | 0.0                                  | 0.0                          | nan                          | 0.0                          | 0.0                  | 0.0                         | 0.0                          | 0.9461                     | 0.7715                  | 0.9111       | 0.0                  | 0.0                   | 0.0001               | 0.0                   | nan           | 0.6241        | 0.8212            | 0.0                | 0.5332               | 0.0953                   | nan                | 0.0           | 0.0              | 0.0             | 0.7650          | 0.0               | 0.0             | 0.0                   | 0.0                    | 0.0                 | 0.0                 | 0.0                    | 0.6052                    | 0.0                   | 0.0016                | 0.0                             | 0.0                     | nan                     | 0.0                     | 0.0             | 0.0                    | 0.0                     | 0.7597                | 0.6233             | 0.8572  | 0.0             | 0.0              | 0.0001          | 0.0              |
| 1.2833        | 0.9   | 360  | 0.9499          | 0.1796   | 0.2219        | 0.7872           | nan                | 0.8955             | 0.9492                 | 0.0                     | 0.6118                    | 0.1297                        | nan                     | 0.0000             | 0.0                   | 0.0                  | 0.9021               | 0.0                    | 0.0                  | 0.0                        | 0.0                         | 0.0                      | 0.0                      | 0.0                         | 0.9220                         | 0.0                        | 0.0000                     | 0.0                                  | 0.0                          | nan                          | 0.0                          | 0.0                  | 0.0                         | 0.0                          | 0.9116                     | 0.8733                  | 0.9055       | 0.0                  | 0.0                   | 0.0000               | 0.0                   | nan           | 0.6470        | 0.8098            | 0.0                | 0.5469               | 0.1222                   | nan                | 0.0000        | 0.0              | 0.0             | 0.7614          | 0.0               | 0.0             | 0.0                   | 0.0                    | 0.0                 | 0.0                 | 0.0                    | 0.6024                    | 0.0                   | 0.0000                | 0.0                             | 0.0                     | nan                     | 0.0                     | 0.0             | 0.0                    | 0.0                     | 0.7813                | 0.6212             | 0.8554  | 0.0             | 0.0              | 0.0000          | 0.0              |
| 1.4176        | 0.95  | 380  | 0.9139          | 0.1787   | 0.2189        | 0.7850           | nan                | 0.8862             | 0.9493                 | 0.0                     | 0.5835                    | 0.0994                        | nan                     | 0.0                | 0.0                   | 0.0                  | 0.9040               | 0.0                    | 0.0                  | 0.0                        | 0.0                         | 0.0                      | 0.0                      | 0.0                         | 0.9214                         | 0.0                        | 0.0145                     | 0.0                                  | 0.0                          | nan                          | 0.0                          | 0.0                  | 0.0                         | 0.0                          | 0.9361                     | 0.7945                  | 0.9172       | 0.0                  | 0.0                   | 0.0                  | 0.0                   | nan           | 0.6505        | 0.8022            | 0.0                | 0.5362               | 0.0952                   | nan                | 0.0           | 0.0              | 0.0             | 0.7533          | 0.0               | 0.0             | 0.0                   | 0.0                    | 0.0                 | 0.0                 | 0.0                    | 0.5977                    | 0.0                   | 0.0145                | 0.0                             | 0.0                     | nan                     | 0.0                     | 0.0             | 0.0                    | 0.0                     | 0.7687                | 0.6399             | 0.8597  | 0.0             | 0.0              | 0.0             | 0.0              |
| 1.5852        | 1.0   | 400  | 0.8985          | 0.1849   | 0.2264        | 0.7912           | nan                | 0.8786             | 0.9434                 | 0.0                     | 0.6576                    | 0.2217                        | nan                     | 0.0001             | 0.0                   | 0.0                  | 0.8940               | 0.0                    | 0.0                  | 0.0                        | 0.0                         | 0.0                      | 0.0                      | 0.0                         | 0.9119                         | 0.0                        | 0.0250                     | 0.0                                  | 0.0                          | nan                          | 0.0                          | 0.0                  | 0.0                         | 0.0                          | 0.9404                     | 0.8480                  | 0.9235       | 0.0                  | 0.0                   | 0.0                  | 0.0                   | nan           | 0.6629        | 0.8125            | 0.0                | 0.5617               | 0.1965                   | nan                | 0.0001        | 0.0              | 0.0             | 0.7659          | 0.0               | 0.0             | 0.0                   | 0.0                    | 0.0                 | 0.0                 | 0.0                    | 0.5939                    | 0.0                   | 0.0250                | 0.0                             | 0.0                     | nan                     | 0.0                     | 0.0             | 0.0                    | 0.0                     | 0.7713                | 0.6680             | 0.8603  | 0.0             | 0.0              | 0.0             | 0.0              |
| 0.8892        | 1.05  | 420  | 0.8932          | 0.1843   | 0.2256        | 0.7896           | nan                | 0.8623             | 0.9523                 | 0.0011                  | 0.6176                    | 0.2245                        | nan                     | 0.0001             | 0.0                   | 0.0                  | 0.8965               | 0.0                    | 0.0                  | 0.0                        | 0.0                         | 0.0                      | 0.0                      | 0.0                         | 0.9049                         | 0.0                        | 0.0278                     | 0.0                                  | 0.0                          | nan                          | 0.0                          | 0.0                  | 0.0                         | 0.0                          | 0.9322                     | 0.8637                  | 0.9378       | 0.0                  | 0.0                   | 0.0                  | 0.0                   | nan           | 0.6605        | 0.8028            | 0.0011             | 0.5392               | 0.1996                   | nan                | 0.0001        | 0.0              | 0.0             | 0.7690          | 0.0               | 0.0             | 0.0                   | 0.0                    | 0.0                 | 0.0                 | 0.0                    | 0.5957                    | 0.0                   | 0.0278                | 0.0                             | 0.0                     | nan                     | 0.0                     | 0.0             | 0.0                    | 0.0                     | 0.7779                | 0.6651             | 0.8598  | 0.0             | 0.0              | 0.0             | 0.0              |
| 1.3728        | 1.1   | 440  | 0.8947          | 0.1843   | 0.2250        | 0.7871           | nan                | 0.9545             | 0.9133                 | 0.0012                  | 0.5891                    | 0.2055                        | nan                     | 0.0                | 0.0                   | 0.0                  | 0.8904               | 0.0                    | 0.0                  | 0.0                        | 0.0                         | 0.0                      | 0.0                      | 0.0                         | 0.9167                         | 0.0                        | 0.0283                     | 0.0                                  | 0.0                          | nan                          | 0.0                          | 0.0                  | 0.0                         | 0.0                          | 0.9387                     | 0.8453                  | 0.9164       | 0.0                  | 0.0                   | 0.0                  | 0.0                   | nan           | 0.6190        | 0.8164            | 0.0012             | 0.5548               | 0.1853                   | nan                | 0.0           | 0.0              | 0.0             | 0.7669          | 0.0               | 0.0             | 0.0                   | 0.0                    | 0.0                 | 0.0                 | 0.0                    | 0.5998                    | 0.0                   | 0.0283                | 0.0                             | 0.0                     | nan                     | 0.0                     | 0.0             | 0.0                    | 0.0                     | 0.7810                | 0.6808             | 0.8625  | 0.0             | 0.0              | 0.0             | 0.0              |
| 1.0203        | 1.15  | 460  | 0.9012          | 0.1921   | 0.2356        | 0.7922           | nan                | 0.8315             | 0.9509                 | 0.2213                  | 0.6239                    | 0.3029                        | nan                     | 0.0024             | 0.0                   | 0.0                  | 0.9204               | 0.0                    | 0.0                  | 0.0                        | 0.0                         | 0.0                      | 0.0                      | 0.0                         | 0.9208                         | 0.0                        | 0.0254                     | 0.0                                  | 0.0                          | nan                          | 0.0                          | 0.0                  | 0.0                         | 0.0                          | 0.9207                     | 0.8916                  | 0.9264       | 0.0                  | 0.0                   | 0.0                  | 0.0                   | nan           | 0.6787        | 0.8015            | 0.2210             | 0.5011               | 0.2456                   | nan                | 0.0024        | 0.0              | 0.0             | 0.7583          | 0.0               | 0.0             | 0.0                   | 0.0                    | 0.0                 | 0.0                 | 0.0                    | 0.6075                    | 0.0                   | 0.0254                | 0.0                             | 0.0                     | nan                     | 0.0                     | 0.0             | 0.0                    | 0.0                     | 0.7875                | 0.6509             | 0.8660  | 0.0             | 0.0              | 0.0             | 0.0              |
| 0.745         | 1.2   | 480  | 0.8717          | 0.1869   | 0.2290        | 0.7920           | nan                | 0.8772             | 0.9436                 | 0.0284                  | 0.6182                    | 0.2724                        | nan                     | 0.0006             | 0.0                   | 0.0                  | 0.8924               | 0.0                    | 0.0                  | 0.0                        | 0.0                         | 0.0                      | 0.0                      | 0.0                         | 0.9175                         | 0.0                        | 0.0259                     | 0.0                                  | 0.0                          | nan                          | 0.0                          | 0.0                  | 0.0                         | 0.0                          | 0.9304                     | 0.8811                  | 0.9417       | 0.0                  | 0.0                   | 0.0000               | 0.0                   | nan           | 0.6584        | 0.8095            | 0.0284             | 0.5318               | 0.2370                   | nan                | 0.0006        | 0.0              | 0.0             | 0.7819          | 0.0               | 0.0             | 0.0                   | 0.0                    | 0.0                 | 0.0                 | 0.0                    | 0.6033                    | 0.0                   | 0.0258                | 0.0                             | 0.0                     | nan                     | 0.0                     | 0.0             | 0.0                    | 0.0                     | 0.7810                | 0.6620             | 0.8620  | 0.0             | 0.0              | 0.0000          | 0.0              |
| 0.7155        | 1.25  | 500  | 0.8794          | 0.1859   | 0.2252        | 0.7909           | nan                | 0.8482             | 0.9649                 | 0.0539                  | 0.5716                    | 0.1992                        | nan                     | 0.0016             | 0.0                   | 0.0                  | 0.8988               | 0.0                    | 0.0                  | 0.0                        | 0.0                         | 0.0                      | 0.0                      | 0.0                         | 0.9152                         | 0.0                        | 0.0215                     | 0.0                                  | 0.0                          | nan                          | 0.0                          | 0.0                  | 0.0                         | 0.0                          | 0.9366                     | 0.8641                  | 0.9314       | 0.0                  | 0.0                   | 0.0                  | 0.0                   | nan           | 0.6828        | 0.7895            | 0.0539             | 0.5263               | 0.1845                   | nan                | 0.0016        | 0.0              | 0.0             | 0.7764          | 0.0               | 0.0             | 0.0                   | 0.0                    | 0.0                 | 0.0                 | 0.0                    | 0.6057                    | 0.0                   | 0.0215                | 0.0                             | 0.0                     | nan                     | 0.0                     | 0.0             | 0.0                    | 0.0                     | 0.7760                | 0.6661             | 0.8655  | 0.0             | 0.0              | 0.0             | 0.0              |
| 0.9982        | 1.3   | 520  | 0.8429          | 0.1871   | 0.2279        | 0.7960           | nan                | 0.8970             | 0.9526                 | 0.0260                  | 0.6037                    | 0.2279                        | nan                     | 0.0033             | 0.0                   | 0.0                  | 0.8983               | 0.0                    | 0.0                  | 0.0                        | 0.0                         | 0.0                      | 0.0                      | 0.0                         | 0.9289                         | 0.0                        | 0.0241                     | 0.0                                  | 0.0                          | nan                          | 0.0                          | 0.0                  | 0.0                         | 0.0                          | 0.9292                     | 0.8674                  | 0.9357       | 0.0                  | 0.0                   | 0.0001               | 0.0                   | nan           | 0.6937        | 0.8117            | 0.0260             | 0.5243               | 0.2086                   | nan                | 0.0033        | 0.0              | 0.0             | 0.7755          | 0.0               | 0.0             | 0.0                   | 0.0                    | 0.0                 | 0.0                 | 0.0                    | 0.5998                    | 0.0                   | 0.0240                | 0.0                             | 0.0                     | nan                     | 0.0                     | 0.0             | 0.0                    | 0.0                     | 0.7822                | 0.6708             | 0.8660  | 0.0             | 0.0              | 0.0001          | 0.0              |
| 0.8799        | 1.35  | 540  | 0.8768          | 0.1917   | 0.2324        | 0.7897           | nan                | 0.7844             | 0.9697                 | 0.2185                  | 0.6217                    | 0.2031                        | nan                     | 0.0325             | 0.0                   | 0.0                  | 0.9088               | 0.0                    | 0.0                  | 0.0                        | 0.0                         | 0.0                      | 0.0                      | 0.0                         | 0.9296                         | 0.0                        | 0.0496                     | 0.0                                  | 0.0                          | nan                          | 0.0                          | 0.0                  | 0.0                         | 0.0                          | 0.9237                     | 0.8568                  | 0.9379       | 0.0                  | 0.0                   | 0.0001               | 0.0                   | nan           | 0.6748        | 0.7878            | 0.2181             | 0.5009               | 0.1795                   | nan                | 0.0324        | 0.0              | 0.0             | 0.7791          | 0.0               | 0.0             | 0.0                   | 0.0                    | 0.0                 | 0.0                 | 0.0                    | 0.6018                    | 0.0                   | 0.0495                | 0.0                             | 0.0                     | nan                     | 0.0                     | 0.0             | 0.0                    | 0.0                     | 0.7859                | 0.6572             | 0.8671  | 0.0             | 0.0              | 0.0001          | 0.0              |
| 0.8828        | 1.4   | 560  | 0.8434          | 0.1894   | 0.2302        | 0.7972           | nan                | 0.9184             | 0.9432                 | 0.0183                  | 0.6022                    | 0.2673                        | nan                     | 0.0111             | 0.0                   | 0.0                  | 0.9107               | 0.0                    | 0.0                  | 0.0                        | 0.0                         | 0.0                      | 0.0                      | 0.0                         | 0.9249                         | 0.0                        | 0.0546                     | 0.0                                  | 0.0                          | nan                          | 0.0                          | 0.0                  | 0.0                         | 0.0                          | 0.9298                     | 0.8666                  | 0.9198       | 0.0                  | 0.0                   | 0.0                  | 0.0                   | nan           | 0.6739        | 0.8188            | 0.0183             | 0.5527               | 0.2330                   | nan                | 0.0111        | 0.0              | 0.0             | 0.7679          | 0.0               | 0.0             | 0.0                   | 0.0                    | 0.0                 | 0.0                 | 0.0                    | 0.6061                    | 0.0                   | 0.0545                | 0.0                             | 0.0                     | nan                     | 0.0                     | 0.0             | 0.0                    | 0.0                     | 0.7853                | 0.6722             | 0.8666  | 0.0             | 0.0              | 0.0             | 0.0              |
| 0.7109        | 1.45  | 580  | 0.8446          | 0.1888   | 0.2287        | 0.7958           | nan                | 0.9046             | 0.9491                 | 0.0234                  | 0.5846                    | 0.2557                        | nan                     | 0.0237             | 0.0                   | 0.0                  | 0.9040               | 0.0                    | 0.0                  | 0.0                        | 0.0                         | 0.0                      | 0.0                      | 0.0                         | 0.9350                         | 0.0                        | 0.0319                     | 0.0                                  | 0.0                          | nan                          | 0.0                          | 0.0                  | 0.0                         | 0.0                          | 0.9252                     | 0.8524                  | 0.9280       | 0.0                  | 0.0                   | 0.0001               | 0.0                   | nan           | 0.6886        | 0.8083            | 0.0234             | 0.5422               | 0.2245                   | nan                | 0.0236        | 0.0              | 0.0             | 0.7800          | 0.0               | 0.0             | 0.0                   | 0.0                    | 0.0                 | 0.0                 | 0.0                    | 0.5940                    | 0.0                   | 0.0318                | 0.0                             | 0.0                     | nan                     | 0.0                     | 0.0             | 0.0                    | 0.0                     | 0.7896                | 0.6663             | 0.8682  | 0.0             | 0.0              | 0.0001          | 0.0              |
| 0.6376        | 1.5   | 600  | 0.8241          | 0.1950   | 0.2351        | 0.7978           | nan                | 0.8681             | 0.9553                 | 0.2132                  | 0.6129                    | 0.2591                        | nan                     | 0.0365             | 0.0                   | 0.0                  | 0.9054               | 0.0                    | 0.0                  | 0.0                        | 0.0                         | 0.0                      | 0.0                      | 0.0                         | 0.9224                         | 0.0                        | 0.0459                     | 0.0                                  | 0.0                          | nan                          | 0.0                          | 0.0                  | 0.0                         | 0.0                          | 0.9393                     | 0.8464                  | 0.9175       | 0.0                  | 0.0                   | 0.0002               | 0.0                   | nan           | 0.7154        | 0.8030            | 0.2132             | 0.5123               | 0.2207                   | nan                | 0.0364        | 0.0              | 0.0             | 0.7835          | 0.0               | 0.0             | 0.0                   | 0.0                    | 0.0                 | 0.0                 | 0.0                    | 0.6049                    | 0.0                   | 0.0459                | 0.0                             | 0.0                     | nan                     | 0.0                     | 0.0             | 0.0                    | 0.0                     | 0.7838                | 0.6536             | 0.8663  | 0.0             | 0.0              | 0.0002          | 0.0              |
| 2.0863        | 1.55  | 620  | 0.8111          | 0.1975   | 0.2385        | 0.8017           | nan                | 0.9070             | 0.9445                 | 0.2170                  | 0.6419                    | 0.2979                        | nan                     | 0.0290             | 0.0                   | 0.0                  | 0.8965               | 0.0                    | 0.0                  | 0.0                        | 0.0                         | 0.0                      | 0.0                      | 0.0                         | 0.9324                         | 0.0                        | 0.0476                     | 0.0                                  | 0.0                          | nan                          | 0.0                          | 0.0                  | 0.0                         | 0.0                          | 0.9269                     | 0.8618                  | 0.9290       | 0.0                  | 0.0                   | 0.0002               | 0.0                   | nan           | 0.7148        | 0.8169            | 0.2169             | 0.5451               | 0.2434                   | nan                | 0.0289        | 0.0              | 0.0             | 0.7905          | 0.0               | 0.0             | 0.0                   | 0.0                    | 0.0                 | 0.0                 | 0.0                    | 0.5985                    | 0.0                   | 0.0476                | 0.0                             | 0.0                     | nan                     | 0.0                     | 0.0             | 0.0                    | 0.0                     | 0.7916                | 0.6579             | 0.8680  | 0.0             | 0.0              | 0.0002          | 0.0              |
| 0.7588        | 1.6   | 640  | 0.8296          | 0.1957   | 0.2362        | 0.7990           | nan                | 0.8626             | 0.9585                 | 0.2290                  | 0.6241                    | 0.2442                        | nan                     | 0.0407             | 0.0                   | 0.0                  | 0.9154               | 0.0                    | 0.0                  | 0.0                        | 0.0                         | 0.0                      | 0.0                      | 0.0                         | 0.9145                         | 0.0                        | 0.0422                     | 0.0                                  | 0.0                          | nan                          | 0.0                          | 0.0                  | 0.0                         | 0.0                          | 0.9395                     | 0.8623                  | 0.9250       | 0.0                  | 0.0                   | 0.0000               | 0.0                   | nan           | 0.7204        | 0.8034            | 0.2288             | 0.5230               | 0.2075                   | nan                | 0.0406        | 0.0              | 0.0             | 0.7778          | 0.0               | 0.0             | 0.0                   | 0.0                    | 0.0                 | 0.0                 | 0.0                    | 0.6111                    | 0.0                   | 0.0422                | 0.0                             | 0.0                     | nan                     | 0.0                     | 0.0             | 0.0                    | 0.0                     | 0.7804                | 0.6591             | 0.8679  | 0.0             | 0.0              | 0.0000          | 0.0              |
| 0.7944        | 1.65  | 660  | 0.8116          | 0.1940   | 0.2339        | 0.8012           | nan                | 0.9103             | 0.9586                 | 0.1498                  | 0.5954                    | 0.2507                        | nan                     | 0.0125             | 0.0                   | 0.0                  | 0.9178               | 0.0                    | 0.0                  | 0.0                        | 0.0                         | 0.0                      | 0.0                      | 0.0                         | 0.9103                         | 0.0                        | 0.0682                     | 0.0                                  | 0.0                          | nan                          | 0.0                          | 0.0                  | 0.0                         | 0.0                          | 0.9307                     | 0.8486                  | 0.9309       | 0.0                  | 0.0                   | 0.0                  | 0.0                   | nan           | 0.7133        | 0.8061            | 0.1498             | 0.5379               | 0.2224                   | nan                | 0.0124        | 0.0              | 0.0             | 0.7591          | 0.0               | 0.0             | 0.0                   | 0.0                    | 0.0                 | 0.0                 | 0.0                    | 0.6230                    | 0.0                   | 0.0680                | 0.0                             | 0.0                     | nan                     | 0.0                     | 0.0             | 0.0                    | 0.0                     | 0.7894                | 0.6574             | 0.8689  | 0.0             | 0.0              | 0.0             | 0.0              |
| 1.8619        | 1.7   | 680  | 0.8039          | 0.1971   | 0.2373        | 0.8025           | nan                | 0.8975             | 0.9554                 | 0.2199                  | 0.6051                    | 0.2695                        | nan                     | 0.0293             | 0.0                   | 0.0                  | 0.9198               | 0.0                    | 0.0                  | 0.0                        | 0.0                         | 0.0                      | 0.0                      | 0.0                         | 0.9172                         | 0.0                        | 0.0560                     | 0.0                                  | 0.0                          | nan                          | 0.0                          | 0.0                  | 0.0                         | 0.0                          | 0.9373                     | 0.8605                  | 0.9261       | 0.0                  | 0.0                   | 0.0001               | 0.0                   | nan           | 0.7182        | 0.8107            | 0.2199             | 0.5415               | 0.2326                   | nan                | 0.0292        | 0.0              | 0.0             | 0.7668          | 0.0               | 0.0             | 0.0                   | 0.0                    | 0.0                 | 0.0                 | 0.0                    | 0.6161                    | 0.0                   | 0.0558                | 0.0                             | 0.0                     | nan                     | 0.0                     | 0.0             | 0.0                    | 0.0                     | 0.7847                | 0.6620             | 0.8691  | 0.0             | 0.0              | 0.0001          | 0.0              |
| 0.8539        | 1.75  | 700  | 0.8175          | 0.1966   | 0.2368        | 0.8003           | nan                | 0.8667             | 0.9584                 | 0.2116                  | 0.6096                    | 0.2763                        | nan                     | 0.0486             | 0.0                   | 0.0                  | 0.9172               | 0.0                    | 0.0                  | 0.0                        | 0.0                         | 0.0                      | 0.0                      | 0.0                         | 0.9217                         | 0.0                        | 0.0456                     | 0.0                                  | 0.0                          | nan                          | 0.0                          | 0.0                  | 0.0                         | 0.0                          | 0.9392                     | 0.8528                  | 0.9288       | 0.0                  | 0.0                   | 0.0002               | 0.0                   | nan           | 0.7175        | 0.8058            | 0.2115             | 0.5323               | 0.2330                   | nan                | 0.0484        | 0.0              | 0.0             | 0.7753          | 0.0               | 0.0             | 0.0                   | 0.0                    | 0.0                 | 0.0                 | 0.0                    | 0.6080                    | 0.0                   | 0.0455                | 0.0                             | 0.0                     | nan                     | 0.0                     | 0.0             | 0.0                    | 0.0                     | 0.7844                | 0.6611             | 0.8694  | 0.0             | 0.0              | 0.0002          | 0.0              |
| 0.7426        | 1.8   | 720  | 0.8064          | 0.1938   | 0.2344        | 0.8010           | nan                | 0.8945             | 0.9508                 | 0.0902                  | 0.6194                    | 0.2880                        | nan                     | 0.0378             | 0.0                   | 0.0                  | 0.9096               | 0.0                    | 0.0                  | 0.0                        | 0.0                         | 0.0                      | 0.0                      | 0.0                         | 0.9219                         | 0.0                        | 0.0522                     | 0.0                                  | 0.0                          | nan                          | 0.0                          | 0.0                  | 0.0                         | 0.0                          | 0.9407                     | 0.8678                  | 0.9269       | 0.0                  | 0.0                   | 0.0002               | 0.0                   | nan           | 0.7005        | 0.8164            | 0.0902             | 0.5469               | 0.2466                   | nan                | 0.0376        | 0.0              | 0.0             | 0.7779          | 0.0               | 0.0             | 0.0                   | 0.0                    | 0.0                 | 0.0                 | 0.0                    | 0.6096                    | 0.0                   | 0.0520                | 0.0                             | 0.0                     | nan                     | 0.0                     | 0.0             | 0.0                    | 0.0                     | 0.7832                | 0.6712             | 0.8693  | 0.0             | 0.0              | 0.0002          | 0.0              |
| 1.0662        | 1.85  | 740  | 0.8011          | 0.1961   | 0.2363        | 0.8021           | nan                | 0.8727             | 0.9602                 | 0.1683                  | 0.6350                    | 0.2551                        | nan                     | 0.0520             | 0.0                   | 0.0                  | 0.9103               | 0.0                    | 0.0                  | 0.0                        | 0.0                         | 0.0                      | 0.0                      | 0.0                         | 0.9225                         | 0.0                        | 0.0461                     | 0.0                                  | 0.0                          | nan                          | 0.0                          | 0.0                  | 0.0                         | 0.0                          | 0.9380                     | 0.8760                  | 0.9266       | 0.0                  | 0.0                   | 0.0000               | 0.0                   | nan           | 0.7122        | 0.8122            | 0.1683             | 0.5470               | 0.2262                   | nan                | 0.0518        | 0.0              | 0.0             | 0.7820          | 0.0               | 0.0             | 0.0                   | 0.0                    | 0.0                 | 0.0                 | 0.0                    | 0.6108                    | 0.0                   | 0.0460                | 0.0                             | 0.0                     | nan                     | 0.0                     | 0.0             | 0.0                    | 0.0                     | 0.7836                | 0.6664             | 0.8688  | 0.0             | 0.0              | 0.0000          | 0.0              |
| 0.6911        | 1.9   | 760  | 0.8008          | 0.1970   | 0.2373        | 0.8022           | nan                | 0.8719             | 0.9617                 | 0.1760                  | 0.6339                    | 0.2651                        | nan                     | 0.0487             | 0.0                   | 0.0                  | 0.9136               | 0.0                    | 0.0                  | 0.0                        | 0.0                         | 0.0                      | 0.0                      | 0.0                         | 0.9253                         | 0.0                        | 0.0656                     | 0.0                                  | 0.0                          | nan                          | 0.0                          | 0.0                  | 0.0                         | 0.0                          | 0.9275                     | 0.8688                  | 0.9371       | 0.0                  | 0.0                   | 0.0002               | 0.0                   | nan           | 0.7080        | 0.8110            | 0.1760             | 0.5442               | 0.2302                   | nan                | 0.0485        | 0.0              | 0.0             | 0.7801          | 0.0               | 0.0             | 0.0                   | 0.0                    | 0.0                 | 0.0                 | 0.0                    | 0.6118                    | 0.0                   | 0.0653                | 0.0                             | 0.0                     | nan                     | 0.0                     | 0.0             | 0.0                    | 0.0                     | 0.7916                | 0.6685             | 0.8696  | 0.0             | 0.0              | 0.0002          | 0.0              |
| 0.6667        | 1.95  | 780  | 0.7993          | 0.1984   | 0.2393        | 0.8023           | nan                | 0.8612             | 0.9593                 | 0.2034                  | 0.6467                    | 0.2867                        | nan                     | 0.0726             | 0.0                   | 0.0                  | 0.9167               | 0.0                    | 0.0                  | 0.0                        | 0.0                         | 0.0                      | 0.0                      | 0.0                         | 0.9315                         | 0.0                        | 0.0501                     | 0.0                                  | 0.0                          | nan                          | 0.0                          | 0.0                  | 0.0                         | 0.0                          | 0.9256                     | 0.8703                  | 0.9331       | 0.0                  | 0.0                   | 0.0003               | 0.0                   | nan           | 0.7144        | 0.8127            | 0.2034             | 0.5399               | 0.2391                   | nan                | 0.0723        | 0.0              | 0.0             | 0.7800          | 0.0               | 0.0             | 0.0                   | 0.0                    | 0.0                 | 0.0                 | 0.0                    | 0.6042                    | 0.0                   | 0.0500                | 0.0                             | 0.0                     | nan                     | 0.0                     | 0.0             | 0.0                    | 0.0                     | 0.7931                | 0.6698             | 0.8697  | 0.0             | 0.0              | 0.0003          | 0.0              |
| 0.8987        | 2.0   | 800  | 0.7904          | 0.1971   | 0.2386        | 0.8024           | nan                | 0.8832             | 0.9527                 | 0.1578                  | 0.6444                    | 0.2996                        | nan                     | 0.0548             | 0.0                   | 0.0                  | 0.9162               | 0.0                    | 0.0                  | 0.0                        | 0.0                         | 0.0                      | 0.0                      | 0.0                         | 0.9320                         | 0.0                        | 0.0617                     | 0.0                                  | 0.0                          | nan                          | 0.0                          | 0.0                  | 0.0                         | 0.0                          | 0.9229                     | 0.8768                  | 0.9321       | 0.0                  | 0.0                   | 0.0001               | 0.0                   | nan           | 0.7059        | 0.8170            | 0.1578             | 0.5477               | 0.2484                   | nan                | 0.0545        | 0.0              | 0.0             | 0.7758          | 0.0               | 0.0             | 0.0                   | 0.0                    | 0.0                 | 0.0                 | 0.0                    | 0.6064                    | 0.0                   | 0.0615                | 0.0                             | 0.0                     | nan                     | 0.0                     | 0.0             | 0.0                    | 0.0                     | 0.7947                | 0.6688             | 0.8695  | 0.0             | 0.0              | 0.0001          | 0.0              |


### Framework versions

- Transformers 4.48.0
- Pytorch 2.1.1+cu118
- Datasets 3.2.0
- Tokenizers 0.21.0