gremlin97 commited on
Commit
17c97ff
·
1 Parent(s): f93f680

Update leaderboard metadata and dataset naming

Browse files

- Changed organization to "Kerner Lab - ASU" for all entries
- Updated author attribution to "Purohit et al."
- Added "mb-" prefix to all dataset names for consistency

data/classification.csv CHANGED
@@ -1,46 +1,46 @@
1
  Model,Organization,Dataset,Accuracy,F1-Score,Author,Author Link
2
- InceptionV3,Mars-Bench,atmospheric_dust_cls_edr,0.9435,0.9435,Mars-Bench Team,
3
- InceptionV3,Mars-Bench,atmospheric_dust_cls_rdr,0.9394,0.9394,Mars-Bench Team,
4
- InceptionV3,Mars-Bench,change_cls_ctx,0.8,0.7111,Mars-Bench Team,
5
- InceptionV3,Mars-Bench,change_cls_hirise,0.9733,0.9719,Mars-Bench Team,
6
- InceptionV3,Mars-Bench,domars16k,0.7905,0.7897,Mars-Bench Team,
7
- InceptionV3,Mars-Bench,frost_cls,0.9258,0.9249,Mars-Bench Team,
8
- InceptionV3,Mars-Bench,landmark_cls,0.888,0.8669,Mars-Bench Team,
9
- InceptionV3,Mars-Bench,surface_multi_label_cls,0.8707,0.7673,Mars-Bench Team,
10
- InceptionV3,Mars-Bench,surface_cls,0.862,0.841,Mars-Bench Team,
11
- ResNet101,Mars-Bench,atmospheric_dust_cls_edr,0.9418,0.9417,Mars-Bench Team,
12
- ResNet101,Mars-Bench,atmospheric_dust_cls_rdr,0.9465,0.9465,Mars-Bench Team,
13
- ResNet101,Mars-Bench,change_cls_ctx,0.8,0.7111,Mars-Bench Team,
14
- ResNet101,Mars-Bench,change_cls_hirise,0.9841,0.9837,Mars-Bench Team,
15
- ResNet101,Mars-Bench,domars16k,0.8215,0.82,Mars-Bench Team,
16
- ResNet101,Mars-Bench,frost_cls,0.9293,0.9282,Mars-Bench Team,
17
- ResNet101,Mars-Bench,landmark_cls,0.9002,0.8805,Mars-Bench Team,
18
- ResNet101,Mars-Bench,surface_multi_label_cls,0.8785,0.7904,Mars-Bench Team,
19
- ResNet101,Mars-Bench,surface_cls,0.8696,0.8521,Mars-Bench Team,
20
- SqueezeNet1.1,Mars-Bench,atmospheric_dust_cls_edr,0.948,0.948,Mars-Bench Team,
21
- SqueezeNet1.1,Mars-Bench,atmospheric_dust_cls_rdr,0.9412,0.9412,Mars-Bench Team,
22
- SqueezeNet1.1,Mars-Bench,change_cls_ctx,0.8,0.7111,Mars-Bench Team,
23
- SqueezeNet1.1,Mars-Bench,change_cls_hirise,0.9575,0.9534,Mars-Bench Team,
24
- SqueezeNet1.1,Mars-Bench,domars16k,0.8242,0.8243,Mars-Bench Team,
25
- SqueezeNet1.1,Mars-Bench,frost_cls,0.8973,0.8963,Mars-Bench Team,
26
- SqueezeNet1.1,Mars-Bench,landmark_cls,0.9094,0.8941,Mars-Bench Team,
27
- SqueezeNet1.1,Mars-Bench,surface_multi_label_cls,0.7882,0.6623,Mars-Bench Team,
28
- SqueezeNet1.1,Mars-Bench,surface_cls,0.8626,0.8494,Mars-Bench Team,
29
- SwinV2-B,Mars-Bench,atmospheric_dust_cls_edr,0.9487,0.9487,Mars-Bench Team,
30
- SwinV2-B,Mars-Bench,atmospheric_dust_cls_rdr,0.9607,0.9607,Mars-Bench Team,
31
- SwinV2-B,Mars-Bench,change_cls_ctx,0.8,0.7111,Mars-Bench Team,
32
- SwinV2-B,Mars-Bench,change_cls_hirise,0.9898,0.9898,Mars-Bench Team,
33
- SwinV2-B,Mars-Bench,domars16k,0.8675,0.866,Mars-Bench Team,
34
- SwinV2-B,Mars-Bench,frost_cls,0.9454,0.9449,Mars-Bench Team,
35
- SwinV2-B,Mars-Bench,landmark_cls,0.9191,0.9052,Mars-Bench Team,
36
- SwinV2-B,Mars-Bench,surface_multi_label_cls,0.8961,0.8284,Mars-Bench Team,
37
- SwinV2-B,Mars-Bench,surface_cls,0.8763,0.8699,Mars-Bench Team,
38
- ViT-L/16,Mars-Bench,atmospheric_dust_cls_edr,0.9402,0.9402,Mars-Bench Team,
39
- ViT-L/16,Mars-Bench,atmospheric_dust_cls_rdr,0.9529,0.9529,Mars-Bench Team,
40
- ViT-L/16,Mars-Bench,change_cls_ctx,0.8,0.7111,Mars-Bench Team,
41
- ViT-L/16,Mars-Bench,change_cls_hirise,0.9885,0.9884,Mars-Bench Team,
42
- ViT-L/16,Mars-Bench,domars16k,0.8817,0.8809,Mars-Bench Team,
43
- ViT-L/16,Mars-Bench,frost_cls,0.9311,0.9302,Mars-Bench Team,
44
- ViT-L/16,Mars-Bench,landmark_cls,0.9205,0.9101,Mars-Bench Team,
45
- ViT-L/16,Mars-Bench,surface_multi_label_cls,0.8964,0.8304,Mars-Bench Team,
46
- ViT-L/16,Mars-Bench,surface_cls,0.8798,0.8705,Mars-Bench Team,
 
1
  Model,Organization,Dataset,Accuracy,F1-Score,Author,Author Link
2
+ InceptionV3,Kerner Lab - ASU,mb-atmospheric_dust_cls_edr,0.9435,0.9435,Purohit et al.,
3
+ InceptionV3,Kerner Lab - ASU,mb-atmospheric_dust_cls_rdr,0.9394,0.9394,Purohit et al.,
4
+ InceptionV3,Kerner Lab - ASU,mb-change_cls_ctx,0.8,0.7111,Purohit et al.,
5
+ InceptionV3,Kerner Lab - ASU,mb-change_cls_hirise,0.9733,0.9719,Purohit et al.,
6
+ InceptionV3,Kerner Lab - ASU,mb-domars16k,0.7905,0.7897,Purohit et al.,
7
+ InceptionV3,Kerner Lab - ASU,mb-frost_cls,0.9258,0.9249,Purohit et al.,
8
+ InceptionV3,Kerner Lab - ASU,mb-landmark_cls,0.888,0.8669,Purohit et al.,
9
+ InceptionV3,Kerner Lab - ASU,mb-surface_multi_label_cls,0.8707,0.7673,Purohit et al.,
10
+ InceptionV3,Kerner Lab - ASU,mb-surface_cls,0.862,0.841,Purohit et al.,
11
+ ResNet101,Kerner Lab - ASU,mb-atmospheric_dust_cls_edr,0.9418,0.9417,Purohit et al.,
12
+ ResNet101,Kerner Lab - ASU,mb-atmospheric_dust_cls_rdr,0.9465,0.9465,Purohit et al.,
13
+ ResNet101,Kerner Lab - ASU,mb-change_cls_ctx,0.8,0.7111,Purohit et al.,
14
+ ResNet101,Kerner Lab - ASU,mb-change_cls_hirise,0.9841,0.9837,Purohit et al.,
15
+ ResNet101,Kerner Lab - ASU,mb-domars16k,0.8215,0.82,Purohit et al.,
16
+ ResNet101,Kerner Lab - ASU,mb-frost_cls,0.9293,0.9282,Purohit et al.,
17
+ ResNet101,Kerner Lab - ASU,mb-landmark_cls,0.9002,0.8805,Purohit et al.,
18
+ ResNet101,Kerner Lab - ASU,mb-surface_multi_label_cls,0.8785,0.7904,Purohit et al.,
19
+ ResNet101,Kerner Lab - ASU,mb-surface_cls,0.8696,0.8521,Purohit et al.,
20
+ SqueezeNet1.1,Kerner Lab - ASU,mb-atmospheric_dust_cls_edr,0.948,0.948,Purohit et al.,
21
+ SqueezeNet1.1,Kerner Lab - ASU,mb-atmospheric_dust_cls_rdr,0.9412,0.9412,Purohit et al.,
22
+ SqueezeNet1.1,Kerner Lab - ASU,mb-change_cls_ctx,0.8,0.7111,Purohit et al.,
23
+ SqueezeNet1.1,Kerner Lab - ASU,mb-change_cls_hirise,0.9575,0.9534,Purohit et al.,
24
+ SqueezeNet1.1,Kerner Lab - ASU,mb-domars16k,0.8242,0.8243,Purohit et al.,
25
+ SqueezeNet1.1,Kerner Lab - ASU,mb-frost_cls,0.8973,0.8963,Purohit et al.,
26
+ SqueezeNet1.1,Kerner Lab - ASU,mb-landmark_cls,0.9094,0.8941,Purohit et al.,
27
+ SqueezeNet1.1,Kerner Lab - ASU,mb-surface_multi_label_cls,0.7882,0.6623,Purohit et al.,
28
+ SqueezeNet1.1,Kerner Lab - ASU,mb-surface_cls,0.8626,0.8494,Purohit et al.,
29
+ SwinV2-B,Kerner Lab - ASU,mb-atmospheric_dust_cls_edr,0.9487,0.9487,Purohit et al.,
30
+ SwinV2-B,Kerner Lab - ASU,mb-atmospheric_dust_cls_rdr,0.9607,0.9607,Purohit et al.,
31
+ SwinV2-B,Kerner Lab - ASU,mb-change_cls_ctx,0.8,0.7111,Purohit et al.,
32
+ SwinV2-B,Kerner Lab - ASU,mb-change_cls_hirise,0.9898,0.9898,Purohit et al.,
33
+ SwinV2-B,Kerner Lab - ASU,mb-domars16k,0.8675,0.866,Purohit et al.,
34
+ SwinV2-B,Kerner Lab - ASU,mb-frost_cls,0.9454,0.9449,Purohit et al.,
35
+ SwinV2-B,Kerner Lab - ASU,mb-landmark_cls,0.9191,0.9052,Purohit et al.,
36
+ SwinV2-B,Kerner Lab - ASU,mb-surface_multi_label_cls,0.8961,0.8284,Purohit et al.,
37
+ SwinV2-B,Kerner Lab - ASU,mb-surface_cls,0.8763,0.8699,Purohit et al.,
38
+ ViT-L/16,Kerner Lab - ASU,mb-atmospheric_dust_cls_edr,0.9402,0.9402,Purohit et al.,
39
+ ViT-L/16,Kerner Lab - ASU,mb-atmospheric_dust_cls_rdr,0.9529,0.9529,Purohit et al.,
40
+ ViT-L/16,Kerner Lab - ASU,mb-change_cls_ctx,0.8,0.7111,Purohit et al.,
41
+ ViT-L/16,Kerner Lab - ASU,mb-change_cls_hirise,0.9885,0.9884,Purohit et al.,
42
+ ViT-L/16,Kerner Lab - ASU,mb-domars16k,0.8817,0.8809,Purohit et al.,
43
+ ViT-L/16,Kerner Lab - ASU,mb-frost_cls,0.9311,0.9302,Purohit et al.,
44
+ ViT-L/16,Kerner Lab - ASU,mb-landmark_cls,0.9205,0.9101,Purohit et al.,
45
+ ViT-L/16,Kerner Lab - ASU,mb-surface_multi_label_cls,0.8964,0.8304,Purohit et al.,
46
+ ViT-L/16,Kerner Lab - ASU,mb-surface_cls,0.8798,0.8705,Purohit et al.,
data/detection.csv CHANGED
@@ -1,10 +1,10 @@
1
  Model,Organization,Dataset,mAP,Author,Author Link
2
- Faster R-CNN,Mars-Bench,boulder_det,0.0181,Mars-Bench Team,
3
- Faster R-CNN,Mars-Bench,conequest_det,0.1324,Mars-Bench Team,
4
- Faster R-CNN,Mars-Bench,dust_devil_det,0.3207,Mars-Bench Team,
5
- RetinaNet,Mars-Bench,boulder_det,0.0105,Mars-Bench Team,
6
- RetinaNet,Mars-Bench,conequest_det,0.1599,Mars-Bench Team,
7
- RetinaNet,Mars-Bench,dust_devil_det,0.3408,Mars-Bench Team,
8
- SSD,Mars-Bench,boulder_det,0.0,Mars-Bench Team,
9
- SSD,Mars-Bench,conequest_det,0.013,Mars-Bench Team,
10
- SSD,Mars-Bench,dust_devil_det,0.0064,Mars-Bench Team,
 
1
  Model,Organization,Dataset,mAP,Author,Author Link
2
+ Faster R-CNN,Kerner Lab - ASU,mb-boulder_det,0.0181,Purohit et al.,
3
+ Faster R-CNN,Kerner Lab - ASU,mb-conequest_det,0.1324,Purohit et al.,
4
+ Faster R-CNN,Kerner Lab - ASU,mb-dust_devil_det,0.3207,Purohit et al.,
5
+ RetinaNet,Kerner Lab - ASU,mb-boulder_det,0.0105,Purohit et al.,
6
+ RetinaNet,Kerner Lab - ASU,mb-conequest_det,0.1599,Purohit et al.,
7
+ RetinaNet,Kerner Lab - ASU,mb-dust_devil_det,0.3408,Purohit et al.,
8
+ SSD,Kerner Lab - ASU,mb-boulder_det,0.0,Purohit et al.,
9
+ SSD,Kerner Lab - ASU,mb-conequest_det,0.013,Purohit et al.,
10
+ SSD,Kerner Lab - ASU,mb-dust_devil_det,0.0064,Purohit et al.,
data/segmentation.csv CHANGED
@@ -1,33 +1,33 @@
1
  Model,Organization,Dataset,Dice Score,IoU,Author,Author Link
2
- DeepLabV3+,Mars-Bench,boulder_seg,0.5456,0.5144,Mars-Bench Team,
3
- DeepLabV3+,Mars-Bench,conequest_seg,0.5941,0.5729,Mars-Bench Team,
4
- DeepLabV3+,Mars-Bench,crater_binary_seg,0.7171,0.6607,Mars-Bench Team,
5
- DeepLabV3+,Mars-Bench,crater_multi_seg,0.3045,0.2755,Mars-Bench Team,
6
- DeepLabV3+,Mars-Bench,mars_seg_mer,0.257,0.2242,Mars-Bench Team,
7
- DeepLabV3+,Mars-Bench,mars_seg_msl,0.2801,0.2357,Mars-Bench Team,
8
- DeepLabV3+,Mars-Bench,mmls,0.6414,0.5249,Mars-Bench Team,
9
- DeepLabV3+,Mars-Bench,s5mars,0.1895,0.1674,Mars-Bench Team,
10
- DPT,Mars-Bench,boulder_seg,0.3136,0.2812,Mars-Bench Team,
11
- DPT,Mars-Bench,conequest_seg,0.6425,0.6281,Mars-Bench Team,
12
- DPT,Mars-Bench,crater_binary_seg,0.7487,0.6938,Mars-Bench Team,
13
- DPT,Mars-Bench,crater_multi_seg,0.3073,0.2819,Mars-Bench Team,
14
- DPT,Mars-Bench,mars_seg_mer,0.2733,0.2404,Mars-Bench Team,
15
- DPT,Mars-Bench,mars_seg_msl,0.3011,0.2555,Mars-Bench Team,
16
- DPT,Mars-Bench,mmls,0.3703,0.2889,Mars-Bench Team,
17
- DPT,Mars-Bench,s5mars,0.2035,0.1806,Mars-Bench Team,
18
- SegFormer,Mars-Bench,boulder_seg,0.5285,0.4693,Mars-Bench Team,
19
- SegFormer,Mars-Bench,conequest_seg,0.6101,0.5877,Mars-Bench Team,
20
- SegFormer,Mars-Bench,crater_binary_seg,0.7237,0.6672,Mars-Bench Team,
21
- SegFormer,Mars-Bench,crater_multi_seg,0.3125,0.2832,Mars-Bench Team,
22
- SegFormer,Mars-Bench,mars_seg_mer,0.2692,0.2317,Mars-Bench Team,
23
- SegFormer,Mars-Bench,mars_seg_msl,0.2939,0.2435,Mars-Bench Team,
24
- SegFormer,Mars-Bench,mmls,0.6392,0.5204,Mars-Bench Team,
25
- SegFormer,Mars-Bench,s5mars,0.184,0.1606,Mars-Bench Team,
26
- U-Net,Mars-Bench,boulder_seg,0.4489,0.3832,Mars-Bench Team,
27
- U-Net,Mars-Bench,conequest_seg,0.6145,0.5998,Mars-Bench Team,
28
- U-Net,Mars-Bench,crater_binary_seg,0.7865,0.7277,Mars-Bench Team,
29
- U-Net,Mars-Bench,crater_multi_seg,0.342,0.3102,Mars-Bench Team,
30
- U-Net,Mars-Bench,mars_seg_mer,0.2776,0.2395,Mars-Bench Team,
31
- U-Net,Mars-Bench,mars_seg_msl,0.3022,0.2525,Mars-Bench Team,
32
- U-Net,Mars-Bench,mmls,0.6364,0.5204,Mars-Bench Team,
33
- U-Net,Mars-Bench,s5mars,0.2012,0.1777,Mars-Bench Team,
 
1
  Model,Organization,Dataset,Dice Score,IoU,Author,Author Link
2
+ DeepLabV3+,Kerner Lab - ASU,mb-boulder_seg,0.5456,0.5144,Purohit et al.,
3
+ DeepLabV3+,Kerner Lab - ASU,mb-conequest_seg,0.5941,0.5729,Purohit et al.,
4
+ DeepLabV3+,Kerner Lab - ASU,mb-crater_binary_seg,0.7171,0.6607,Purohit et al.,
5
+ DeepLabV3+,Kerner Lab - ASU,mb-crater_multi_seg,0.3045,0.2755,Purohit et al.,
6
+ DeepLabV3+,Kerner Lab - ASU,mb-mars_seg_mer,0.257,0.2242,Purohit et al.,
7
+ DeepLabV3+,Kerner Lab - ASU,mb-mars_seg_msl,0.2801,0.2357,Purohit et al.,
8
+ DeepLabV3+,Kerner Lab - ASU,mb-mmls,0.6414,0.5249,Purohit et al.,
9
+ DeepLabV3+,Kerner Lab - ASU,mb-s5mars,0.1895,0.1674,Purohit et al.,
10
+ DPT,Kerner Lab - ASU,mb-boulder_seg,0.3136,0.2812,Purohit et al.,
11
+ DPT,Kerner Lab - ASU,mb-conequest_seg,0.6425,0.6281,Purohit et al.,
12
+ DPT,Kerner Lab - ASU,mb-crater_binary_seg,0.7487,0.6938,Purohit et al.,
13
+ DPT,Kerner Lab - ASU,mb-crater_multi_seg,0.3073,0.2819,Purohit et al.,
14
+ DPT,Kerner Lab - ASU,mb-mars_seg_mer,0.2733,0.2404,Purohit et al.,
15
+ DPT,Kerner Lab - ASU,mb-mars_seg_msl,0.3011,0.2555,Purohit et al.,
16
+ DPT,Kerner Lab - ASU,mb-mmls,0.3703,0.2889,Purohit et al.,
17
+ DPT,Kerner Lab - ASU,mb-s5mars,0.2035,0.1806,Purohit et al.,
18
+ SegFormer,Kerner Lab - ASU,mb-boulder_seg,0.5285,0.4693,Purohit et al.,
19
+ SegFormer,Kerner Lab - ASU,mb-conequest_seg,0.6101,0.5877,Purohit et al.,
20
+ SegFormer,Kerner Lab - ASU,mb-crater_binary_seg,0.7237,0.6672,Purohit et al.,
21
+ SegFormer,Kerner Lab - ASU,mb-crater_multi_seg,0.3125,0.2832,Purohit et al.,
22
+ SegFormer,Kerner Lab - ASU,mb-mars_seg_mer,0.2692,0.2317,Purohit et al.,
23
+ SegFormer,Kerner Lab - ASU,mb-mars_seg_msl,0.2939,0.2435,Purohit et al.,
24
+ SegFormer,Kerner Lab - ASU,mb-mmls,0.6392,0.5204,Purohit et al.,
25
+ SegFormer,Kerner Lab - ASU,mb-s5mars,0.184,0.1606,Purohit et al.,
26
+ U-Net,Kerner Lab - ASU,mb-boulder_seg,0.4489,0.3832,Purohit et al.,
27
+ U-Net,Kerner Lab - ASU,mb-conequest_seg,0.6145,0.5998,Purohit et al.,
28
+ U-Net,Kerner Lab - ASU,mb-crater_binary_seg,0.7865,0.7277,Purohit et al.,
29
+ U-Net,Kerner Lab - ASU,mb-crater_multi_seg,0.342,0.3102,Purohit et al.,
30
+ U-Net,Kerner Lab - ASU,mb-mars_seg_mer,0.2776,0.2395,Purohit et al.,
31
+ U-Net,Kerner Lab - ASU,mb-mars_seg_msl,0.3022,0.2525,Purohit et al.,
32
+ U-Net,Kerner Lab - ASU,mb-mmls,0.6364,0.5204,Purohit et al.,
33
+ U-Net,Kerner Lab - ASU,mb-s5mars,0.2012,0.1777,Purohit et al.,