Update README.md
Browse files
README.md
CHANGED
@@ -1,3 +1,44 @@
|
|
1 |
-
---
|
2 |
-
license: apache-2.0
|
3 |
-
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
---
|
2 |
+
license: apache-2.0
|
3 |
+
---
|
4 |
+
[](https://paperswithcode.com/sota/referring-expression-segmentation-on-refcocog?p=multi-label-cluster-discrimination-for-visual)
|
5 |
+
[](https://paperswithcode.com/sota/referring-expression-segmentation-on-refcoco-5?p=multi-label-cluster-discrimination-for-visual)
|
6 |
+
[](https://paperswithcode.com/sota/referring-expression-segmentation-on-refcoco-3?p=multi-label-cluster-discrimination-for-visual)
|
7 |
+
[](https://paperswithcode.com/sota/referring-expression-segmentation-on-refcocog-1?p=multi-label-cluster-discrimination-for-visual)
|
8 |
+
[](https://paperswithcode.com/sota/referring-expression-segmentation-on-refcoco-8?p=multi-label-cluster-discrimination-for-visual)
|
9 |
+
[](https://paperswithcode.com/sota/referring-expression-segmentation-on-refcoco-4?p=multi-label-cluster-discrimination-for-visual)
|
10 |
+
[](https://paperswithcode.com/sota/referring-expression-segmentation-on-refcoco-9?p=multi-label-cluster-discrimination-for-visual)
|
11 |
+
[](https://paperswithcode.com/sota/referring-expression-segmentation-on-refcoco?p=multi-label-cluster-discrimination-for-visual)
|
12 |
+
[](https://paperswithcode.com/sota/referring-expression-segmentation-on-refcoco?p=multi-label-cluster-discrimination-for-visual)
|
13 |
+
|
14 |
+
|
15 |
+
## RefCOCO Segmentation Evaluation:
|
16 |
+
|
17 |
+
| Dataset | Split | MLCD-seg-7B | EVF-SAM | GLaMM | VisionLLM v2| LISA |
|
18 |
+
| :-- | :-: | :-: | :-: | :-: | :-: | :-: |
|
19 |
+
| RefCOCO | val | **83.6** | 82.4 | 79.5 | 79.2 | 74.9 |
|
20 |
+
| RefCOCO | testA | **85.3** | 84.2 | 83.2 | 82.3 | 79.1 |
|
21 |
+
| RefCOCO | testB | **81.5** | 80.2 | 76.9 | 77.0 | 72.3 |
|
22 |
+
| RefCOCO+ | val | **79.4** | 76.5 | 72.6 | 68.9 | 65.1 |
|
23 |
+
| RefCOCO+ | testA | **82.9** | 80.0 | 78.7 | 75.8 | 70.8 |
|
24 |
+
| RefCOCO+ | testB | **75.6** | 71.9 | 64.6 | 61.8 | 58.1 |
|
25 |
+
| RefCOCOg | val | **79.7** | 78.2 | 74.2 | 73.3 | 67.9 |
|
26 |
+
| RefCOCOg | test | **80.5** | 78.3 | 74.9 | 74.8 | 70.6 |
|
27 |
+
|
28 |
+
---
|
29 |
+
## Evaluation
|
30 |
+
Install the evaluation tool and execute the evaluation script:
|
31 |
+
```bash
|
32 |
+
bash ./eval/scripts/eval_refcoco.sh
|
33 |
+
```
|
34 |
+
---
|
35 |
+
|
36 |
+
## Citations
|
37 |
+
```
|
38 |
+
@misc{mlcdseg_wukun,
|
39 |
+
author = {Wu, Kun and Xie, Yin and Zhou, Xinyu and An, Xiang, and Deng, Jiankang},
|
40 |
+
title = {MLCD-seg-7B},
|
41 |
+
year = {2024},
|
42 |
+
url = {https://github.com/deepglint/unicom/tree/main/downstream},
|
43 |
+
}
|
44 |
+
```
|