File size: 2,347 Bytes
6a700f8 8ea5cad 6a700f8 0cec5b4 4f6f59a 5b234fa 4f6f59a 1b06129 4f6f59a 5c0aae3 4f6f59a 6a700f8 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 |
---
license: apache-2.0
datasets:
- Code2Logic/GameQA-140K
- Code2Logic/GameQA-5K
base_model:
- Qwen/Qwen2.5-VL-7B-Instruct
---
***This model (GameQA-Qwen2.5-VL-7B) results from training Qwen2.5-VL-7B with GRPO solely on our [GameQA-5K](https://huggingface.co/datasets/Code2Logic/GameQA-5K) (sampled from the full [GameQA-140K](https://huggingface.co/datasets/Gabriel166/GameQA-140K) dataset).***
# Evaluation Results on General Vision BenchMarks
<div align=center><img src="https://raw.githubusercontent.com/tongjingqi/Code2Logic/refs/heads/main/assets/evaluation_results_on_general_vision_benchmarks.png"></div>
***(The inference and evaluation configurations were unified across both the original open-source models and our trained models.)***
It's also found that getting trained on 5k samples from our GameQA dataset can lead to better results than on [multimodal-open-r1-8k-verified](https://huggingface.co/datasets/lmms-lab/multimodal-open-r1-8k-verified).
<div align=center><img src="https://raw.githubusercontent.com/tongjingqi/Code2Logic/refs/heads/main/assets/GameQA_generalizes_better.png"></div>
# Code2Logic: Game-Code-Driven Data Synthesis for Enhancing VLMs General Reasoning
This is the first work, to the best of our knowledge, that leverages ***game code*** to synthesize multimodal reasoning data for ***training*** VLMs. Furthermore, when trained with a GRPO strategy solely on **GameQA** (synthesized via our proposed **Code2Logic** approach), multiple cutting-edge open-source models exhibit significantly enhanced out-of-domain generalization.
[[π Paper](https://arxiv.org/abs/2505.13886)] [[π€ GameQA-140K Dataset](https://huggingface.co/datasets/Gabriel166/GameQA-140K)] [[π€ GameQA-5K Dataset](https://huggingface.co/datasets/Code2Logic/GameQA-5K)] [[π€ GameQA-InternVL3-8B](https://huggingface.co/Code2Logic/GameQA-InternVL3-8B) ] [[π€ GameQA-Qwen2.5-VL-7B](https://huggingface.co/Code2Logic/GameQA-Qwen2.5-VL-7B)] [[π€ GameQA-LLaVA-OV-7B](https://huggingface.co/Code2Logic/GameQA-llava-onevision-qwen2-7b-ov-hf) ]
<div align=center><img src="https://raw.githubusercontent.com/tongjingqi/Code2Logic/refs/heads/main/assets/categorized_30_games_images.png"></div>
## News
* We've open-sourced the ***three*** models trained with GRPO on GameQA on [Huggingface](https://huggingface.co/Code2Logic). |