---
library_name: transformers
tags:
- generated_from_trainer
datasets:
- When-Does-Reasoning-Matter/general-reasoning-ift-pairs
- When-Does-Reasoning-Matter/math-reasoning-ift-pairs
language:
- en
pipeline_tag: text-generation
---

# When Does Reasoning Matter?

<p align="left">
  <img src="https://cdn-avatars.huggingface.co/v1/production/uploads/62be186a5f59ff2320e6e32b/GjJ15tY7-F4bqR96FN4pd.png" alt="Dataset Icon" width="180"/>
</p>

<p align="left">
<a href="https://arxiv.org/pdf/2509.22193" target="_blank" rel="noopener noreferrer">
  <img src="https://img.shields.io/badge/arXiv-2509.22193-b31b1b.svg?style=for-the-badge" alt="arXiv:2509.22193" />
  </a>
</p>


This model was trained as part of the paper [When Does Reasoning Matter?](https://arxiv.org/pdf/2509.22193)
It belongs to a collection of **General and Math-specific student models** distilled from Instruction-Fine-Tuned (IFT) or Reasoning answers generated by [Qwen/Qwen3-235B-A22B](https://huggingface.co/Qwen/Qwen3-235B-A22B).

<img src="https://huggingface.co/api/resolve-cache/models/When-Does-Reasoning-Matter/Qwen2.5-0.5B-ift/733797fee2fdd300e1a0453d368250327fe4cc44/results.png?%2FWhen-Does-Reasoning-Matter%2FQwen2.5-0.5B-ift%2Fresolve%2Fmain%2Fresults.png=&etag=%22d36dedfbca764a8ac9a7a5ebc043ca53f5ee4966%22" alt="results" width="600"/>

---

## Datasets

These models were trained on the **largest set of IFT and Reasoning answer pairs**:
- **General dataset**: [general-reasoning-ift-pairs](https://huggingface.co/datasets/When-Does-Reasoning-Matter/general-reasoning-ift-pairs)  
- **Math dataset**: [math-reasoning-ift-pairs](https://huggingface.co/datasets/When-Does-Reasoning-Matter/math-reasoning-ift-pairs)  

---

## Available Models

<table>
  <thead>
    <tr>
      <th colspan="2">General</th>
      <th colspan="2">Math</th>
    </tr>
    <tr>
      <th>IFT Models</th>
      <th>Reasoning Models</th>
      <th>IFT Models</th>
      <th>Reasoning Models</th>
    </tr>
  </thead>
  <tbody>
    <tr>
      <td><a href="https://huggingface.co/When-Does-Reasoning-Matter/Qwen2.5-0.5B-ift">Qwen2.5-0.5B-ift</a></td>
      <td><a href="https://huggingface.co/When-Does-Reasoning-Matter/Qwen2.5-0.5B-reasoning">Qwen2.5-0.5B-reasoning</a></td>
      <td><a href="https://huggingface.co/When-Does-Reasoning-Matter/Qwen2.5-0.5B-math-ift">Qwen2.5-0.5B-math-ift</a></td>
      <td><a href="https://huggingface.co/When-Does-Reasoning-Matter/Qwen2.5-0.5B-math-reasoning">Qwen2.5-0.5B-math-reasoning</a></td>
    </tr>
    <tr>
      <td><a href="https://huggingface.co/When-Does-Reasoning-Matter/Qwen2.5-1.5B-ift">Qwen2.5-1.5B-ift</a></td>
      <td><a href="https://huggingface.co/When-Does-Reasoning-Matter/Qwen2.5-1.5B-reasoning">Qwen2.5-1.5B-reasoning</a></td>
      <td><a href="https://huggingface.co/When-Does-Reasoning-Matter/Qwen2.5-1.5B-math-ift">Qwen2.5-1.5B-math-ift</a></td>
      <td><a href="https://huggingface.co/When-Does-Reasoning-Matter/Qwen2.5-1.5B-math-reasoning">Qwen2.5-1.5B-math-reasoning</a></td>
    </tr>
    <tr>
      <td><a href="https://huggingface.co/When-Does-Reasoning-Matter/Qwen2.5-3B-ift">Qwen2.5-3B-ift</a></td>
      <td><a href="https://huggingface.co/When-Does-Reasoning-Matter/Qwen2.5-3B-reasoning">Qwen2.5-3B-reasoning</a></td>
      <td><a href="https://huggingface.co/When-Does-Reasoning-Matter/Qwen2.5-3B-math-ift">Qwen2.5-3B-math-ift</a></td>
      <td><a href="https://huggingface.co/When-Does-Reasoning-Matter/Qwen2.5-3B-math-reasoning">Qwen2.5-3B-math-reasoning</a></td>
    </tr>
    <tr>
      <td><a href="https://huggingface.co/When-Does-Reasoning-Matter/Qwen2.5-7B-ift">Qwen2.5-7B-ift</a></td>
      <td><a href="https://huggingface.co/When-Does-Reasoning-Matter/Qwen2.5-7B-reasoning">Qwen2.5-7B-reasoning</a></td>
      <td><a href="https://huggingface.co/When-Does-Reasoning-Matter/Qwen2.5-7B-math-ift">Qwen2.5-7B-math-ift</a></td>
      <td><a href="https://huggingface.co/When-Does-Reasoning-Matter/Qwen2.5-7B-math-reasoning">Qwen2.5-7B-math-reasoning</a></td>
    </tr>
    <tr>
      <td><a href="https://huggingface.co/When-Does-Reasoning-Matter/Qwen2.5-14B-ift">Qwen2.5-14B-ift</a></td>
      <td><a href="https://huggingface.co/When-Does-Reasoning-Matter/Qwen2.5-14B-reasoning">Qwen2.5-14B-reasoning</a></td>
      <td><a href="https://huggingface.co/When-Does-Reasoning-Matter/Qwen2.5-14B-math-ift">Qwen2.5-14B-math-ift</a></td>
      <td><a href="https://huggingface.co/When-Does-Reasoning-Matter/Qwen2.5-14B-math-reasoning">Qwen2.5-14B-math-reasoning</a></td>
    </tr>
  </tbody>
</table>

---

If you use this dataset in your work, please cite: **[When Does Reasoning Matter?](https://arxiv.org/pdf/2509.22193)**

```bibtex
@misc{boizard2025doesreasoningmattercontrolled,
      title={When Does Reasoning Matter? A Controlled Study of Reasoning's Contribution to Model Performance}, 
      author={Nicolas Boizard and Hippolyte Gisserot-Boukhlef and Kevin El-Haddad and Céline Hudelot and Pierre Colombo},
      year={2025},
      eprint={2509.22193},
      archivePrefix={arXiv},
      primaryClass={cs.CL},
      url={https://arxiv.org/abs/2509.22193}, 
}
```