|
|
--- |
|
|
license: apache-2.0 |
|
|
datasets: |
|
|
- lvwerra/stack-exchange-paired |
|
|
language: |
|
|
- en |
|
|
library_name: adapter-transformers |
|
|
pipeline_tag: text-generation |
|
|
tags: |
|
|
- reward_model |
|
|
--- |
|
|
## Reward Model GPT2 |
|
|
|
|
|
fine-tuned [GPT2](https://huggingface.co/gpt2) to a reward model. |
|
|
|
|
|
The model is designed to generate human-like responses to questions in [Stack Exchange](https://huggingface.co/datasets/lvwerra/stack-exchange-paired) domains of programming, mathematics, physics, and more. |
|
|
|
|
|
For training code check the github [example](https://github.com/huggingface/trl/blob/main/examples/research_projects/stack_llama/scripts/reward_modeling.py). |
|
|
|
|
|
info: |
|
|
* epoch: 1.0 |
|
|
* train_loss: 0.641692199903866 |
|
|
* eval_loss: 0.6299035549163818 |
|
|
* eval_accuracy: 0.729 |
|
|
|
|
|
|
