Kyleyee
/

Qwen2.5-1.5B-cdpo-hh

Text Generation

Generated from Trainer

text-generation-inference

Model card Files Files and versions

Kyleyee commited on Jul 25

Commit

8bd69ab

·

verified ·

1 Parent(s): 2db4c8b

End of training

Files changed (1) hide show

README.md +2 -1

README.md CHANGED Viewed

@@ -1,5 +1,6 @@
 ---
 base_model: Kyleyee/Qwen2.5-1.5B-sft-hh-3e
 library_name: transformers
 model_name: Qwen2.5-1.5B-cdpo-hh
 tags:
@@ -11,7 +12,7 @@ licence: license
 # Model Card for Qwen2.5-1.5B-cdpo-hh
-This model is a fine-tuned version of [Kyleyee/Qwen2.5-1.5B-sft-hh-3e](https://huggingface.co/Kyleyee/Qwen2.5-1.5B-sft-hh-3e).
 It has been trained using [TRL](https://github.com/huggingface/trl).
 ## Quick start

 ---
 base_model: Kyleyee/Qwen2.5-1.5B-sft-hh-3e
+datasets: Kyleyee/train_data_Helpful_drdpo_preference
 library_name: transformers
 model_name: Qwen2.5-1.5B-cdpo-hh
 tags:
 # Model Card for Qwen2.5-1.5B-cdpo-hh
+This model is a fine-tuned version of [Kyleyee/Qwen2.5-1.5B-sft-hh-3e](https://huggingface.co/Kyleyee/Qwen2.5-1.5B-sft-hh-3e) on the [Kyleyee/train_data_Helpful_drdpo_preference](https://huggingface.co/datasets/Kyleyee/train_data_Helpful_drdpo_preference) dataset.
 It has been trained using [TRL](https://github.com/huggingface/trl).
 ## Quick start