ertghiu256
/

qwen3-4b-instruct-human-like-dpo

Text Generation

text-generation-inference

Model card Files Files and versions

Uploaded finetuned model

Developed by: ertghiu256
License: apache-2.0
Finetuned from model : unsloth/qwen3-4b-instruct-2507-unsloth-bnb-4bit

This qwen3 model was trained 2x faster with Unsloth and Huggingface's TRL library.

Downloads last month: 18

Safetensors

Model size

4B params

Tensor type

BF16

·

Model tree for ertghiu256/qwen3-4b-instruct-human-like-dpo

Base model

Qwen/Qwen3-4B-Instruct-2507

Finetuned

(219)

this model

Dataset used to train ertghiu256/qwen3-4b-instruct-human-like-dpo