Models

ShenaoZ/0.0005_withdpo_4iters_bs256_dpolastdataup_5551lr_iter_4

Text Generation • 7B • Updated May 9, 2024 • 5

YYYYYYibo/nash_dpo_doff_real_no_golden_iter_3

Updated May 9, 2024 • 8

ShenaoZ/0.001_withdpo_4iters_bs256_555lr_iter_4

Text Generation • 7B • Updated May 9, 2024 • 5

ShenaoZ/0.00005_withdpo_4iters_bs256_dpolastdataup_5511lr_iter_4

Text Generation • 7B • Updated May 9, 2024 • 7

yyx123/Yi-6B-ruozhiba-1e-5-50

Updated May 18, 2024 • 7

DUAL-GPO/phi-2-gpo-renew2-b0.001-vllm-merge-20k-complete-v2-i1

Updated May 9, 2024 • 6

DUAL-GPO/zephyr-7b-gpo-v11-i1

Updated May 9, 2024 • 5

g8a9/tweety-mistral-7b-sft

Updated May 9, 2024 • 6

DUAL-GPO-2/zephyr-7b-gpo-v12-i1

Updated May 9, 2024 • 5

martimfasantos/tinyllama-1.1b-sum-dpo-qlora

Updated May 11, 2024 • 7

EllieS/TempReason-L1-llama3

Updated May 9, 2024 • 6

ShenaoZ/0.0005_withdpo_4iters_bs256_2epoch_5311lr_iter_1

Text Generation • 7B • Updated May 9, 2024 • 7

ShenaoZ/0.0001_withdpo_4iters_bs256_5551lr_iter_1

Text Generation • 7B • Updated May 9, 2024 • 7

ShenaoZ/0.001_withdpo_4iters_bs256_5551lr_iter_1

Text Generation • 7B • Updated May 9, 2024 • 7

ShenaoZ/0.0005_withdpo_4iters_bs256_2epoch_5551lr_iter_1

Text Generation • 7B • Updated May 9, 2024 • 7

ShenaoZ/0.0005_mistral_withdpo_4iters_bs256_5551lr_iter_1

Text Generation • 7B • Updated May 9, 2024 • 7

DUAL-GPO-2/phi-2-gpo-v1-i1

Updated May 10, 2024 • 5

ShenaoZ/0.0001_withdpo_4iters_bs256_5551lr_iter_2

Text Generation • 7B • Updated May 10, 2024 • 7

EllieS/llama3-L1-SFT-L2-KTO

Updated May 10, 2024 • 8

ShenaoZ/0.0005_betadpoinit_4iters_bs256_5551lr_iter_1

Text Generation • 7B • Updated May 10, 2024 • 7

ShenaoZ/0.0005_mistral_withdpo_4iters_bs256_5551lr_iter_2

Text Generation • 7B • Updated May 10, 2024 • 6

ShenaoZ/0.001_withdpo_4iters_bs256_5551lr_iter_2

Text Generation • 7B • Updated May 10, 2024 • 7

ShenaoZ/0.0005_withdpo_4iters_bs256_2epoch_5311lr_iter_2

Text Generation • 7B • Updated May 10, 2024 • 7

ShenaoZ/0.0005_withdpo_4iters_bs256_2epoch_5551lr_iter_2

Text Generation • 7B • Updated May 10, 2024 • 7

DUAL-GPO/phi-2-gpo-renew2-b0.001-vllm-merge-20k-complete-refSFT-i1

Updated May 10, 2024 • 5

Minbyul/biomistral-7b-wo-kqa_golden-iter-dpo-step3

Text Generation • 7B • Updated Jun 18, 2024 • 7

ShenaoZ/0.0001_withdpo_4iters_bs256_5551lr_iter_3

Text Generation • 7B • Updated May 10, 2024 • 7

ShenaoZ/0.0005_betadpoinit_4iters_bs256_5551lr_iter_2

Text Generation • 7B • Updated May 10, 2024 • 7

ShenaoZ/0.001_withdpo_4iters_bs256_5551lr_iter_3

Text Generation • 7B • Updated May 10, 2024 • 7

orpo-explorers/kaist-sft-mistral-OHP-15k-Stratified-1

Text Generation • 7B • Updated May 10, 2024 • 8