Models

ShenaoZ/0.0001_zephyrdpoinit_nodpo_3iters_bs256_555lr_iter_1

Text Generation • 7B • Updated May 6, 2024 • 7

ShenaoZ/0.00001_withdpo_4iters_bs256_555lr_iter_4

Text Generation • 7B • Updated May 6, 2024 • 7

ShenaoZ/0.0001_zephyrgemmasft_withdpo_3iters_bs256_555lr_iter_2

Text Generation • 7B • Updated May 6, 2024 • 5

ShenaoZ/0.0001_sft_nodpo_3iters_bs256_555lr_iter_2

Text Generation • 7B • Updated May 6, 2024 • 4

DUAL-GPO/phi-2-gpo-renew2-b0.001-0.5ultrafeedback-rank256-i1

Updated May 6, 2024 • 5

ShenaoZ/0.0001_zephyrgemmasft_withdpo_4iters_bs256_555lr_iter_1

Text Generation • 7B • Updated May 6, 2024 • 5

ShenaoZ/0.0001_zephyrdpoinit_nodpo_3iters_bs256_555lr_iter_2

Text Generation • 7B • Updated May 6, 2024 • 4

ShenaoZ/0.0001_zephyrgemmasft_withdpo_4iters_bs256_555lr_iter_2

Text Generation • 7B • Updated May 6, 2024 • 7

vipinkatara/Mistral-7B-v0.1-orpo-final1

Text Generation • 7B • Updated May 7, 2024 • 5

ShenaoZ/0.0001_sft_nodpo_3iters_bs256_555lr_iter_3

Text Generation • 7B • Updated May 6, 2024 • 7

ShenaoZ/0.0001_zephyrdpoinit_nodpo_3iters_bs256_555lr_iter_3

Text Generation • 7B • Updated May 6, 2024 • 7

ShenaoZ/0.0001_zephyrgemmasft_withdpo_4iters_bs256_555lr_iter_3

Text Generation • 7B • Updated May 6, 2024 • 7

DUAL-GPO/phi-2-gpo-renew2-b0.001-0.05ultrafeedback-rank128-i1

Updated May 6, 2024 • 5

DUAL-GPO/zephyr-7b-gpo-log-test-i0

Updated May 6, 2024 • 7

DUAL-GPO/zephyr-7b-gpo-test-i0

Updated May 6, 2024 • 7

DUAL-GPO/zephyr-7b-lgpo-v1-i1

Updated May 7, 2024 • 9

DUAL-GPO-2/zephyr-7b-gpo-v6-i1

Updated May 7, 2024 • 10

DUAL-GPO/zephyr-7b-gpo-v5-i1

Updated May 7, 2024 • 9

ShenaoZ/0.0001_sft_nodpo_4iters_bs256_555lr_iter_1

Text Generation • 7B • Updated May 6, 2024 • 5

ShenaoZ/0.0001_sft_nodpo_5iters_bs256_555lr_iter_1

Text Generation • 7B • Updated May 6, 2024 • 4

ShenaoZ/0.0001_sft_nodpo_5iters_bs256_555lr_iter_2

Text Generation • 7B • Updated May 6, 2024 • 5

ShenaoZ/0.0001_sft_nodpo_4iters_bs256_555lr_iter_2

Text Generation • 7B • Updated May 7, 2024 • 5

ShenaoZ/0.0_withdpo_4iters_bs256_5102lr_iter_1

Text Generation • 7B • Updated May 7, 2024 • 5

Minbyul/biomistral-7b-wo-kqa_golden-iter-sft-dpo-step1

Text Generation • 7B • Updated May 7, 2024 • 3

ShenaoZ/0.0001_sft_nodpo_5iters_bs256_555lr_iter_3

Text Generation • 7B • Updated May 7, 2024 • 5

ShenaoZ/0.0001_sft_nodpo_4iters_bs256_555lr_iter_3

Text Generation • 7B • Updated May 7, 2024 • 7

Ritvik19/openhermes-tinyllama-sft-qlora

Updated May 7, 2024 • 9

YYYYYYibo/vanilla_doff_dpo_iter_1

Updated May 7, 2024 • 7

ShenaoZ/0.0001_sft_nodpo_5iters_bs256_555lr_iter_4

Text Generation • 7B • Updated May 7, 2024 • 5

DUAL-GPO-2/phi-2-gpo-renew2-b0.001-vllm-merge-20k-i1

Updated May 7, 2024 • 6