Hao Sun's picture

1 8 18

Hao Sun

Holarissun

·

https://holarissun.github.io/

AI & ML interests

[email protected]. Deep RL, RL x LLM, RLHF.

Organizations

None yet

Holarissun 's models 356

Holarissun/SFT_gemma2b_hh-rlhf-helpful-gpt4_lr5e-06_epoch2-subset-1

Updated Jun 17, 2024 • 4

Holarissun/SFT_gemma2b_hh-rlhf-helpful_lr5e-06_epoch2-subset-1

Updated Jun 17, 2024 • 4

Holarissun/REPROD_dpo_helpfulhelpful_gpt4_subset-1_modelgemma7b_maxsteps10000_bz8_lr5e-06

Updated May 29, 2024 • 3

Holarissun/REPROD_dpo_harmlessharmless_gpt4_subset-1_modelgemma7b_maxsteps10000_bz8_lr5e-06

Updated May 29, 2024 • 4

Holarissun/REPROD_dpo_helpfulhelpful_human_subset-1_modelgemma7b_maxsteps10000_bz8_lr5e-06

Updated May 29, 2024 • 5

Holarissun/REPROD_dpo_harmlessharmless_human_subset-1_modelgemma7b_maxsteps10000_bz8_lr5e-06

Updated May 29, 2024 • 2

Holarissun/REPROD_dpo_helpfulhelpful_human_subset-1_modelgemma2b_maxsteps10000_bz8_lr5e-06

Updated May 28, 2024 • 6

Holarissun/REPROD_dpo_harmlessharmless_human_subset-1_modelgemma2b_maxsteps10000_bz8_lr5e-06

Updated May 28, 2024 • 2

Holarissun/REPROD_dpo_helpfulhelpful_human_subset-1_modelgemma2b_maxsteps10000_bz8_lr5e-05

Updated May 25, 2024 • 3

Holarissun/REPROD_dpo_harmlessharmless_human_subset-1_modelgemma2b_maxsteps6000_bz8_lr5e-05

Updated May 24, 2024 • 2

Holarissun/REPROD_dpo_helpfulhelpful_gpt4_subset-1_modelgemma2b_maxsteps10000_bz8_lr1e-05

Updated May 24, 2024 • 3

Holarissun/REPROD_dpo_harmlessharmless_human_subset-1_modelgemma2b_maxsteps6000_bz8_lr5e-06

Updated May 24, 2024 • 3

Holarissun/REPROD_dpo_helpfulhelpful_gpt3_subset-1_modelgemma2b_maxsteps10000_bz8_lr1e-05

Updated May 24, 2024 • 4 • 1

Holarissun/REPROD_dpo_helpfulhelpful_human_subset-1_modelgemma2b_maxsteps10000_bz8_lr1e-05

Updated May 24, 2024 • 3

Holarissun/REPROD_dpo_helpfulhelpful_gpt4_subset-1_modelgemma2b_maxsteps10000_bz8_lr5e-06

Updated May 24, 2024 • 4

Holarissun/REPROD_dpo_harmlessharmless_human_subset-1_modelgemma2b_maxsteps6000_bz8_lr1e-05

Updated May 24, 2024 • 2

Holarissun/REPROD_dpo_helpfulhelpful_gpt3_subset-1_modelgemma2b_maxsteps10000_bz8_lr5e-06

Updated May 24, 2024 • 2

Holarissun/dpo_tldrtldr_contrast_subset10000_modelgemma2b_maxsteps5000_bz8_lr1e-05

Updated May 13, 2024 • 5

Holarissun/RM-TLDR_gpt3_loraR64_-1_gemma2b_lr5e-05_bs2_g4

Updated May 12, 2024 • 2

Holarissun/RM-TLDR_gpt3_loraR64_-1_gemma2b_lr1e-06_bs2_g4

Updated May 12, 2024 • 2

Holarissun/RM-TLDR_gpt3_loraR64_-1_gemma2b_lr1.41e-05_bs2_g4

Updated May 12, 2024 • 3

Holarissun/RM-TLDR_gpt3_loraR64_-1_gemma2b_lr5e-06_bs2_g4

Updated May 12, 2024 • 3

Holarissun/RM-TLDR_contrast_loraR32_-1_gemma2b_lr5e-05_bs2_g4

Updated May 12, 2024 • 3

Holarissun/RM-TLDR_contrast_loraR64_-1_gemma2b_lr5e-05_bs2_g4

Updated May 12, 2024 • 2

Holarissun/RM-TLDR_contrast_loraR64_-1_gemma2b_lr1e-06_bs2_g4

Updated May 12, 2024 • 4

Holarissun/RM-TLDR_contrast_loraR64_-1_gemma2b_lr5e-06_bs2_g4

Updated May 12, 2024 • 4

Holarissun/RM-TLDR_contrast_loraR64_-1_gemma2b_lr1.41e-05_bs2_g4

Updated May 12, 2024 • 5

Holarissun/RM-TLDR_human_loraR64_-1_gemma7b_lr1.41e-05_bs2_g4

Updated May 11, 2024 • 4

Holarissun/dpo_harmlessharmless_contrast_subset20000_modelgpt2_maxsteps5000_bz8_lr5e-06

Updated May 11, 2024 • 2

Holarissun/dpo_harmlessharmless_contrast_subset20000_modelgpt2_maxsteps5000_bz8_lr1e-05

Updated May 11, 2024 • 1