SiliangZ/mistral_irl3_rm_data_idpo
Viewer
• Updated
• 208k • 3
Siliang Zeng
SiliangZ
AI & ML interests
Alignment, RLHF, LLM
Organizations
SiliangZ/mistral_irl3_rm_data_combined_idpo
Viewer
• Updated
• 624k • 4
SiliangZ/mistral_irl2_rm_data_combined_idpo
Viewer
• Updated
• 416k • 4
SiliangZ/AIHF_Online_RLHF_Iter2
Viewer
• Updated
• 20k • 9
SiliangZ/AIHF_Online_RLHF_Iter1
Viewer
• Updated
• 20k • 9
SiliangZ/ultrafeedback_with_demo_sft_pairs_temp07
Viewer
• Updated
• 269k • 6
SiliangZ/ultrachat_200k_mistral_sft_iter1_iter2_temp1_generations
Viewer
• Updated
• 624k • 9
SiliangZ/ultrachat_200k_mistral_sft_temp1_iter1
Viewer
• Updated
• 416k • 9
SiliangZ/ultrachat_200k_mistral_sft_and_mistral_irl1_round1_temp07
Viewer
• Updated
• 416k • 9 • 1
SiliangZ/ultrachat_200k_mistral_sft_temp1
Viewer
• Updated
• 231k • 7
SiliangZ/ultrachat_200k_mistral_sft_temp07
Viewer
• Updated
• 231k • 9
SiliangZ/TLDR_Preference_2
Viewer
• Updated
• 233k • 6
SiliangZ/TLDR_Preference_1
Viewer
• Updated
• 117k • 5
SiliangZ/iter1_temp07_iter0_round_3_generated_with_spin0
Viewer
• Updated
• 99.6k • 3
SiliangZ/iter1_temp07_and_temp1_iter0_round_3_generated_with_spin0
Viewer
• Updated
• 149k • 4
SiliangZ/iter1_temp1_iter0_round_3_generated_with_spin0
Viewer
• Updated
• 99.6k • 4
SiliangZ/spin_iter0_with_ultrachat_200k_iter0_iter1_5epochs
Viewer
• Updated
• 466k • 3
SiliangZ/16_generations_IRL_Iter0_RM_ultrachat_200k_vs_sft_with_spin_iter0_checkpoint_232
Viewer
• Updated
• 49.8k • 5
SiliangZ/SPIN_with_ultrachat_200k_iter_0_and_1
Viewer
• Updated
• 515k • 3
SiliangZ/spin_iter0_with_ultrachat_200k_pairs_two_rounds
Viewer
• Updated
• 466k • 4
SiliangZ/Generations_IRL_iter0_Bo16_5_epoch_checkpoint_237
Viewer
• Updated
• 49.8k • 6
SiliangZ/full_ultrachat_200k_vs_sft_with_spin_iter0
Viewer
• Updated
• 258k • 5
SiliangZ/full_ultrachat_200k_sft_greedy_generations
Viewer
• Updated
• 208k • 8
SiliangZ/ultrachat_200k_vs_zephyr_sft_greedy
Viewer
• Updated
• 208k • 5
SiliangZ/Labeled_Data_Best_of_16_Round_0
Viewer
• Updated
• 49.8k • 7
SiliangZ/UltraChat_50k_Prompt_800k_zephyr_sft_generations
Viewer
• Updated
• 49.8k • 30