berkeley-nest/Nectar
Viewer • Updated • 183k • 1.12k • 295
LM Preference datas
-
-
mlabonne/chatml_dpo_pairs
Viewer • Updated • 12.9k • 27 • 55 -
HuggingFaceH4/ultrachat_200k
Viewer • Updated • 515k • 46.6k • 691 -
Intel/orca_dpo_pairs
Viewer • Updated • 12.9k • 2.16k • 321 -
argilla/ultrafeedback-binarized-preferences-cleaned
Viewer • Updated • 60.9k • 8.68k • 162 -
argilla/distilabel-math-preference-dpo
Viewer • Updated • 2.42k • 288 • 88 -
PKU-Alignment/PKU-SafeRLHF
Viewer • Updated • 164k • 15.2k • 182 -
lvwerra/stack-exchange-paired
Viewer • Updated • 31.3M • 2.49k • 149 -
Anthropic/hh-rlhf
Viewer • Updated • 169k • 36.8k • 1.72k -
jondurbin/truthy-dpo-v0.1
Viewer • Updated • 1.02k • 358 • 136 -
neovalle/H4rmony
Viewer • Updated • 2.02k • 48 • 15 -
peiyi9979/Math-Shepherd
Viewer • Updated • 445k • 649 • 101 -
nvidia/HelpSteer
Viewer • Updated • 37.1k • 2.2k • 247 -
argilla/dpo-mix-7k
Viewer • Updated • 7.5k • 545 • 171 -
microsoft/ms_marco
Viewer • Updated • 1.11M • 24.2k • 240 -
openbmb/UltraInteract_sft
Viewer • Updated • 289k • 1.06k • 126 -
allenai/olmo-2-0325-32b-preference-mix
Updated • 119 • 15 -
PrimeIntellect/SYNTHETIC-2-Base-Answer-Critique
Viewer • Updated • 50k • 11 • 2