Datasets › PKU-SafeRLHF-orpo-72k

PKU-SafeRLHF-orpo-72k

archive 2025-07-28

Warning: this dataset contains data that may be offensive or harmful. The data are intended for research purposes, especially research that can make models less harmful.

original PKU-SafeRLHF datasets (click 🔗 for more details)

what's the advantage of this train dataset over the original one ? - standard chosen/rejected format of preference datasets : make 'chosen' and 'rejected' according to 'better_response_id' - only one file : merge three train datasets(Alpaca-7B、Alpaca2-7B、Alpaca3-8B) into one file

Benchmarks archive 2025-07-28

No leaderboard in the archive resolves to this dataset.

Papers archive 2025-07-28

No paper in the archive has a leaderboard row on this dataset; the archive counts 1 paper for it but never published that list.

Dataset loaders archive 2025-07-28

No loader listed in the archive.

Tasks archive 2025-07-28

No task tagged in the archive.

License archive 2025-07-28

No licence recorded in the archive. Absence here is not a statement about the dataset's terms.

Modalities archive 2025-07-28

No modality tagged.

Languages archive 2025-07-28

No language tagged.

Variants archive 2025-07-28

  • PKU-SafeRLHF-orpo-72k

1 variant name, as the archive lists them.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections