{"url":"/dataset/pku-saferlhf-orpo-72k","name":"PKU-SafeRLHF-orpo-72k","full_name":null,"description_markdown":"<span style=\"color: red;\">Warning: this dataset contains data that may be offensive or harmful. The data are intended for research purposes, especially research that can make models less harmful.</span>\r\n\r\n[original PKU-SafeRLHF datasets (click 🔗 for more details)](https://huggingface.co/datasets/PKU-Alignment/PKU-SafeRLHF-single-dimension)\r\n\r\nwhat's the advantage of this **train** dataset over the original one ?\r\n- **standard chosen/rejected format of preference datasets** : make 'chosen' and 'rejected' according to 'better_response_id'\r\n- **only one file** : merge three train datasets(Alpaca-7B、Alpaca2-7B、Alpaca3-8B) into one file","description_withheld":null,"homepage":"https://huggingface.co/datasets/juneup/PKU-SafeRLHF-orpo-72k","introduced_date":null,"introduced_date_note":null,"introduced_by":null,"license":null,"modalities":[],"tasks":[],"languages":[],"variants":["PKU-SafeRLHF-orpo-72k"],"data_loaders":[],"num_papers_in_archive":1,"source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28"},"benchmarks":[],"papers_with_a_benchmark_row":[],"syntology_totals":{"read_at":"2026-09-24T18:15:14+00:00","papers_with_samples":0,"samples_harvested":0,"samples_ran":0,"samples_unverified":0,"pointer_only_for_licence":0,"papers_with_no_sample_that_ran":0,"note":"the per-paper counts above, summed; not a rate"},"papers_note":"The archive never published its papers-using-dataset list; these are papers with a leaderboard row on this dataset's benchmarks."}