{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/a-comprehensive-survey-of-reward-models","title":"A Comprehensive Survey of Reward Models: Taxonomy, Applications, Challenges, and Future","arxiv_id":"2504.12328","date":"2025-04-12","proceeding":null,"authors":["Jialun Zhong","Wei Shen","Yanzeng Li","Songyang Gao","Hua Lu","Yicheng Chen","Yang Zhang","Wei Zhou","Jinjie Gu","Lei Zou"],"abstract":"Reward Model (RM) has demonstrated impressive potential for enhancing Large Language Models (LLM), as RM can serve as a proxy for human preferences, providing signals to guide LLMs' behavior in various tasks. In this paper, we provide a comprehensive overview of relevant research, exploring RMs from the perspectives of preference collection, reward modeling, and usage. Next, we introduce the applications of RMs and discuss the benchmarks for evaluation. Furthermore, we conduct an in-depth analysis of the challenges existing in the field and dive into the potential research directions. This paper is dedicated to providing beginners with a comprehensive introduction to RMs and facilitating future studies. The resources are publicly available at github\\footnote{https://github.com/JLZhong23/awesome-reward-models}.","url_abs":"https://arxiv.org/abs/2504.12328v1","url_pdf":"https://arxiv.org/pdf/2504.12328v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"a-comprehensive-survey-of-reward-models","repo_url":"https://github.com/jlzhong23/awesome-reward-models","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"none","reach":{"status":"ok"}}],"tasks":[],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/2504.12328","atlas_url":"https://app.syntology.ai/?focus=2504.12328","mcp":null,"developers":"https://syntology.ai/developers"},"arxiv_metadata":null,"syntology_extracted_results":null}