{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/arxiv-2602-14028","title":"GRRM: Group Relative Reward Modeling for Machine Translation","arxiv_id":"2602.14028","date":"2026-02-15","proceeding":null,"authors":["Sen Yang","Shanbo Cheng","Lu Xu","Jianbing Zhang","Shujian Huang"],"abstract":"While Group Relative Policy Optimization (GRPO) offers a powerful framework for LLM post-training, its effectiveness in open-ended domains like Machine Translation hinges on accurate intra-group ranking. We identify that standard Scalar Quality Metrics (SQM) fall short in this context; by evaluating candidates in isolation, they lack the comparative context necessary to distinguish fine-grained linguistic nuances. To address this, we introduce the Group Quality Metric (GQM) paradigm and instantiate it via the Group Relative Reward Model (GRRM). Unlike traditional independent scorers, GRRM processes the entire candidate group jointly, leveraging comparative analysis to rigorously resolve relative quality and adaptive granularity. Empirical evaluations confirm that GRRM achieves competitive ranking accuracy among all baselines. Building on this foundation, we integrate GRRM into the GRPO training loop to optimize the translation policy. Experimental results demonstrate that our framework not only improves general translation quality but also unlocks reasoning capabilities comparable to state-of-the-art reasoning models. We release codes, datasets, and model checkpoints at https://github.com/NJUNLP/GRRM.","url_abs":"https://arxiv.org/abs/2602.14028","url_pdf":"https://arxiv.org/pdf/2602.14028","source":{"archive":null,"snapshot":"2025-07-28","note":"not in the Papers with Code archive (frozen at the snapshot)","row_kind":"graph","title_abstract_authors_date":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)"},"code_links":[],"tasks":[],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2602.14028","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2602.14028"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"mentioned_in_github":null,"is_official":null,"provenance":"deterministic:regex_extraction","mentioned_in_paper":null,"url":"https://github.com/NJUNLP/GRRM","reach":null}],"summary":{"ran_draft_wrong":5,"ran_honours":1,"ran":1,"ran_violates":1},"by_repo_kind":{"found_in_text":{"samples":8,"ran":8,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"e5814b44319ba995","entry":"_extract_ranking","repo":"NJUNLP/GRRM","repo_kind":"found_in_text","path":"utils/reward_utils.py","file_url":"https://github.com/NJUNLP/GRRM/blob/HEAD/utils/reward_utils.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"e5814b44319ba995"}},{"code_sha256_prefix":"24e66cad0e6b05a2","entry":"_split_last_line","repo":"NJUNLP/GRRM","repo_kind":"found_in_text","path":"utils/reward_utils.py","file_url":"https://github.com/NJUNLP/GRRM/blob/HEAD/utils/reward_utils.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"24e66cad0e6b05a2"}},{"code_sha256_prefix":"2441ed3471bcee3e","entry":"compare_orderings","repo":"NJUNLP/GRRM","repo_kind":"found_in_text","path":"utils/reward_utils.py","file_url":"https://github.com/NJUNLP/GRRM/blob/HEAD/utils/reward_utils.py","link_basis":"first_harvest_node","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"2441ed3471bcee3e"}},{"code_sha256_prefix":"5ff1ea205b53bef5","entry":"pair_relation","repo":"NJUNLP/GRRM","repo_kind":"found_in_text","path":"utils/reward_utils.py","file_url":"https://github.com/NJUNLP/GRRM/blob/HEAD/utils/reward_utils.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"5ff1ea205b53bef5"}},{"code_sha256_prefix":"d326d5abe618b300","entry":"parse_order","repo":"NJUNLP/GRRM","repo_kind":"found_in_text","path":"utils/reward_utils.py","file_url":"https://github.com/NJUNLP/GRRM/blob/HEAD/utils/reward_utils.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"d326d5abe618b300"}},{"code_sha256_prefix":"a95e1e9da8019ff3","entry":"ranking_reward_fn","repo":"NJUNLP/GRRM","repo_kind":"found_in_text","path":"utils/reward_utils.py","file_url":"https://github.com/NJUNLP/GRRM/blob/HEAD/utils/reward_utils.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"a95e1e9da8019ff3"}},{"code_sha256_prefix":"96cfe91cc5639ec9","entry":"ranking_reward_fn_no_cot","repo":"NJUNLP/GRRM","repo_kind":"found_in_text","path":"utils/reward_utils.py","file_url":"https://github.com/NJUNLP/GRRM/blob/HEAD/utils/reward_utils.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"96cfe91cc5639ec9"}},{"code_sha256_prefix":"9750cf5a239a0a35","entry":"validate_ranking","repo":"NJUNLP/GRRM","repo_kind":"found_in_text","path":"utils/reward_utils.py","file_url":"https://github.com/NJUNLP/GRRM/blob/HEAD/utils/reward_utils.py","link_basis":"first_harvest_node","language":"python","status":"ran_violates","verification_level":1,"contract_check":"VIOLATES","metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"9750cf5a239a0a35"}}]},"arxiv_metadata":{"licence":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)","fields":["title","abstract","authors","date"],"primary_category":"cs.CL","source":"arxiv_2026.jsonl"},"syntology_extracted_results":null}