{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/arxiv-2606-18910","title":"REVES: REvision and VErification--Augmented Training for Test-Time Scaling","arxiv_id":"2606.18910","date":"2026-06-17","proceeding":null,"authors":["Yuanxin Liu","Ruida Zhou","Xinyan Zhao","Amr Sharaf","Hongzhou Lin","Arijit Biswas","Mohammad Ghavamzadeh","Zhaoran Wang","Mingyi Hong"],"abstract":"Test-time scaling via sequential revision has emerged as a powerful paradigm for enhancing Large Language Model (LLM) reasoning. However, standard post-training methods primarily optimize single-shot objectives, creating a fundamental misalignment with multi-step inference dynamics. While recent work treats this as multi-turn reinforcement learning (RL), conventional approaches optimize over the multi-step trajectories directly, failing to further exploit the high-quality mistakes in intermediate steps that model can learn from correcting them. We propose a two-stage iterative framework that alternates between online data/prompt augmentation and policy optimization. By converting the intermediate steps (``near-miss'' answers) in the successful recovery trajectories into decoupled revision and verification prompts, our approach concentrates training on both effective answer transformation and error identification. This approach enables efficient off-policy data generation and reduces the computational overhead of long-horizon sampling compared to standard multi-turn RL. On LiveCodeBench, using publicly available test cases as feedback, we observe gains of +6.5 points over the RL baseline and +4.0 points over standard multi-turn training. Beyond coding, our approach matches the previously reported SOTA result on circle packing while using the smallest base model (4B) and far fewer rollouts than the much larger evolutionary search systems. Math results under ground-truth verification further confirm improved correction ability. It also generalizes to out-of-distribution constraint-satisfaction puzzles such as n\\_queens and mini\\_sudoku, where correctness is defined entirely by problem constraints. Code is available at https://github.com/yxliu02/REVES.git.","url_abs":"https://arxiv.org/abs/2606.18910","url_pdf":"https://arxiv.org/pdf/2606.18910","source":{"archive":null,"snapshot":"2025-07-28","note":"not in the Papers with Code archive (frozen at the snapshot)","row_kind":"graph","title_abstract_authors_date":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)"},"code_links":[],"tasks":[],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2606.18910","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2606.18910"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"mentioned_in_github":null,"is_official":null,"provenance":"deterministic:regex_extraction","mentioned_in_paper":null,"url":"https://github.com/yxliu02/REVES","reach":null}],"summary":{"ran":6,"unverified":3},"by_repo_kind":{"found_in_text":{"samples":9,"ran":6,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":9,"samples":[{"code_sha256_prefix":"6694df975c87349f","entry":"check_if_pass","repo":"yxliu02/REVES","repo_kind":"found_in_text","path":"evaluator/eval_travelplanner.py","file_url":"https://github.com/yxliu02/REVES/blob/HEAD/evaluator/eval_travelplanner.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"6694df975c87349f"}},{"code_sha256_prefix":"11f3de9065fe2129","entry":"compute_tail_confidence","repo":"yxliu02/REVES","repo_kind":"found_in_text","path":"evaluator/confidence.py","file_url":"https://github.com/yxliu02/REVES/blob/HEAD/evaluator/confidence.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"11f3de9065fe2129"}},{"code_sha256_prefix":"9b56f76fdba191e1","entry":"compute_token_confidence_from_topk","repo":"yxliu02/REVES","repo_kind":"found_in_text","path":"evaluator/confidence.py","file_url":"https://github.com/yxliu02/REVES/blob/HEAD/evaluator/confidence.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"9b56f76fdba191e1"}},{"code_sha256_prefix":"6ead68c2fb69f843","entry":"convert_function_to_class_method","repo":"yxliu02/REVES","repo_kind":"found_in_text","path":"evaluator/LiveCodeBench/compute_score.py","file_url":"https://github.com/yxliu02/REVES/blob/HEAD/evaluator/LiveCodeBench/compute_score.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"6ead68c2fb69f843"}},{"code_sha256_prefix":"d4259713effdc23b","entry":"normalize_countdown_answer","repo":"yxliu02/REVES","repo_kind":"found_in_text","path":"evaluator/eval_countdown.py","file_url":"https://github.com/yxliu02/REVES/blob/HEAD/evaluator/eval_countdown.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"d4259713effdc23b"}},{"code_sha256_prefix":"2dddcb48090ef99f","entry":"score","repo":"yxliu02/REVES","repo_kind":"found_in_text","path":"evaluator/eval_travelplanner.py","file_url":"https://github.com/yxliu02/REVES/blob/HEAD/evaluator/eval_travelplanner.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"2dddcb48090ef99f"}},{"code_sha256_prefix":"44f6a6f7dfba6796","entry":"eval_arc_full","repo":"yxliu02/REVES","repo_kind":"found_in_text","path":"evaluator/eval_arcagi.py","file_url":"https://github.com/yxliu02/REVES/blob/HEAD/evaluator/eval_arcagi.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"44f6a6f7dfba6796"}},{"code_sha256_prefix":"421dada0c713846d","entry":"eval_arc_train_only","repo":"yxliu02/REVES","repo_kind":"found_in_text","path":"evaluator/eval_arcagi.py","file_url":"https://github.com/yxliu02/REVES/blob/HEAD/evaluator/eval_arcagi.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"421dada0c713846d"}},{"code_sha256_prefix":"d3c889cf7bca8cd5","entry":"make_planner","repo":"yxliu02/REVES","repo_kind":"found_in_text","path":"main_parallel_mp.py","file_url":"https://github.com/yxliu02/REVES/blob/HEAD/main_parallel_mp.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"d3c889cf7bca8cd5"}}]},"arxiv_metadata":{"licence":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)","fields":["title","abstract","authors","date"],"primary_category":"cs.LG","source":"arxiv_2026.jsonl"},"syntology_extracted_results":null}