{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/arxiv-2603-22016","title":"ROM: Real-time Overthinking Mitigation via Streaming Detection and Intervention","arxiv_id":"2603.22016","date":"2026-03-23","proceeding":null,"authors":["Xinyan Wang","Xiaogeng Liu","Ming Pei","Chaowei Xiao"],"abstract":"Large Reasoning Models (LRMs) often reach a correct solution before their long Chain-of-Thought trace ends, yet continue with redundant verification, repeated attempts, or unnecessary exploration that wastes computation and can even overturn the correct answer. We frame this behavior as a latent productive-to-redundant transition and show it is directly reflected in hidden states: around first-correct-solution (FCS) boundaries, late-layer representations separate efficient from overthinking tokens, while boundary-permutation and position controls collapse. We propose ROM, a streaming intervention framework that monitors a frozen LRM with a lightweight hidden-state detector ($\\sim$0.1\\% of backbone parameters) and intervenes at well-formed reasoning boundaries; Counterfactual Self-Correction (CSC) balances supervision with wrong$\\rightarrow$correct trajectories, preserving useful pre-FCS self-correction. Unlike prior adaptive early-exit methods, ROM extracts no intermediate answers, launches no probe decoding, and updates no backbone weights. Across five backbones from three model families and five reasoning benchmarks, against ten recent baselines under a shared protocol, ROM$_{\\text{CSC}}$ attains the highest accuracy in 19 of 25 model--benchmark settings, cuts response length by 28--77\\% (mean 45\\%) versus vanilla decoding, and is the only method on the accuracy--length Pareto front in every setting. The same MATH500-trained supervision transfers zero-shot across scales, families, and task domains, and end-to-end wall-clock latency drops by 46.5\\% with $\\sim$5\\% per-token overhead. Code is available at https://github.com/SaFo-Lab/ROM.","url_abs":"https://arxiv.org/abs/2603.22016","url_pdf":"https://arxiv.org/pdf/2603.22016","source":{"archive":null,"snapshot":"2025-07-28","note":"not in the Papers with Code archive (frozen at the snapshot)","row_kind":"graph","title_abstract_authors_date":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)"},"code_links":[],"tasks":[],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2603.22016","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2603.22016"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"mentioned_in_github":null,"is_official":null,"provenance":"deterministic:regex_extraction","mentioned_in_paper":null,"url":"https://github.com/SaFo-Lab/ROM","reach":null}],"summary":{"ran":2,"ran_violates":1,"unverified":2},"by_repo_kind":{"found_in_text":{"samples":5,"ran":3,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"279e64cc9defba19","entry":"AttentionLayer","repo":"SaFo-Lab/ROM","repo_kind":"found_in_text","path":"rom/models.py","file_url":"https://github.com/SaFo-Lab/ROM/blob/HEAD/rom/models.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"279e64cc9defba19"}},{"code_sha256_prefix":"bc293b52aca4f276","entry":"CfcCell","repo":"SaFo-Lab/ROM","repo_kind":"found_in_text","path":"rom/models.py","file_url":"https://github.com/SaFo-Lab/ROM/blob/HEAD/rom/models.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"bc293b52aca4f276"}},{"code_sha256_prefix":"146de1d72445bdc7","entry":"build_custom_attention_mask","repo":"SaFo-Lab/ROM","repo_kind":"found_in_text","path":"rom/models.py","file_url":"https://github.com/SaFo-Lab/ROM/blob/HEAD/rom/models.py","link_basis":"first_harvest_node","language":"python","status":"ran_violates","verification_level":1,"contract_check":"VIOLATES","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"146de1d72445bdc7"}},{"code_sha256_prefix":"82997c77bfe00650","entry":"StreamingHead","repo":"SaFo-Lab/ROM","repo_kind":"found_in_text","path":"rom/models.py","file_url":"https://github.com/SaFo-Lab/ROM/blob/HEAD/rom/models.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"82997c77bfe00650"}},{"code_sha256_prefix":"5447babf2f2df6b4","entry":"_cfc_loop_jit","repo":"SaFo-Lab/ROM","repo_kind":"found_in_text","path":"rom/models.py","file_url":"https://github.com/SaFo-Lab/ROM/blob/HEAD/rom/models.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"5447babf2f2df6b4"}}]},"arxiv_metadata":{"licence":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)","fields":["title","abstract","authors","date"],"primary_category":"cs.LG","source":"arxiv_2026.jsonl"},"syntology_extracted_results":null}