{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/arxiv-2603-28610","title":"ResAdapt: Adaptive Resolution for Efficient Multimodal Reasoning","arxiv_id":"2603.28610","date":"2026-03-30","proceeding":null,"authors":["Huanxuan Liao","Zhongtao Jiang","Yupu Hao","Yuqiao Tan","Shizhu He","Ben Wang","Jun Zhao","Kun Xu","Kang Liu"],"abstract":"Multimodal Large Language Models (MLLMs) achieve stronger visual understanding by scaling input fidelity, yet the resulting visual token growth makes jointly sustaining high spatial resolution and long temporal context prohibitive. We argue that the bottleneck lies not in how post-encoding representations are compressed but in the volume of pixels the encoder receives, and address it with ResAdapt, an Input-side adaptation framework that learns how much visual budget each frame should receive before encoding. ResAdapt couples a lightweight Allocator with an unchanged MLLM backbone, so the backbone retains its native visual-token interface while receiving an operator-transformed input. We formulate allocation as a contextual bandit and train the Allocator with Cost-Aware Policy Optimization (CAPO), which converts sparse rollout feedback into a stable accuracy-cost learning signal. Across budget-controlled video QA, temporal grounding, and image reasoning tasks, ResAdapt improves low-budget operating points and often lies on or near the efficiency-accuracy frontier, with the clearest gains on reasoning-intensive benchmarks under aggressive compression. Notably, ResAdapt supports up to 16x more frames at the same visual budget while delivering over 15% performance gain. Code is available at https://github.com/Xnhyacinth/ResAdapt.","url_abs":"https://arxiv.org/abs/2603.28610","url_pdf":"https://arxiv.org/pdf/2603.28610","source":{"archive":null,"snapshot":"2025-07-28","note":"not in the Papers with Code archive (frozen at the snapshot)","row_kind":"graph","title_abstract_authors_date":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)"},"code_links":[],"tasks":[],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2603.28610","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2603.28610"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"mentioned_in_github":null,"is_official":null,"provenance":"deterministic:regex_extraction","mentioned_in_paper":null,"url":"https://github.com/Xnhyacinth/ResAdapt","reach":null}],"summary":{"ran_violates":1,"ran_draft_wrong":1,"unverified":3},"by_repo_kind":{"found_in_text":{"samples":5,"ran":2,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":5,"samples":[{"code_sha256_prefix":"aa5486a3650902d8","entry":"exists","repo":"Xnhyacinth/ResAdapt","repo_kind":"found_in_text","path":"resadapt/allocator/aznet_light_v1.py","file_url":"https://github.com/Xnhyacinth/ResAdapt/blob/HEAD/resadapt/allocator/aznet_light_v1.py","link_basis":"harvester_set","language":"python","status":"ran_violates","verification_level":1,"contract_check":"VIOLATES","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"aa5486a3650902d8"}},{"code_sha256_prefix":"fdd93453f92f9167","entry":"rotate_half","repo":"Xnhyacinth/ResAdapt","repo_kind":"found_in_text","path":"resadapt/allocator/aznet_v1.py","file_url":"https://github.com/Xnhyacinth/ResAdapt/blob/HEAD/resadapt/allocator/aznet_v1.py","link_basis":"plan_row","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"fdd93453f92f9167"}},{"code_sha256_prefix":"5d733ab29c30bfdf","entry":"FeedForward","repo":"Xnhyacinth/ResAdapt","repo_kind":"found_in_text","path":"resadapt/allocator/aznet_v1.py","file_url":"https://github.com/Xnhyacinth/ResAdapt/blob/HEAD/resadapt/allocator/aznet_v1.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"5d733ab29c30bfdf"}},{"code_sha256_prefix":"05123557cbed8a5d","entry":"count_params","repo":"Xnhyacinth/ResAdapt","repo_kind":"found_in_text","path":"resadapt/allocator/modeling_allocator_smol_v1.py","file_url":"https://github.com/Xnhyacinth/ResAdapt/blob/HEAD/resadapt/allocator/modeling_allocator_smol_v1.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"05123557cbed8a5d"}},{"code_sha256_prefix":"4be5d19ab34c5d1a","entry":"create_rl_dataset","repo":"Xnhyacinth/ResAdapt","repo_kind":"found_in_text","path":"resadapt/main_ppo.py","file_url":"https://github.com/Xnhyacinth/ResAdapt/blob/HEAD/resadapt/main_ppo.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"4be5d19ab34c5d1a"}}]},"arxiv_metadata":{"licence":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)","fields":["title","abstract","authors","date"],"primary_category":"cs.CL","source":"arxiv_2026.jsonl"},"syntology_extracted_results":null}