{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/arxiv-2606-16158","title":"Focus When Necessary: Adaptive Routing and Collaborative Grounding for Training-Free Visual Grounding","arxiv_id":"2606.16158","date":"2026-06-15","proceeding":null,"authors":["Yifan Wang","Peiming Li","Shiyu Li","Zhiyuan Hu","Xiaochen Yang","Wenming Yang","Yang Tang","Zheng Wei"],"abstract":"While Multimodal Large Language Models (MLLMs) excel in cross-modal reasoning, they often struggle to perceive fine-grained details in complex high-resolution images. Recent training-free methods address this through image scaling and localized cropping. However, applying these manipulations indiscriminately introduces computational redundancy for simple queries and can degrade accuracy by truncating essential global context or introducing irrelevant background noise. To this end, we propose LazyMCoT, a dynamic and training-free framework that adaptively allocates visual grounding efforts based on sample difficulty. The framework features an Adaptive Routing mechanism that evaluates predictive uncertainty using first-token statistics from a single forward pass. This efficiently bypasses confident cases while ensuring the recall of difficult samples via conformal calibration. For these challenging cases, a Collaborative Grounding module integrates the inherent cross-modal attention of the model with an external visual expert through a two-stage refinement process. This refinement process generates a precise localized display to recover small or occluded targets. Extensive experiments across diverse benchmarks demonstrate that LazyMCoT rivals training-based approaches by simultaneously improving reasoning accuracy and reducing average inference latency. Our code is availble at https://github.com/TencentBAC/LazyMCoT.","url_abs":"https://arxiv.org/abs/2606.16158","url_pdf":"https://arxiv.org/pdf/2606.16158","source":{"archive":null,"snapshot":"2025-07-28","note":"not in the Papers with Code archive (frozen at the snapshot)","row_kind":"graph","title_abstract_authors_date":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)"},"code_links":[],"tasks":[],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":null,"mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2606.16158"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"mentioned_in_github":null,"is_official":null,"provenance":"deterministic:regex_extraction","mentioned_in_paper":null,"url":"https://github.com/TencentBAC/LazyMCoT","reach":null}],"summary":{"ran_fixture":2,"ran":14,"ran_draft_wrong":1,"unverified":4},"by_repo_kind":{"found_in_text":{"samples":21,"ran":17,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"3c76e52815c5401d","entry":"repeat_kv","repo":"TencentBAC/LazyMCoT","repo_kind":"found_in_text","path":"Qwen2.5/modeling_qwen2_5_vl_re_infer.py","file_url":"https://github.com/TencentBAC/LazyMCoT/blob/HEAD/Qwen2.5/modeling_qwen2_5_vl_re_infer.py","link_basis":"plan_row","language":"python","status":"ran_fixture","verification_level":2,"contract_check":"RAISES","metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"3c76e52815c5401d"}},{"code_sha256_prefix":"4e0b167ecec51c2f","entry":"add_legend_to_lpd_image","repo":"TencentBAC/LazyMCoT","repo_kind":"found_in_text","path":"Qwen2.5/Get_box.py","file_url":"https://github.com/TencentBAC/LazyMCoT/blob/HEAD/Qwen2.5/Get_box.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"4e0b167ecec51c2f"}},{"code_sha256_prefix":"68c10fc085ad39ab","entry":"assign_entity_colors","repo":"TencentBAC/LazyMCoT","repo_kind":"found_in_text","path":"Qwen2.5/Get_box.py","file_url":"https://github.com/TencentBAC/LazyMCoT/blob/HEAD/Qwen2.5/Get_box.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"68c10fc085ad39ab"}},{"code_sha256_prefix":"4ff5e2363f779bc5","entry":"bbox_is_contained","repo":"TencentBAC/LazyMCoT","repo_kind":"found_in_text","path":"Qwen2.5/Get_box.py","file_url":"https://github.com/TencentBAC/LazyMCoT/blob/HEAD/Qwen2.5/Get_box.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"4ff5e2363f779bc5"}},{"code_sha256_prefix":"e73c38d042a613e4","entry":"build_answer_instr_v2","repo":"TencentBAC/LazyMCoT","repo_kind":"found_in_text","path":"Qwen2.5/inference.py","file_url":"https://github.com/TencentBAC/LazyMCoT/blob/HEAD/Qwen2.5/inference.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"e73c38d042a613e4"}},{"code_sha256_prefix":"57e95166ade5f25c","entry":"build_transform","repo":"TencentBAC/LazyMCoT","repo_kind":"found_in_text","path":"Internvl/utiles_internvl.py","file_url":"https://github.com/TencentBAC/LazyMCoT/blob/HEAD/Internvl/utiles_internvl.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"57e95166ade5f25c"}},{"code_sha256_prefix":"fc36fa0d03b1f887","entry":"call_grounding_expert","repo":"TencentBAC/LazyMCoT","repo_kind":"found_in_text","path":"Qwen2.5/utiles.py","file_url":"https://github.com/TencentBAC/LazyMCoT/blob/HEAD/Qwen2.5/utiles.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"fc36fa0d03b1f887"}},{"code_sha256_prefix":"db8e58c7121842e5","entry":"call_grounding_expert_local","repo":"TencentBAC/LazyMCoT","repo_kind":"found_in_text","path":"Qwen2.5/utiles.py","file_url":"https://github.com/TencentBAC/LazyMCoT/blob/HEAD/Qwen2.5/utiles.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"db8e58c7121842e5"}},{"code_sha256_prefix":"4f3612bd2bd5cd21","entry":"compute_router_v2_features","repo":"TencentBAC/LazyMCoT","repo_kind":"found_in_text","path":"Qwen2.5/inference.py","file_url":"https://github.com/TencentBAC/LazyMCoT/blob/HEAD/Qwen2.5/inference.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"4f3612bd2bd5cd21"}},{"code_sha256_prefix":"3ff7a3c1eec6ef6c","entry":"dynamic_preprocess","repo":"TencentBAC/LazyMCoT","repo_kind":"found_in_text","path":"Internvl/utiles_internvl.py","file_url":"https://github.com/TencentBAC/LazyMCoT/blob/HEAD/Internvl/utiles_internvl.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"3ff7a3c1eec6ef6c"}},{"code_sha256_prefix":"bd77f5f8067f18e9","entry":"find_closest_aspect_ratio","repo":"TencentBAC/LazyMCoT","repo_kind":"found_in_text","path":"Internvl/utiles_internvl.py","file_url":"https://github.com/TencentBAC/LazyMCoT/blob/HEAD/Internvl/utiles_internvl.py","link_basis":"plan_row","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":"well_formed","behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"bd77f5f8067f18e9"}},{"code_sha256_prefix":"0ec3c2d60f8cdba2","entry":"find_entity_token_indices","repo":"TencentBAC/LazyMCoT","repo_kind":"found_in_text","path":"Qwen2.5/utiles.py","file_url":"https://github.com/TencentBAC/LazyMCoT/blob/HEAD/Qwen2.5/utiles.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"0ec3c2d60f8cdba2"}},{"code_sha256_prefix":"3cbd0221e03b6e19","entry":"get_available_gpus","repo":"TencentBAC/LazyMCoT","repo_kind":"found_in_text","path":"Internvl/cycle_inference_internvl.py","file_url":"https://github.com/TencentBAC/LazyMCoT/blob/HEAD/Internvl/cycle_inference_internvl.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"3cbd0221e03b6e19"}},{"code_sha256_prefix":"0a4e5b7b6a531990","entry":"get_available_gpus","repo":"TencentBAC/LazyMCoT","repo_kind":"found_in_text","path":"Qwen2.5/cycle_infer.py","file_url":"https://github.com/TencentBAC/LazyMCoT/blob/HEAD/Qwen2.5/cycle_infer.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"0a4e5b7b6a531990"}},{"code_sha256_prefix":"8e2521476d8d70a8","entry":"load_dataset","repo":"TencentBAC/LazyMCoT","repo_kind":"found_in_text","path":"Qwen2.5/Vstar_Metric.py","file_url":"https://github.com/TencentBAC/LazyMCoT/blob/HEAD/Qwen2.5/Vstar_Metric.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"8e2521476d8d70a8"}},{"code_sha256_prefix":"e03d53ba9d4f9ae5","entry":"rotate_half","repo":"TencentBAC/LazyMCoT","repo_kind":"found_in_text","path":"Qwen2.5/modeling_qwen2_5_vl_re_infer.py","file_url":"https://github.com/TencentBAC/LazyMCoT/blob/HEAD/Qwen2.5/modeling_qwen2_5_vl_re_infer.py","link_basis":"harvester_set","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"e03d53ba9d4f9ae5"}},{"code_sha256_prefix":"be98428cc9e7a491","entry":"unpack_att_result","repo":"TencentBAC/LazyMCoT","repo_kind":"found_in_text","path":"Qwen2.5/inference.py","file_url":"https://github.com/TencentBAC/LazyMCoT/blob/HEAD/Qwen2.5/inference.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"be98428cc9e7a491"}},{"code_sha256_prefix":"049747a79920f0f7","entry":"apply_rotary_pos_emb_vision","repo":"TencentBAC/LazyMCoT","repo_kind":"found_in_text","path":"Qwen2.5/modeling_qwen2_5_vl_re_infer.py","file_url":"https://github.com/TencentBAC/LazyMCoT/blob/HEAD/Qwen2.5/modeling_qwen2_5_vl_re_infer.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"049747a79920f0f7"}},{"code_sha256_prefix":"4b4a1446c2b464c6","entry":"get_conv_template","repo":"TencentBAC/LazyMCoT","repo_kind":"found_in_text","path":"Internvl/conversation.py","file_url":"https://github.com/TencentBAC/LazyMCoT/blob/HEAD/Internvl/conversation.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"4b4a1446c2b464c6"}},{"code_sha256_prefix":"2beb8dd1f96cde4d","entry":"merge_json_files","repo":"TencentBAC/LazyMCoT","repo_kind":"found_in_text","path":"Qwen2.5/Vstar_Metric.py","file_url":"https://github.com/TencentBAC/LazyMCoT/blob/HEAD/Qwen2.5/Vstar_Metric.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"2beb8dd1f96cde4d"}},{"code_sha256_prefix":"18d3d1616e0f719c","entry":"read_multi_line_json_objects","repo":"TencentBAC/LazyMCoT","repo_kind":"found_in_text","path":"Qwen2.5/Vstar_Metric.py","file_url":"https://github.com/TencentBAC/LazyMCoT/blob/HEAD/Qwen2.5/Vstar_Metric.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"18d3d1616e0f719c"}}]},"arxiv_metadata":{"licence":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)","fields":["title","abstract","authors","date"],"primary_category":"cs.CL","source":"arxiv_2026.jsonl"},"syntology_extracted_results":{"kind":"leaderboard_placements","source":"Syntology's leaderboard-shaped extractor over the paper's own arXiv-HTML tables: a model pointed at a cell, the number was read from that cell and checked against the board's metric, dataset, split and scale, and an independent check accepted the entry; not reviewed by the paper's authors or the archive's editors","extractor_model":"global.anthropic.claude-sonnet-4-5-20250929-v1:0","verifier_model":null,"prompt_sha":"fa63d4bb9d755694","coverage":{"sentence":"Syntology has checked 6,264 of the 9,581 papers on this site that are newer than the archive; results from the others appear after they are checked.","papers_newer_than_archive":9581,"papers_checked":6264},"entries":[],"not_placed":{"boards":0,"rejected_by_independent_check":0,"refused_by_a_rule":0,"check_did_not_answer":0,"proposed_without_a_cell":0,"declined_by_site":0}}}