{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/arxiv-2509-04833","title":"PropVG: End-to-End Proposal-Driven Visual Grounding with Multi-Granularity Discrimination","arxiv_id":"2509.04833","date":"2025-09-05","proceeding":"ICCV","authors":["Ming Dai","Wenxuan Cheng","Jiedong Zhuang","Jiang-jiang Liu","Hongshen Zhao","Zhenhua Feng","Wankou Yang"],"abstract":"Recent advances in visual grounding have largely shifted away from traditional proposal-based two-stage frameworks due to their inefficiency and high computational complexity, favoring end-to-end direct reference paradigms. However, these methods rely exclusively on the referred target for supervision, overlooking the potential benefits of prominent prospective targets. Moreover, existing approaches often fail to incorporate multi-granularity discrimination, which is crucial for robust object identification in complex scenarios. To address these limitations, we propose PropVG, an end-to-end proposal-based framework that, to the best of our knowledge, is the first to seamlessly integrate foreground object proposal generation with referential object comprehension without requiring additional detectors. Furthermore, we introduce a Contrastive-based Refer Scoring (CRS) module, which employs contrastive learning at both sentence and word levels to enhance the capability in understanding and distinguishing referred objects. Additionally, we design a Multi-granularity Target Discrimination (MTD) module that fuses object- and semantic-level information to improve the recognition of absent targets. Extensive experiments on gRefCOCO (GREC/GRES), Ref-ZOM, R-RefCOCO, and RefCOCO (REC/RES) benchmarks demonstrate the effectiveness of PropVG. The codes and models are available at https://github.com/Dmmm1997/PropVG.","url_abs":"https://arxiv.org/abs/2509.04833","url_pdf":"https://arxiv.org/pdf/2509.04833","source":{"archive":null,"snapshot":"2025-07-28","note":"not in the Papers with Code archive (frozen at the snapshot)","row_kind":"graph","title_abstract_authors_date":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)"},"code_links":[],"tasks":[],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/2509.04833","atlas_url":"https://app.syntology.ai/?focus=2509.04833","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2509.04833"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-25T09:33:49+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"mentioned_in_github":null,"is_official":null,"provenance":"deterministic:regex_extraction","mentioned_in_paper":null,"url":"https://github.com/Dmmm1997/PropVG","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"ran_fixture":3,"ran_draft_wrong":1,"unverified":8},"by_repo_kind":{"found_in_text":{"samples":12,"ran":4,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"c8ea5508b3ca2db0","entry":"apply_box_noise","repo":"Dmmm1997/PropVG","repo_kind":"found_in_text","path":"propvg/layers/denoising.py","file_url":"https://github.com/Dmmm1997/PropVG/blob/HEAD/propvg/layers/denoising.py","link_basis":"plan_row","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"c8ea5508b3ca2db0"}},{"code_sha256_prefix":"95bd488170c50d24","entry":"apply_label_noise","repo":"Dmmm1997/PropVG","repo_kind":"found_in_text","path":"propvg/layers/denoising.py","file_url":"https://github.com/Dmmm1997/PropVG/blob/HEAD/propvg/layers/denoising.py","link_basis":"plan_row","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"95bd488170c50d24"}},{"code_sha256_prefix":"856982244cffd7e3","entry":"box_cxcywh_to_xyxy","repo":"Dmmm1997/PropVG","repo_kind":"found_in_text","path":"propvg/layers/box_ops.py","file_url":"https://github.com/Dmmm1997/PropVG/blob/HEAD/propvg/layers/box_ops.py","link_basis":"plan_row","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"856982244cffd7e3"}},{"code_sha256_prefix":"be924e54ed79731b","entry":"multi_scale_deformable_attn_pytorch","repo":"Dmmm1997/PropVG","repo_kind":"found_in_text","path":"propvg/layers/multi_scale_deform_attn.py","file_url":"https://github.com/Dmmm1997/PropVG/blob/HEAD/propvg/layers/multi_scale_deform_attn.py","link_basis":"plan_row","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"be924e54ed79731b"}},{"code_sha256_prefix":"abe66849ff8e9119","entry":"box_iou","repo":"Dmmm1997/PropVG","repo_kind":"found_in_text","path":"propvg/layers/box_ops.py","file_url":"https://github.com/Dmmm1997/PropVG/blob/HEAD/propvg/layers/box_ops.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"abe66849ff8e9119"}},{"code_sha256_prefix":"9d703502a5c06dd4","entry":"box_xyxy_to_cxcywh","repo":"Dmmm1997/PropVG","repo_kind":"found_in_text","path":"propvg/layers/box_ops.py","file_url":"https://github.com/Dmmm1997/PropVG/blob/HEAD/propvg/layers/box_ops.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"9d703502a5c06dd4"}},{"code_sha256_prefix":"c8f336bbb9a19971","entry":"build_act_layer","repo":"Dmmm1997/PropVG","repo_kind":"found_in_text","path":"propvg/layers/dcn_v3.py","file_url":"https://github.com/Dmmm1997/PropVG/blob/HEAD/propvg/layers/dcn_v3.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"c8f336bbb9a19971"}},{"code_sha256_prefix":"3189378f2936393a","entry":"build_matcher","repo":"Dmmm1997/PropVG","repo_kind":"found_in_text","path":"propvg/core/matcher.py","file_url":"https://github.com/Dmmm1997/PropVG/blob/HEAD/propvg/core/matcher.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"3189378f2936393a"}},{"code_sha256_prefix":"132d865c3c70a243","entry":"build_norm_layer","repo":"Dmmm1997/PropVG","repo_kind":"found_in_text","path":"propvg/layers/dcn_v3.py","file_url":"https://github.com/Dmmm1997/PropVG/blob/HEAD/propvg/layers/dcn_v3.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"132d865c3c70a243"}},{"code_sha256_prefix":"47b44963c80f19d1","entry":"create_dummy_class","repo":"Dmmm1997/PropVG","repo_kind":"found_in_text","path":"propvg/layers/multi_scale_deform_attn.py","file_url":"https://github.com/Dmmm1997/PropVG/blob/HEAD/propvg/layers/multi_scale_deform_attn.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"47b44963c80f19d1"}},{"code_sha256_prefix":"5f2ed565ef0da8fc","entry":"create_dummy_func","repo":"Dmmm1997/PropVG","repo_kind":"found_in_text","path":"propvg/layers/multi_scale_deform_attn.py","file_url":"https://github.com/Dmmm1997/PropVG/blob/HEAD/propvg/layers/multi_scale_deform_attn.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"5f2ed565ef0da8fc"}},{"code_sha256_prefix":"a63400f18f4a819c","entry":"dcnv3_core_pytorch","repo":"Dmmm1997/PropVG","repo_kind":"found_in_text","path":"propvg/layers/dcn_v3.py","file_url":"https://github.com/Dmmm1997/PropVG/blob/HEAD/propvg/layers/dcn_v3.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"a63400f18f4a819c"}}]},"arxiv_metadata":{"licence":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)","fields":["title","abstract","authors","date"],"primary_category":"cs.CV","source":"arxiv_api"},"syntology_extracted_results":null}