{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/rethinking-diversified-and-discriminative","title":"Rethinking Diversified and Discriminative Proposal Generation for Visual Grounding","arxiv_id":"1805.03508","date":"2018-05-09","proceeding":null,"authors":["Zhou Yu","Jun Yu","Chenchao Xiang","Zhou Zhao","Qi Tian","DaCheng Tao"],"abstract":"Visual grounding aims to localize an object in an image referred to by a\ntextual query phrase. Various visual grounding approaches have been proposed,\nand the problem can be modularized into a general framework: proposal\ngeneration, multi-modal feature representation, and proposal ranking. Of these\nthree modules, most existing approaches focus on the latter two, with the\nimportance of proposal generation generally neglected. In this paper, we\nrethink the problem of what properties make a good proposal generator. We\nintroduce the diversity and discrimination simultaneously when generating\nproposals, and in doing so propose Diversified and Discriminative Proposal\nNetworks model (DDPN). Based on the proposals generated by DDPN, we propose a\nhigh performance baseline model for visual grounding and evaluate it on four\nbenchmark datasets. Experimental results demonstrate that our model delivers\nsignificant improvements on all the tested data-sets (e.g., 18.8\\% improvement\non ReferItGame and 8.2\\% improvement on Flickr30k Entities over the existing\nstate-of-the-arts respectively)","url_abs":"http://arxiv.org/abs/1805.03508v1","url_pdf":"http://arxiv.org/pdf/1805.03508v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"rethinking-diversified-and-discriminative","repo_url":"https://github.com/xiangchenchao/ddpn","is_official":1,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"pytorch","reach":{"status":"ok"}}],"tasks":[{"task_slug":"diversity","task_name":"Diversity"},{"task_slug":"phrase-grounding","task_name":"Phrase Grounding"},{"task_slug":"visual-grounding","task_name":"Visual Grounding"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[{"leaderboard":"/sota/phrase-grounding-on-flickr30k-entities-test","task":"Phrase Grounding","dataset":"Flickr30k Entities Test","model":"DDPN (ResNet-101)","rank_in_archive_order":9,"of":18,"metrics":{"R@1":"73.3"},"uses_additional_data":false}],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=1805.03508","mcp":null,"developers":"https://syntology.ai/developers"},"arxiv_metadata":null,"syntology_extracted_results":null}