{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/dynamic-language-binding-in-relational-visual","title":"Dynamic Language Binding in Relational Visual Reasoning","arxiv_id":"2004.14603","date":"2020-04-30","proceeding":null,"authors":["Thao Minh Le","Vuong Le","Svetha Venkatesh","Truyen Tran"],"abstract":"We present Language-binding Object Graph Network, the first neural reasoning method with dynamic relational structures across both visual and textual domains with applications in visual question answering. Relaxing the common assumption made by current models that the object predicates pre-exist and stay static, passive to the reasoning process, we propose that these dynamic predicates expand across the domain borders to include pair-wise visual-linguistic object binding. In our method, these contextualized object links are actively found within each recurrent reasoning step without relying on external predicative priors. These dynamic structures reflect the conditional dual-domain object dependency given the evolving context of the reasoning through co-attention. Such discovered dynamic graphs facilitate multi-step knowledge combination and refinements that iteratively deduce the compact representation of the final answer. The effectiveness of this model is demonstrated on image question answering demonstrating favorable performance on major VQA datasets. Our method outperforms other methods in sophisticated question-answering tasks wherein multiple object relations are involved. The graph structure effectively assists the progress of training, and therefore the network learns efficiently compared to other reasoning models.","url_abs":"https://arxiv.org/abs/2004.14603v3","url_pdf":"https://arxiv.org/pdf/2004.14603v3.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"dynamic-language-binding-in-relational-visual","repo_url":"https://github.com/thaolmk54/LOGNet-VQA","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"pytorch","reach":null}],"tasks":[{"task_slug":"object","task_name":"Object"},{"task_slug":"question-answering","task_name":"Question Answering"},{"task_slug":"visual-question-answering-1","task_name":"Visual Question Answering"},{"task_slug":"visual-question-answering","task_name":"Visual Question Answering (VQA)"},{"task_slug":"visual-reasoning","task_name":"Visual Reasoning"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2004.14603","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2004.14603"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/thaolmk54/LOGNet-VQA","reach":null}],"summary":{"ran":5,"unverified":4},"by_repo_kind":{"listed":{"samples":9,"ran":5,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"2401a481f69c8d60","entry":"Controller","repo":"thaolmk54/LOGNet-VQA","repo_kind":"listed","path":"exp_clevr/model/LOGUnits.py","file_url":"https://github.com/thaolmk54/LOGNet-VQA/blob/HEAD/exp_clevr/model/LOGUnits.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"2401a481f69c8d60"}},{"code_sha256_prefix":"890c90f4b841447c","entry":"GraphConstructor","repo":"thaolmk54/LOGNet-VQA","repo_kind":"listed","path":"exp_clevr/model/LOGUnits.py","file_url":"https://github.com/thaolmk54/LOGNet-VQA/blob/HEAD/exp_clevr/model/LOGUnits.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"890c90f4b841447c"}},{"code_sha256_prefix":"bd5196cd30adaf0f","entry":"GraphConvolution","repo":"thaolmk54/LOGNet-VQA","repo_kind":"listed","path":"exp_clevr/model/LOGUnits.py","file_url":"https://github.com/thaolmk54/LOGNet-VQA/blob/HEAD/exp_clevr/model/LOGUnits.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"bd5196cd30adaf0f"}},{"code_sha256_prefix":"d4809f91c00e743c","entry":"RepRefinement","repo":"thaolmk54/LOGNet-VQA","repo_kind":"listed","path":"exp_clevr/model/LOGUnits.py","file_url":"https://github.com/thaolmk54/LOGNet-VQA/blob/HEAD/exp_clevr/model/LOGUnits.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"d4809f91c00e743c"}},{"code_sha256_prefix":"4e516ff2044792ee","entry":"ResidualGCN","repo":"thaolmk54/LOGNet-VQA","repo_kind":"listed","path":"exp_clevr/model/LOGUnits.py","file_url":"https://github.com/thaolmk54/LOGNet-VQA/blob/HEAD/exp_clevr/model/LOGUnits.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"4e516ff2044792ee"}},{"code_sha256_prefix":"5d1db5ba17ad45e5","entry":"LOGUnits","repo":"thaolmk54/LOGNet-VQA","repo_kind":"listed","path":"exp_clevr/model/LOGUnits.py","file_url":"https://github.com/thaolmk54/LOGNet-VQA/blob/HEAD/exp_clevr/model/LOGUnits.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"5d1db5ba17ad45e5"}},{"code_sha256_prefix":"c75b5c065f748b81","entry":"LanguageBinding","repo":"thaolmk54/LOGNet-VQA","repo_kind":"listed","path":"exp_clevr/model/LOGUnits.py","file_url":"https://github.com/thaolmk54/LOGNet-VQA/blob/HEAD/exp_clevr/model/LOGUnits.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"c75b5c065f748b81"}},{"code_sha256_prefix":"3c1c7b5a1c6feb7f","entry":"MemoryUpdate","repo":"thaolmk54/LOGNet-VQA","repo_kind":"listed","path":"exp_clevr/model/LOGUnits.py","file_url":"https://github.com/thaolmk54/LOGNet-VQA/blob/HEAD/exp_clevr/model/LOGUnits.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"3c1c7b5a1c6feb7f"}},{"code_sha256_prefix":"07bd0dba4c652d5b","entry":"WordsToSingleVisualNode","repo":"thaolmk54/LOGNet-VQA","repo_kind":"listed","path":"exp_clevr/model/LOGUnits.py","file_url":"https://github.com/thaolmk54/LOGNet-VQA/blob/HEAD/exp_clevr/model/LOGUnits.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"07bd0dba4c652d5b"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}