{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/progressive-semantic-visual-mutual-adaption","title":"Progressive Semantic-Visual Mutual Adaption for Generalized Zero-Shot Learning","arxiv_id":"2303.15322","date":"2023-03-27","proceeding":"CVPR 2023 1","authors":["Man Liu","Feng Li","Chunjie Zhang","Yunchao Wei","Huihui Bai","Yao Zhao"],"abstract":"Generalized Zero-Shot Learning (GZSL) identifies unseen categories by knowledge transferred from the seen domain, relying on the intrinsic interactions between visual and semantic information. Prior works mainly localize regions corresponding to the sharing attributes. When various visual appearances correspond to the same attribute, the sharing attributes inevitably introduce semantic ambiguity, hampering the exploration of accurate semantic-visual interactions. In this paper, we deploy the dual semantic-visual transformer module (DSVTM) to progressively model the correspondences between attribute prototypes and visual features, constituting a progressive semantic-visual mutual adaption (PSVMA) network for semantic disambiguation and knowledge transferability improvement. Specifically, DSVTM devises an instance-motivated semantic encoder that learns instance-centric prototypes to adapt to different images, enabling the recast of the unmatched semantic-visual pair into the matched one. Then, a semantic-motivated instance decoder strengthens accurate cross-domain interactions between the matched pair for semantic-related instance adaption, encouraging the generation of unambiguous visual representations. Moreover, to mitigate the bias towards seen classes in GZSL, a debiasing loss is proposed to pursue response consistency between seen and unseen predictions. The PSVMA consistently yields superior performances against other state-of-the-art methods. Code will be available at: https://github.com/ManLiuCoder/PSVMA.","url_abs":"https://arxiv.org/abs/2303.15322v1","url_pdf":"https://arxiv.org/pdf/2303.15322v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"progressive-semantic-visual-mutual-adaption","repo_url":"https://github.com/manliucoder/psvma","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok"}}],"tasks":[{"task_slug":"attribute","task_name":"Attribute"},{"task_slug":"decoder","task_name":"Decoder"},{"task_slug":"generalized-zero-shot-learning","task_name":"Generalized Zero-Shot Learning"},{"task_slug":"zero-shot-learning","task_name":"Zero-Shot Learning"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2303.15322","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2303.15322"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/manliucoder/psvma","reach":{"status":"ok"}},{"provenance":"deterministic:regex_extraction","url":"https://github.com/ManLiuCoder/PSVMA","reach":{"status":"ok"}}],"summary":{"ran":4,"ran_draft_wrong":1,"unverified":2},"by_repo_kind":{"official":{"samples":7,"ran":5,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":7,"samples":[{"code_sha256_prefix":"0e21305c3d5c717e","entry":"AnyAttention","repo":"ManLiuCoder/PSVMA","repo_kind":"official","path":"models/modeling/PSVMAModel/PSVMANet.py","file_url":"https://github.com/ManLiuCoder/PSVMA/blob/HEAD/models/modeling/PSVMAModel/PSVMANet.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"0e21305c3d5c717e"}},{"code_sha256_prefix":"37fda41f5c65d130","entry":"Mlp","repo":"ManLiuCoder/PSVMA","repo_kind":"official","path":"models/modeling/PSVMAModel/PSVMANet.py","file_url":"https://github.com/ManLiuCoder/PSVMA/blob/HEAD/models/modeling/PSVMAModel/PSVMANet.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"37fda41f5c65d130"}},{"code_sha256_prefix":"f21575969a49c927","entry":"SimpleReasoning","repo":"ManLiuCoder/PSVMA","repo_kind":"official","path":"models/modeling/PSVMAModel/PSVMANet.py","file_url":"https://github.com/ManLiuCoder/PSVMA/blob/HEAD/models/modeling/PSVMAModel/PSVMANet.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"f21575969a49c927"}},{"code_sha256_prefix":"492f429c85b8ac17","entry":"Tokenmix","repo":"ManLiuCoder/PSVMA","repo_kind":"official","path":"models/modeling/PSVMAModel/PSVMANet.py","file_url":"https://github.com/ManLiuCoder/PSVMA/blob/HEAD/models/modeling/PSVMAModel/PSVMANet.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"492f429c85b8ac17"}},{"code_sha256_prefix":"49e6743e36a2c42f","entry":"trunc_normal_","repo":"ManLiuCoder/PSVMA","repo_kind":"official","path":"models/modeling/PSVMAModel/PSVMANet.py","file_url":"https://github.com/ManLiuCoder/PSVMA/blob/HEAD/models/modeling/PSVMAModel/PSVMANet.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"49e6743e36a2c42f"}},{"code_sha256_prefix":"a2572b7acd0772c5","entry":"Block","repo":"ManLiuCoder/PSVMA","repo_kind":"official","path":"models/modeling/PSVMAModel/PSVMANet.py","file_url":"https://github.com/ManLiuCoder/PSVMA/blob/HEAD/models/modeling/PSVMAModel/PSVMANet.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"a2572b7acd0772c5"}},{"code_sha256_prefix":"84af83cab6dcad8f","entry":"PSVMANet","repo":"ManLiuCoder/PSVMA","repo_kind":"official","path":"models/modeling/PSVMAModel/PSVMANet.py","file_url":"https://github.com/ManLiuCoder/PSVMA/blob/HEAD/models/modeling/PSVMAModel/PSVMANet.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"84af83cab6dcad8f"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}