{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/grounding-visual-representations-with-texts","title":"Grounding Visual Representations with Texts for Domain Generalization","arxiv_id":"2207.10285","date":"2022-07-21","proceeding":null,"authors":["Seonwoo Min","Nokyung Park","Siwon Kim","Seunghyun Park","Jinkyu Kim"],"abstract":"Reducing the representational discrepancy between source and target domains is a key component to maximize the model generalization. In this work, we advocate for leveraging natural language supervision for the domain generalization task. We introduce two modules to ground visual representations with texts containing typical reasoning of humans: (1) Visual and Textual Joint Embedder and (2) Textual Explanation Generator. The former learns the image-text joint embedding space where we can ground high-level class-discriminative information into the model. The latter leverages an explainable model and generates explanations justifying the rationale behind its decision. To the best of our knowledge, this is the first work to leverage the vision-and-language cross-modality approach for the domain generalization task. Our experiments with a newly created CUB-DG benchmark dataset demonstrate that cross-modality supervision can be successfully used to ground domain-invariant visual representations and improve the model generalization. Furthermore, in the large-scale DomainBed benchmark, our proposed method achieves state-of-the-art results and ranks 1st in average performance for five multi-domain datasets. The dataset and codes are available at https://github.com/mswzeus/GVRT.","url_abs":"https://arxiv.org/abs/2207.10285v2","url_pdf":"https://arxiv.org/pdf/2207.10285v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"grounding-visual-representations-with-texts","repo_url":"https://github.com/mswzeus/gvrt","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok"}}],"tasks":[{"task_slug":"domain-generalization","task_name":"Domain Generalization"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/2207.10285","atlas_url":"https://app.syntology.ai/?focus=2207.10285","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2207.10285"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-25T09:33:49+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/mswzeus/gvrt","reach":{"status":"ok"}},{"provenance":"deterministic:regex_extraction","url":"https://github.com/mswzeus/GVRT","reach":{"status":"ok"}}],"summary":{"ran":3,"ran_fixture":1,"unverified":4},"by_repo_kind":{"official":{"samples":8,"ran":4,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":8,"samples":[{"code_sha256_prefix":"0365865840bb039c","entry":"Bottleneck","repo":"mswzeus/GVRT","repo_kind":"official","path":"src/algorithms.py","file_url":"https://github.com/mswzeus/GVRT/blob/HEAD/src/algorithms.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"0365865840bb039c"}},{"code_sha256_prefix":"87938d2cb1a2cf79","entry":"Discriminator","repo":"mswzeus/GVRT","repo_kind":"official","path":"src/algorithms.py","file_url":"https://github.com/mswzeus/GVRT/blob/HEAD/src/algorithms.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"87938d2cb1a2cf79"}},{"code_sha256_prefix":"86b1bebccd3af0d9","entry":"Explainer","repo":"mswzeus/GVRT","repo_kind":"official","path":"src/algorithms.py","file_url":"https://github.com/mswzeus/GVRT/blob/HEAD/src/algorithms.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"86b1bebccd3af0d9"}},{"code_sha256_prefix":"dd2f0d0b92b15365","entry":"get_optimizer","repo":"mswzeus/GVRT","repo_kind":"official","path":"src/algorithms.py","file_url":"https://github.com/mswzeus/GVRT/blob/HEAD/src/algorithms.py","link_basis":"first_harvest_node","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"dd2f0d0b92b15365"}},{"code_sha256_prefix":"4e2bc3708f6de3a9","entry":"GVRT","repo":"mswzeus/GVRT","repo_kind":"official","path":"src/algorithms.py","file_url":"https://github.com/mswzeus/GVRT/blob/HEAD/src/algorithms.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"4e2bc3708f6de3a9"}},{"code_sha256_prefix":"653780e79cc4b453","entry":"MixStyle","repo":"mswzeus/GVRT","repo_kind":"official","path":"src/algorithms.py","file_url":"https://github.com/mswzeus/GVRT/blob/HEAD/src/algorithms.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"653780e79cc4b453"}},{"code_sha256_prefix":"8e3bbac06a50bb0b","entry":"ResNet","repo":"mswzeus/GVRT","repo_kind":"official","path":"src/algorithms.py","file_url":"https://github.com/mswzeus/GVRT/blob/HEAD/src/algorithms.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"8e3bbac06a50bb0b"}},{"code_sha256_prefix":"8862176401c5c495","entry":"Resnet50_mixstyle","repo":"mswzeus/GVRT","repo_kind":"official","path":"src/algorithms.py","file_url":"https://github.com/mswzeus/GVRT/blob/HEAD/src/algorithms.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"8862176401c5c495"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}