{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/relax-representation-learning-explainability","title":"RELAX: Representation Learning Explainability","arxiv_id":"2112.10161","date":"2021-12-19","proceeding":null,"authors":["Kristoffer K. Wickstrøm","Daniel J. Trosten","Sigurd Løkse","Ahcène Boubekki","Karl Øyvind Mikalsen","Michael C. Kampffmeyer","Robert Jenssen"],"abstract":"Despite the significant improvements that representation learning via self-supervision has led to when learning from unlabeled data, no methods exist that explain what influences the learned representation. We address this need through our proposed approach, RELAX, which is the first approach for attribution-based explanations of representations. Our approach can also model the uncertainty in its explanations, which is essential to produce trustworthy explanations. RELAX explains representations by measuring similarities in the representation space between an input and masked out versions of itself, providing intuitive explanations and significantly outperforming the gradient-based baseline. We provide theoretical interpretations of RELAX and conduct a novel analysis of feature extractors trained using supervised and unsupervised learning, providing insights into different learning strategies. Finally, we illustrate the usability of RELAX in multi-view clustering and highlight that incorporating uncertainty can be essential for providing low-complexity explanations, taking a crucial step towards explaining representations.","url_abs":"https://arxiv.org/abs/2112.10161v2","url_pdf":"https://arxiv.org/pdf/2112.10161v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"relax-representation-learning-explainability","repo_url":"https://github.com/wickstrom/relax","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[{"task_slug":"representation-learning","task_name":"Representation Learning"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2112.10161","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2112.10161"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/wickstrom/relax","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"unverified":3},"by_repo_kind":{"official":{"samples":3,"ran":0,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"734c4a7ec68b201f","entry":"imagenet_image_transforms","repo":"wickstrom/relax","repo_kind":"official","path":"src/relax_xai/utils.py","file_url":"https://github.com/wickstrom/relax/blob/HEAD/src/relax_xai/utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"734c4a7ec68b201f"}},{"code_sha256_prefix":"0f9642c784b50468","entry":"mask_generator","repo":"wickstrom/relax","repo_kind":"official","path":"src/relax_xai/masking_functions.py","file_url":"https://github.com/wickstrom/relax/blob/HEAD/src/relax_xai/masking_functions.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"0f9642c784b50468"}},{"code_sha256_prefix":"ee1af63b0c1e900c","entry":"unsqueeze_image","repo":"wickstrom/relax","repo_kind":"official","path":"src/relax_xai/utils.py","file_url":"https://github.com/wickstrom/relax/blob/HEAD/src/relax_xai/utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"ee1af63b0c1e900c"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}