{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/dress-disentangled-representation-based-self","title":"DRESS: Disentangled Representation-based Self-Supervised Meta-Learning for Diverse Tasks","arxiv_id":"2503.09679","date":"2025-03-12","proceeding":null,"authors":["Wei Cui","Tongzi Wu","Jesse C. Cresswell","Yi Sui","Keyvan Golestan"],"abstract":"Meta-learning represents a strong class of approaches for solving few-shot learning tasks. Nonetheless, recent research suggests that simply pre-training a generic encoder can potentially surpass meta-learning algorithms. In this paper, we first discuss the reasons why meta-learning fails to stand out in these few-shot learning experiments, and hypothesize that it is due to the few-shot learning tasks lacking diversity. We propose DRESS, a task-agnostic Disentangled REpresentation-based Self-Supervised meta-learning approach that enables fast model adaptation on highly diversified few-shot learning tasks. Specifically, DRESS utilizes disentangled representation learning to create self-supervised tasks that can fuel the meta-training process. Furthermore, we also propose a class-partition based metric for quantifying the task diversity directly on the input space. We validate the effectiveness of DRESS through experiments on datasets with multiple factors of variation and varying complexity. The results suggest that DRESS is able to outperform competing methods on the majority of the datasets and task setups. Through this paper, we advocate for a re-examination of proper setups for task adaptation studies, and aim to reignite interest in the potential of meta-learning for solving few-shot learning tasks via disentangled representations.","url_abs":"https://arxiv.org/abs/2503.09679v1","url_pdf":"https://arxiv.org/pdf/2503.09679v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"dress-disentangled-representation-based-self","repo_url":"https://github.com/layer6ai-labs/DRESS","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":null}],"tasks":[{"task_slug":"diversity","task_name":"Diversity"},{"task_slug":"few-shot-learning","task_name":"Few-Shot Learning"},{"task_slug":"meta-learning","task_name":"Meta-Learning"},{"task_slug":"representation-learning","task_name":"Representation Learning"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2503.09679","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2503.09679"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/layer6ai-labs/DRESS","reach":null}],"summary":{"ran":3,"ran_draft_wrong":2,"unverified":6},"by_repo_kind":{"official":{"samples":9,"ran":4,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":2,"samples":[{"code_sha256_prefix":"b22fdd4994990f4f","entry":"QKVAttention","repo":"layer6ai-labs/DRESS","repo_kind":"official","path":"encoders/diti.py","file_url":"https://github.com/layer6ai-labs/DRESS/blob/HEAD/encoders/diti.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"b22fdd4994990f4f"}},{"code_sha256_prefix":"56122d5495b08e3f","entry":"QKVAttentionLegacy","repo":"layer6ai-labs/DRESS","repo_kind":"official","path":"encoders/diti.py","file_url":"https://github.com/layer6ai-labs/DRESS/blob/HEAD/encoders/diti.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"56122d5495b08e3f"}},{"code_sha256_prefix":"a5788ad13b47f3b3","entry":"View","repo":"layer6ai-labs/DRESS","repo_kind":"official","path":"encoders/diti.py","file_url":"https://github.com/layer6ai-labs/DRESS/blob/HEAD/encoders/diti.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"a5788ad13b47f3b3"}},{"code_sha256_prefix":"992e95480b7cbca2","entry":"normalization","repo":"layer6ai-labs/DRESS","repo_kind":"official","path":"encoders/diti.py","file_url":"https://github.com/layer6ai-labs/DRESS/blob/HEAD/encoders/diti.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"992e95480b7cbca2"}},{"code_sha256_prefix":"129b804760b3115f","entry":"zero_module","repo":null,"repo_kind":null,"path":null,"file_url":null,"link_basis":"identical_code_first_harvested_elsewhere","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":null,"inline_ok":false,"mcp_get_code":{"code_sha256":"129b804760b3115f"}},{"code_sha256_prefix":"f6b39d2739468aaf","entry":"AttentionBlock","repo":"layer6ai-labs/DRESS","repo_kind":"official","path":"encoders/diti.py","file_url":"https://github.com/layer6ai-labs/DRESS/blob/HEAD/encoders/diti.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"f6b39d2739468aaf"}},{"code_sha256_prefix":"53af6e132f2045c0","entry":"DiTi","repo":"layer6ai-labs/DRESS","repo_kind":"official","path":"encoders/diti.py","file_url":"https://github.com/layer6ai-labs/DRESS/blob/HEAD/encoders/diti.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"53af6e132f2045c0"}},{"code_sha256_prefix":"b2bebacdf89de0ec","entry":"DiTiCELEBAEncoder","repo":"layer6ai-labs/DRESS","repo_kind":"official","path":"encoders/diti.py","file_url":"https://github.com/layer6ai-labs/DRESS/blob/HEAD/encoders/diti.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"b2bebacdf89de0ec"}},{"code_sha256_prefix":"d241c9856ac78e53","entry":"_get_mask_end_dim","repo":"layer6ai-labs/DRESS","repo_kind":"official","path":"encoders/diti.py","file_url":"https://github.com/layer6ai-labs/DRESS/blob/HEAD/encoders/diti.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"d241c9856ac78e53"}},{"code_sha256_prefix":"3c3e6fb356a512b8","entry":"construct_latent_groups","repo":"layer6ai-labs/DRESS","repo_kind":"official","path":"encoders/diti.py","file_url":"https://github.com/layer6ai-labs/DRESS/blob/HEAD/encoders/diti.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"3c3e6fb356a512b8"}},{"code_sha256_prefix":"fe4eb545bbb728e0","entry":"conv_nd","repo":null,"repo_kind":null,"path":null,"file_url":null,"link_basis":"identical_code_first_harvested_elsewhere","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":null,"inline_ok":false,"mcp_get_code":{"code_sha256":"fe4eb545bbb728e0"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}