{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/universal-representation-learning-from","title":"Universal Representation Learning from Multiple Domains for Few-shot Classification","arxiv_id":"2103.13841","date":"2021-03-25","proceeding":"ICCV 2021 10","authors":["Wei-Hong Li","Xialei Liu","Hakan Bilen"],"abstract":"In this paper, we look at the problem of few-shot classification that aims to learn a classifier for previously unseen classes and domains from few labeled samples. Recent methods use adaptation networks for aligning their features to new domains or select the relevant features from multiple domain-specific feature extractors. In this work, we propose to learn a single set of universal deep representations by distilling knowledge of multiple separately trained networks after co-aligning their features with the help of adapters and centered kernel alignment. We show that the universal representations can be further refined for previously unseen domains by an efficient adaptation step in a similar spirit to distance learning methods. We rigorously evaluate our model in the recent Meta-Dataset benchmark and demonstrate that it significantly outperforms the previous methods while being more efficient. Our code will be available at https://github.com/VICO-UoE/URL.","url_abs":"https://arxiv.org/abs/2103.13841v1","url_pdf":"https://arxiv.org/pdf/2103.13841v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"universal-representation-learning-from","repo_url":"https://github.com/VICO-UoE/URL","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"tf","reach":null},{"paper_slug":"universal-representation-learning-from","repo_url":"https://github.com/google-research/meta-dataset","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"tf","reach":null},{"paper_slug":"universal-representation-learning-from","repo_url":"https://github.com/tmlr-group/CoPA","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"tf","reach":null},{"paper_slug":"universal-representation-learning-from","repo_url":"https://github.com/tmlr-group/mokd","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"tf","reach":{"status":"ok","spdx":"MIT"}},{"paper_slug":"universal-representation-learning-from","repo_url":"https://github.com/vico-uoe/universalrepresentations","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":null}],"tasks":[{"task_slug":"classification-1","task_name":"Classification"},{"task_slug":"few-shot-image-classification","task_name":"Few-Shot Image Classification"},{"task_slug":"classification","task_name":"General Classification"},{"task_slug":"representation-learning","task_name":"Representation Learning"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[{"leaderboard":"/sota/few-shot-image-classification-on-meta-dataset","task":"Few-Shot Image Classification","dataset":"Meta-Dataset","model":"URL (ResNet18, 84x84 image, shuffled data, scratch, MDL)","rank_in_archive_order":6,"of":22,"metrics":{"Accuracy":"75.75"},"uses_additional_data":false}],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2103.13841","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2103.13841"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/google-research/meta-dataset","reach":null},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/tmlr-group/mokd","reach":{"status":"ok","spdx":"MIT"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/vico-uoe/universalrepresentations","reach":null},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/VICO-UoE/URL","reach":null},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/tmlr-group/CoPA","reach":null}],"summary":{"ran_draft_wrong":11,"ran":1,"unverified":14},"by_repo_kind":{"official":{"samples":1,"ran":1,"repositories":1},"listed":{"samples":25,"ran":11,"repositories":3}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"7e968a05de2ba8b3","entry":"apply_selection","repo":"tmlr-group/CoPA","repo_kind":"listed","path":"models/pa.py","file_url":"https://github.com/tmlr-group/CoPA/blob/HEAD/models/pa.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"7e968a05de2ba8b3"}},{"code_sha256_prefix":"122da5c3e4363856","entry":"centering","repo":"tmlr-group/CoPA","repo_kind":"listed","path":"models/pa.py","file_url":"https://github.com/tmlr-group/CoPA/blob/HEAD/models/pa.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"122da5c3e4363856"}},{"code_sha256_prefix":"fa075e62a49c4713","entry":"compute_avg_prototypes","repo":"tmlr-group/CoPA","repo_kind":"listed","path":"models/pa.py","file_url":"https://github.com/tmlr-group/CoPA/blob/HEAD/models/pa.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"fa075e62a49c4713"}},{"code_sha256_prefix":"bfdceee8e94ba8ee","entry":"compute_max_prototype","repo":"tmlr-group/CoPA","repo_kind":"listed","path":"models/pa.py","file_url":"https://github.com/tmlr-group/CoPA/blob/HEAD/models/pa.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"bfdceee8e94ba8ee"}},{"code_sha256_prefix":"7bc0c018da29b173","entry":"compute_most_sim_prototype","repo":"tmlr-group/CoPA","repo_kind":"listed","path":"models/pa.py","file_url":"https://github.com/tmlr-group/CoPA/blob/HEAD/models/pa.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"7bc0c018da29b173"}},{"code_sha256_prefix":"8c6dd9a5516475ee","entry":"compute_sum_prototype","repo":"tmlr-group/CoPA","repo_kind":"listed","path":"models/pa.py","file_url":"https://github.com/tmlr-group/CoPA/blob/HEAD/models/pa.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"8c6dd9a5516475ee"}},{"code_sha256_prefix":"ab00127e0e9d1905","entry":"cross_entropy_loss","repo":"tmlr-group/CoPA","repo_kind":"listed","path":"models/pa.py","file_url":"https://github.com/tmlr-group/CoPA/blob/HEAD/models/pa.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"ab00127e0e9d1905"}},{"code_sha256_prefix":"b1de118bad80d84f","entry":"kernel_CKA","repo":"tmlr-group/CoPA","repo_kind":"listed","path":"models/pa.py","file_url":"https://github.com/tmlr-group/CoPA/blob/HEAD/models/pa.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"b1de118bad80d84f"}},{"code_sha256_prefix":"c1fa4a28c0967388","entry":"kernel_HSIC","repo":"tmlr-group/CoPA","repo_kind":"listed","path":"models/pa.py","file_url":"https://github.com/tmlr-group/CoPA/blob/HEAD/models/pa.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"c1fa4a28c0967388"}},{"code_sha256_prefix":"8f26f9f0da493c06","entry":"pa","repo":"VICO-UoE/URL","repo_kind":"official","path":"models/tsa.py","file_url":"https://github.com/VICO-UoE/URL/blob/HEAD/models/tsa.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"8f26f9f0da493c06"}},{"code_sha256_prefix":"3e380e81bdaa50cd","entry":"prototype_loss","repo":"tmlr-group/CoPA","repo_kind":"listed","path":"models/pa.py","file_url":"https://github.com/tmlr-group/CoPA/blob/HEAD/models/pa.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"3e380e81bdaa50cd"}},{"code_sha256_prefix":"ad1380889172ec1f","entry":"rbf","repo":"tmlr-group/CoPA","repo_kind":"listed","path":"models/pa.py","file_url":"https://github.com/tmlr-group/CoPA/blob/HEAD/models/pa.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"ad1380889172ec1f"}},{"code_sha256_prefix":"ffad41c1ddd8d6c1","entry":"ResNet","repo":"vico-uoe/universalrepresentations","repo_kind":"listed","path":"VisualDecathlon/models.py","file_url":"https://github.com/vico-uoe/universalrepresentations/blob/HEAD/VisualDecathlon/models.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"ffad41c1ddd8d6c1"}},{"code_sha256_prefix":"68e3d9ea3b5a4b42","entry":"cal_dist","repo":"tmlr-group/mokd","repo_kind":"listed","path":"models/losses.py","file_url":"https://github.com/tmlr-group/mokd/blob/HEAD/models/losses.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"68e3d9ea3b5a4b42"}},{"code_sha256_prefix":"1700ff73ab4e452a","entry":"cal_dist_cosine","repo":"tmlr-group/mokd","repo_kind":"listed","path":"models/losses.py","file_url":"https://github.com/tmlr-group/mokd/blob/HEAD/models/losses.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"1700ff73ab4e452a"}},{"code_sha256_prefix":"fad178676f5c5101","entry":"compute_prototypes","repo":"tmlr-group/mokd","repo_kind":"listed","path":"hsic_loss.py","file_url":"https://github.com/tmlr-group/mokd/blob/HEAD/hsic_loss.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"fad178676f5c5101"}},{"code_sha256_prefix":"28cc87a06ba68afb","entry":"cosine_sim","repo":"tmlr-group/mokd","repo_kind":"listed","path":"models/model_utils.py","file_url":"https://github.com/tmlr-group/mokd/blob/HEAD/models/model_utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"28cc87a06ba68afb"}},{"code_sha256_prefix":"94d7d1aa90bc2d6f","entry":"get_optimizer","repo":"tmlr-group/mokd","repo_kind":"listed","path":"models/model_helpers.py","file_url":"https://github.com/tmlr-group/mokd/blob/HEAD/models/model_helpers.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"94d7d1aa90bc2d6f"}},{"code_sha256_prefix":"d2e93fa24f8623c1","entry":"imq","repo":"tmlr-group/mokd","repo_kind":"listed","path":"models/hsic_estimation.py","file_url":"https://github.com/tmlr-group/mokd/blob/HEAD/models/hsic_estimation.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"d2e93fa24f8623c1"}},{"code_sha256_prefix":"42107d08a8a749ec","entry":"labels_to_episode_labels","repo":"tmlr-group/mokd","repo_kind":"listed","path":"models/model_utils.py","file_url":"https://github.com/tmlr-group/mokd/blob/HEAD/models/model_utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"42107d08a8a749ec"}},{"code_sha256_prefix":"dd2fbf6ed2260eae","entry":"linear","repo":"tmlr-group/mokd","repo_kind":"listed","path":"models/hsic_estimation.py","file_url":"https://github.com/tmlr-group/mokd/blob/HEAD/models/hsic_estimation.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"dd2fbf6ed2260eae"}},{"code_sha256_prefix":"78c17a9df7b56d4d","entry":"linear_HSIC","repo":"tmlr-group/mokd","repo_kind":"listed","path":"models/cka.py","file_url":"https://github.com/tmlr-group/mokd/blob/HEAD/models/cka.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"78c17a9df7b56d4d"}},{"code_sha256_prefix":"3990fde51995b22c","entry":"pa","repo":"tmlr-group/CoPA","repo_kind":"listed","path":"models/pa.py","file_url":"https://github.com/tmlr-group/CoPA/blob/HEAD/models/pa.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"3990fde51995b22c"}},{"code_sha256_prefix":"549d8369236aee08","entry":"pred_with_protos","repo":"tmlr-group/mokd","repo_kind":"listed","path":"hsic_loss.py","file_url":"https://github.com/tmlr-group/mokd/blob/HEAD/hsic_loss.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"549d8369236aee08"}},{"code_sha256_prefix":"1dddaffd3ae4142f","entry":"rbf","repo":"tmlr-group/mokd","repo_kind":"listed","path":"models/cka.py","file_url":"https://github.com/tmlr-group/mokd/blob/HEAD/models/cka.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"1dddaffd3ae4142f"}},{"code_sha256_prefix":"29877c45faa57d6f","entry":"rbf","repo":"tmlr-group/mokd","repo_kind":"listed","path":"models/hsic_estimation.py","file_url":"https://github.com/tmlr-group/mokd/blob/HEAD/models/hsic_estimation.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"29877c45faa57d6f"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}