{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/cross-domain-few-shot-learning-by-1","title":"Cross-Domain Few-Shot Learning by Representation Fusion","arxiv_id":"2010.06498","date":"2020-10-13","proceeding":null,"authors":["Thomas Adler","Johannes Brandstetter","Michael Widrich","Andreas Mayr","David Kreil","Michael Kopp","Günter Klambauer","Sepp Hochreiter"],"abstract":"In order to quickly adapt to new data, few-shot learning aims at learning from few examples, often by using already acquired knowledge. The new data often differs from the previously seen data due to a domain shift, that is, a change of the input-target distribution. While several methods perform well on small domain shifts like new target classes with similar inputs, larger domain shifts are still challenging. Large domain shifts may result in high-level concepts that are not shared between the original and the new domain, whereas low-level concepts like edges in images might still be shared and useful. For cross-domain few-shot learning, we suggest representation fusion to unify different abstraction levels of a deep neural network into one representation. We propose Cross-domain Hebbian Ensemble Few-shot learning (CHEF), which achieves representation fusion by an ensemble of Hebbian learners acting on different layers of a deep neural network. Ablation studies show that representation fusion is a decisive factor to boost cross-domain few-shot learning. On the few-shot datasets miniImagenet and tieredImagenet with small domain shifts, CHEF is competitive with state-of-the-art methods. On cross-domain few-shot benchmark challenges with larger domain shifts, CHEF establishes novel state-of-the-art results in all categories. We further apply CHEF on a real-world cross-domain application in drug discovery. We consider a domain shift from bioactive molecules to environmental chemicals and drugs with twelve associated toxicity prediction tasks. On these tasks, that are highly relevant for computational drug discovery, CHEF significantly outperforms all its competitors. Github: https://github.com/ml-jku/chef","url_abs":"https://arxiv.org/abs/2010.06498v2","url_pdf":"https://arxiv.org/pdf/2010.06498v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"cross-domain-few-shot-learning-by-1","repo_url":"https://github.com/ml-jku/chef","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}},{"paper_slug":"cross-domain-few-shot-learning-by-1","repo_url":"https://github.com/tomte812/chef","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[{"task_slug":"cross-domain-few-shot","task_name":"Cross-Domain Few-Shot"},{"task_slug":"drug-discovery","task_name":"Drug Discovery"},{"task_slug":"few-shot-learning","task_name":"Few-Shot Learning"},{"task_slug":"cross-domain-few-shot-learning","task_name":"cross-domain few-shot learning"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2010.06498","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2010.06498"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/ml-jku/chef","reach":{"status":"ok","spdx":"MIT"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/tomte812/chef","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"ran_honours":1,"unverified":7},"by_repo_kind":{"official":{"samples":8,"ran":1,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"82bdff06f37e069f","entry":"create_nshot_task_label","repo":"ml-jku/chef","repo_kind":"official","path":"core.py","file_url":"https://github.com/ml-jku/chef/blob/HEAD/core.py","link_basis":"plan_row","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":"well_formed","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"82bdff06f37e069f"}},{"code_sha256_prefix":"dbd513fa100f72a6","entry":"ResNet10","repo":"ml-jku/chef","repo_kind":"official","path":"res10.py","file_url":"https://github.com/ml-jku/chef/blob/HEAD/res10.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"dbd513fa100f72a6"}},{"code_sha256_prefix":"09f95116ebb31294","entry":"categorical_accuracy","repo":"ml-jku/chef","repo_kind":"official","path":"metrics.py","file_url":"https://github.com/ml-jku/chef/blob/HEAD/metrics.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"09f95116ebb31294"}},{"code_sha256_prefix":"21ffa3647b971a8f","entry":"conv_block","repo":"ml-jku/chef","repo_kind":"official","path":"models.py","file_url":"https://github.com/ml-jku/chef/blob/HEAD/models.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"21ffa3647b971a8f"}},{"code_sha256_prefix":"76cf965e212fe98f","entry":"functional_conv_block","repo":"ml-jku/chef","repo_kind":"official","path":"models.py","file_url":"https://github.com/ml-jku/chef/blob/HEAD/models.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"76cf965e212fe98f"}},{"code_sha256_prefix":"4aee59839cbc4c7b","entry":"get_few_shot_encoder","repo":"ml-jku/chef","repo_kind":"official","path":"models.py","file_url":"https://github.com/ml-jku/chef/blob/HEAD/models.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"4aee59839cbc4c7b"}},{"code_sha256_prefix":"c362b97acf759ae3","entry":"least_dist","repo":"ml-jku/chef","repo_kind":"official","path":"hebb.py","file_url":"https://github.com/ml-jku/chef/blob/HEAD/hebb.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"c362b97acf759ae3"}},{"code_sha256_prefix":"e4a8df3b5e21888f","entry":"prepare_nshot_task","repo":"ml-jku/chef","repo_kind":"official","path":"core.py","file_url":"https://github.com/ml-jku/chef/blob/HEAD/core.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"e4a8df3b5e21888f"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}