{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/on-the-role-of-neural-collapse-in-meta","title":"On the Role of Neural Collapse in Meta Learning Models for Few-shot Learning","arxiv_id":"2310.00451","date":"2023-09-30","proceeding":null,"authors":["Saaketh Medepalli","Naren Doraiswamy"],"abstract":"Meta-learning frameworks for few-shot learning aims to learn models that can learn new skills or adapt to new environments rapidly with a few training examples. This has led to the generalizability of the developed model towards new classes with just a few labelled samples. However these networks are seen as black-box models and understanding the representations learnt under different learning scenarios is crucial. Neural collapse ($\\mathcal{NC}$) is a recently discovered phenomenon which showcases unique properties at the network proceeds towards zero loss. The input features collapse to their respective class means, the class means form a Simplex equiangular tight frame (ETF) where the class means are maximally distant and linearly separable, and the classifier acts as a simple nearest neighbor classifier. While these phenomena have been observed in simple classification networks, this study is the first to explore and understand the properties of neural collapse in meta learning frameworks for few-shot learning. We perform studies on the Omniglot dataset in the few-shot setting and study the neural collapse phenomenon. We observe that the learnt features indeed have the trend of neural collapse, especially as model size grows, but to do not necessarily showcase the complete collapse as measured by the $\\mathcal{NC}$ properties.","url_abs":"https://arxiv.org/abs/2310.00451v2","url_pdf":"https://arxiv.org/pdf/2310.00451v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"on-the-role-of-neural-collapse-in-meta","repo_url":"https://github.com/saakethmm/nc-prototypical-networks","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[{"task_slug":"few-shot-learning","task_name":"Few-Shot Learning"},{"task_slug":"meta-learning","task_name":"Meta-Learning"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/2310.00451","atlas_url":"https://app.syntology.ai/?focus=2310.00451","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2310.00451"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-25T09:33:49+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/saakethmm/nc-prototypical-networks","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"ran":8,"ran_draft_wrong":1,"unverified":1},"by_repo_kind":{"official":{"samples":10,"ran":9,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"059fa545366b5fa9","entry":"compute_nc1","repo":"saakethmm/nc-prototypical-networks","repo_kind":"official","path":"protonets/utils/validate_nc.py","file_url":"https://github.com/saakethmm/nc-prototypical-networks/blob/HEAD/protonets/utils/validate_nc.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"059fa545366b5fa9"}},{"code_sha256_prefix":"e2dc4f756030e978","entry":"compute_sigma_b","repo":"saakethmm/nc-prototypical-networks","repo_kind":"official","path":"protonets/utils/validate_nc.py","file_url":"https://github.com/saakethmm/nc-prototypical-networks/blob/HEAD/protonets/utils/validate_nc.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"e2dc4f756030e978"}},{"code_sha256_prefix":"f5a6d13ffcf83043","entry":"compute_sigma_w","repo":"saakethmm/nc-prototypical-networks","repo_kind":"official","path":"protonets/utils/validate_nc.py","file_url":"https://github.com/saakethmm/nc-prototypical-networks/blob/HEAD/protonets/utils/validate_nc.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"f5a6d13ffcf83043"}},{"code_sha256_prefix":"4601716ebff8a67b","entry":"convert_array","repo":"saakethmm/nc-prototypical-networks","repo_kind":"official","path":"protonets/utils/log.py","file_url":"https://github.com/saakethmm/nc-prototypical-networks/blob/HEAD/protonets/utils/log.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"4601716ebff8a67b"}},{"code_sha256_prefix":"4dd319c45d372246","entry":"euclidean_dist","repo":"saakethmm/nc-prototypical-networks","repo_kind":"official","path":"protonets/models/utils.py","file_url":"https://github.com/saakethmm/nc-prototypical-networks/blob/HEAD/protonets/models/utils.py","link_basis":"harvester_set","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"4dd319c45d372246"}},{"code_sha256_prefix":"6737d2c557fcf23d","entry":"evaluate","repo":"saakethmm/nc-prototypical-networks","repo_kind":"official","path":"protonets/utils/model.py","file_url":"https://github.com/saakethmm/nc-prototypical-networks/blob/HEAD/protonets/utils/model.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"6737d2c557fcf23d"}},{"code_sha256_prefix":"edcb0cddd78cf783","entry":"extract_meter_values","repo":"saakethmm/nc-prototypical-networks","repo_kind":"official","path":"protonets/utils/log.py","file_url":"https://github.com/saakethmm/nc-prototypical-networks/blob/HEAD/protonets/utils/log.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"edcb0cddd78cf783"}},{"code_sha256_prefix":"896ba48590068c68","entry":"register_model","repo":"saakethmm/nc-prototypical-networks","repo_kind":"official","path":"protonets/models/factory.py","file_url":"https://github.com/saakethmm/nc-prototypical-networks/blob/HEAD/protonets/models/factory.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"896ba48590068c68"}},{"code_sha256_prefix":"c0d75b572348ad84","entry":"render_meter_values","repo":"saakethmm/nc-prototypical-networks","repo_kind":"official","path":"protonets/utils/log.py","file_url":"https://github.com/saakethmm/nc-prototypical-networks/blob/HEAD/protonets/utils/log.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"c0d75b572348ad84"}},{"code_sha256_prefix":"ab239f4a02eaeab3","entry":"get_model","repo":"saakethmm/nc-prototypical-networks","repo_kind":"official","path":"protonets/models/factory.py","file_url":"https://github.com/saakethmm/nc-prototypical-networks/blob/HEAD/protonets/models/factory.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"ab239f4a02eaeab3"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}