{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/a-spectral-theory-of-neural-prediction-and","title":"A Spectral Theory of Neural Prediction and Alignment","arxiv_id":"2309.12821","date":"2023-09-22","proceeding":"NeurIPS 2023 11","authors":["Abdulkadir Canatar","Jenelle Feather","Albert Wakhloo","SueYeon Chung"],"abstract":"The representations of neural networks are often compared to those of biological systems by performing regression between the neural network responses and those measured from biological systems. Many different state-of-the-art deep neural networks yield similar neural predictions, but it remains unclear how to differentiate among models that perform equally well at predicting neural responses. To gain insight into this, we use a recent theoretical framework that relates the generalization error from regression to the spectral properties of the model and the target. We apply this theory to the case of regression between model activations and neural responses and decompose the neural prediction error in terms of the model eigenspectra, alignment of model eigenvectors and neural responses, and the training set size. Using this decomposition, we introduce geometrical measures to interpret the neural prediction error. We test a large number of deep neural networks that predict visual cortical activity and show that there are multiple types of geometries that result in low neural prediction error as measured via regression. The work demonstrates that carefully decomposing representational metrics can provide interpretability of how models are capturing neural activity and points the way towards improved models of neural activity.","url_abs":"https://arxiv.org/abs/2309.12821v2","url_pdf":"https://arxiv.org/pdf/2309.12821v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"a-spectral-theory-of-neural-prediction-and","repo_url":"https://github.com/chung-neuroai-lab/snap","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"jax","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[{"task_slug":"prediction","task_name":"Prediction"},{"task_slug":"regression-1","task_name":"regression"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/2309.12821","atlas_url":"https://app.syntology.ai/?focus=2309.12821","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2309.12821"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-25T09:33:49+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"deterministic:regex_extraction","url":"https://github.com/facebookresearch/vissl","reach":null},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/chung-neuroai-lab/snap","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"ran":9,"ran_draft_wrong":2,"unverified":12},"by_repo_kind":{"official":{"samples":23,"ran":11,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"0f53bb05dcc3ac89","entry":"RandProj","repo":"chung-neuroai-lab/snap","repo_kind":"official","path":"snap/experiment.py","file_url":"https://github.com/chung-neuroai-lab/snap/blob/HEAD/snap/experiment.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"0f53bb05dcc3ac89"}},{"code_sha256_prefix":"f45875100b267e93","entry":"compute_spectrum","repo":"chung-neuroai-lab/snap","repo_kind":"official","path":"snap/metrics.py","file_url":"https://github.com/chung-neuroai-lab/snap/blob/HEAD/snap/metrics.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"f45875100b267e93"}},{"code_sha256_prefix":"2a80220dabcb742a","entry":"conv1x1","repo":"chung-neuroai-lab/snap","repo_kind":"official","path":"snap/simclr/resnet.py","file_url":"https://github.com/chung-neuroai-lab/snap/blob/HEAD/snap/simclr/resnet.py","link_basis":"harvester_set","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"2a80220dabcb742a"}},{"code_sha256_prefix":"600ff2c45e0de056","entry":"conv3x3","repo":"chung-neuroai-lab/snap","repo_kind":"official","path":"snap/simclr/resnet.py","file_url":"https://github.com/chung-neuroai-lab/snap/blob/HEAD/snap/simclr/resnet.py","link_basis":"harvester_set","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"600ff2c45e0de056"}},{"code_sha256_prefix":"56a83123fdf3d256","entry":"cum_power","repo":"chung-neuroai-lab/snap","repo_kind":"official","path":"snap/metrics.py","file_url":"https://github.com/chung-neuroai-lab/snap/blob/HEAD/snap/metrics.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"56a83123fdf3d256"}},{"code_sha256_prefix":"5f0d54cb00af6cd5","entry":"cum_powers","repo":"chung-neuroai-lab/snap","repo_kind":"official","path":"snap/metrics.py","file_url":"https://github.com/chung-neuroai-lab/snap/blob/HEAD/snap/metrics.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"5f0d54cb00af6cd5"}},{"code_sha256_prefix":"69f71980d14d9de9","entry":"eff_dimension","repo":"chung-neuroai-lab/snap","repo_kind":"official","path":"snap/data_utils.py","file_url":"https://github.com/chung-neuroai-lab/snap/blob/HEAD/snap/data_utils.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"69f71980d14d9de9"}},{"code_sha256_prefix":"c20bc9cdcba0af77","entry":"get_layer","repo":"chung-neuroai-lab/snap","repo_kind":"official","path":"snap/wrapper.py","file_url":"https://github.com/chung-neuroai-lab/snap/blob/HEAD/snap/wrapper.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"c20bc9cdcba0af77"}},{"code_sha256_prefix":"ebc2d642cae20518","entry":"get_ordered_data","repo":"chung-neuroai-lab/snap","repo_kind":"official","path":"snap/brainscore_data.py","file_url":"https://github.com/chung-neuroai-lab/snap/blob/HEAD/snap/brainscore_data.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"ebc2d642cae20518"}},{"code_sha256_prefix":"b0d00a3fa442b471","entry":"hook_activation","repo":"chung-neuroai-lab/snap","repo_kind":"official","path":"snap/wrapper.py","file_url":"https://github.com/chung-neuroai-lab/snap/blob/HEAD/snap/wrapper.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"b0d00a3fa442b471"}},{"code_sha256_prefix":"649878832bb1a252","entry":"register_hooks","repo":"chung-neuroai-lab/snap","repo_kind":"official","path":"snap/wrapper.py","file_url":"https://github.com/chung-neuroai-lab/snap/blob/HEAD/snap/wrapper.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"649878832bb1a252"}},{"code_sha256_prefix":"e652e23866d73a36","entry":"create_dataframe","repo":"chung-neuroai-lab/snap","repo_kind":"official","path":"snap/data_utils.py","file_url":"https://github.com/chung-neuroai-lab/snap/blob/HEAD/snap/data_utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"e652e23866d73a36"}},{"code_sha256_prefix":"0aa12a82a511f48c","entry":"delta_fn","repo":"chung-neuroai-lab/snap","repo_kind":"official","path":"snap/regression_utils.py","file_url":"https://github.com/chung-neuroai-lab/snap/blob/HEAD/snap/regression_utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"0aa12a82a511f48c"}},{"code_sha256_prefix":"ac5a8731ed281eb1","entry":"denom_fn","repo":"chung-neuroai-lab/snap","repo_kind":"official","path":"snap/regression_utils.py","file_url":"https://github.com/chung-neuroai-lab/snap/blob/HEAD/snap/regression_utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"ac5a8731ed281eb1"}},{"code_sha256_prefix":"d3e40c689beaa139","entry":"gamma_fn","repo":"chung-neuroai-lab/snap","repo_kind":"official","path":"snap/regression_utils.py","file_url":"https://github.com/chung-neuroai-lab/snap/blob/HEAD/snap/regression_utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"d3e40c689beaa139"}},{"code_sha256_prefix":"c2068b98116a48e2","entry":"gather_data","repo":"chung-neuroai-lab/snap","repo_kind":"official","path":"snap/data_utils.py","file_url":"https://github.com/chung-neuroai-lab/snap/blob/HEAD/snap/data_utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"c2068b98116a48e2"}},{"code_sha256_prefix":"13d33f35a9dbbb42","entry":"get_cornet","repo":"chung-neuroai-lab/snap","repo_kind":"official","path":"snap/models.py","file_url":"https://github.com/chung-neuroai-lab/snap/blob/HEAD/snap/models.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"13d33f35a9dbbb42"}},{"code_sha256_prefix":"5a712347e9252f8a","entry":"get_dataloader","repo":"chung-neuroai-lab/snap","repo_kind":"official","path":"snap/brainscore_data.py","file_url":"https://github.com/chung-neuroai-lab/snap/blob/HEAD/snap/brainscore_data.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"5a712347e9252f8a"}},{"code_sha256_prefix":"0e12ee504ac7da14","entry":"get_model","repo":"chung-neuroai-lab/snap","repo_kind":"official","path":"snap/models.py","file_url":"https://github.com/chung-neuroai-lab/snap/blob/HEAD/snap/models.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"0e12ee504ac7da14"}},{"code_sha256_prefix":"2a1807fbaf2ca5f8","entry":"get_neural_data","repo":"chung-neuroai-lab/snap","repo_kind":"official","path":"snap/brainscore_data.py","file_url":"https://github.com/chung-neuroai-lab/snap/blob/HEAD/snap/brainscore_data.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"2a1807fbaf2ca5f8"}},{"code_sha256_prefix":"5f098124b498099d","entry":"get_processed_data_figs","repo":"chung-neuroai-lab/snap","repo_kind":"official","path":"snap/figure_utils.py","file_url":"https://github.com/chung-neuroai-lab/snap/blob/HEAD/snap/figure_utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"5f098124b498099d"}},{"code_sha256_prefix":"21a3d11e2b746e08","entry":"get_vonenet","repo":"chung-neuroai-lab/snap","repo_kind":"official","path":"snap/models.py","file_url":"https://github.com/chung-neuroai-lab/snap/blob/HEAD/snap/models.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"21a3d11e2b746e08"}},{"code_sha256_prefix":"789b3423123e6dcb","entry":"plot_region_contours","repo":"chung-neuroai-lab/snap","repo_kind":"official","path":"snap/figure_utils.py","file_url":"https://github.com/chung-neuroai-lab/snap/blob/HEAD/snap/figure_utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"789b3423123e6dcb"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}