{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/a-computational-framework-for-modeling-1","title":"A Computational Framework for Modeling Emergence of Color Vision in the Human Brain","arxiv_id":"2408.16916","date":"2024-08-29","proceeding":null,"authors":["Atsunobu Kotani","Ren Ng"],"abstract":"It is a mystery how the brain decodes color vision purely from the optic nerve signals it receives, with a core inferential challenge being how it disentangles internal perception with the correct color dimensionality from the unknown encoding properties of the eye. In this paper, we introduce a computational framework for modeling this emergence of human color vision by simulating both the eye and the cortex. Existing research often overlooks how the cortex develops color vision or represents color space internally, assuming that the color dimensionality is known a priori; however, we argue that the visual cortex has the capability and the challenge of inferring the color dimensionality purely from fluctuations in the optic nerve signals. To validate our theory, we introduce a simulation engine for biological eyes based on established vision science and generate optic nerve signals resulting from looking at natural images. Further, we propose a bio-plausible model of cortical learning based on self-supervised prediction of optic nerve signal fluctuations under natural eye motions. We show that this model naturally learns to generate color vision by disentangling retinal invariants from the sensory signals. When the retina contains N types of color photoreceptors, our simulation shows that N-dimensional color vision naturally emerges, verified through formal colorimetry. Using this framework, we also present the first simulation work that successfully boosts the color dimensionality, as observed in gene therapy on squirrel monkeys, and demonstrates the possibility of enhancing human color vision from 3D to 4D.","url_abs":"https://arxiv.org/abs/2408.16916v2","url_pdf":"https://arxiv.org/pdf/2408.16916v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"a-computational-framework-for-modeling-1","repo_url":"https://github.com/atsu-kotani/Matisse","is_official":1,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":null}],"tasks":[],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2408.16916","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2408.16916"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/atsu-kotani/Matisse","reach":null}],"summary":{"ran":2,"unverified":6},"by_repo_kind":{"official":{"samples":8,"ran":2,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":8,"samples":[{"code_sha256_prefix":"4d7bb019e74faf3d","entry":"NS_cone_mosaic","repo":"atsu-kotani/Matisse","repo_kind":"official","path":"Simulated/Cortex/CortexModel.py","file_url":"https://github.com/atsu-kotani/Matisse/blob/HEAD/Simulated/Cortex/CortexModel.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"4d7bb019e74faf3d"}},{"code_sha256_prefix":"3ebf3fffc5fe7c95","entry":"NS_internal_percept","repo":"atsu-kotani/Matisse","repo_kind":"official","path":"Simulated/Cortex/CortexModel.py","file_url":"https://github.com/atsu-kotani/Matisse/blob/HEAD/Simulated/Cortex/CortexModel.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"3ebf3fffc5fe7c95"}},{"code_sha256_prefix":"c31cdaaf62109ce1","entry":"CortexModel","repo":"atsu-kotani/Matisse","repo_kind":"official","path":"Simulated/Cortex/CortexModel.py","file_url":"https://github.com/atsu-kotani/Matisse/blob/HEAD/Simulated/Cortex/CortexModel.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"c31cdaaf62109ce1"}},{"code_sha256_prefix":"586dbbcca442ae49","entry":"create_C_cone_spectral_type","repo":"atsu-kotani/Matisse","repo_kind":"official","path":"Simulated/Cortex/CortexModel.py","file_url":"https://github.com/atsu-kotani/Matisse/blob/HEAD/Simulated/Cortex/CortexModel.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"586dbbcca442ae49"}},{"code_sha256_prefix":"bfa673595d259b25","entry":"create_D_demosaicing","repo":"atsu-kotani/Matisse","repo_kind":"official","path":"Simulated/Cortex/CortexModel.py","file_url":"https://github.com/atsu-kotani/Matisse/blob/HEAD/Simulated/Cortex/CortexModel.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"bfa673595d259b25"}},{"code_sha256_prefix":"9e5a107994ac7c23","entry":"create_M_global_movement","repo":"atsu-kotani/Matisse","repo_kind":"official","path":"Simulated/Cortex/CortexModel.py","file_url":"https://github.com/atsu-kotani/Matisse/blob/HEAD/Simulated/Cortex/CortexModel.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"9e5a107994ac7c23"}},{"code_sha256_prefix":"da1cf8dbb1c0b126","entry":"create_P_cell_position","repo":"atsu-kotani/Matisse","repo_kind":"official","path":"Simulated/Cortex/CortexModel.py","file_url":"https://github.com/atsu-kotani/Matisse/blob/HEAD/Simulated/Cortex/CortexModel.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"da1cf8dbb1c0b126"}},{"code_sha256_prefix":"e5ece1588b71c345","entry":"create_W_lateral_inhibition_weights","repo":"atsu-kotani/Matisse","repo_kind":"official","path":"Simulated/Cortex/CortexModel.py","file_url":"https://github.com/atsu-kotani/Matisse/blob/HEAD/Simulated/Cortex/CortexModel.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"e5ece1588b71c345"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}