{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/self-supervised-learning-through-the-eyes-of","title":"Self-supervised learning through the eyes of a child","arxiv_id":"2007.16189","date":"2020-07-31","proceeding":"NeurIPS 2020 12","authors":["A. Emin Orhan","Vaibhav V. Gupta","Brenden M. Lake"],"abstract":"Within months of birth, children develop meaningful expectations about the world around them. How much of this early knowledge can be explained through generic learning mechanisms applied to sensory data, and how much of it requires more substantive innate inductive biases? Addressing this fundamental question in its full generality is currently infeasible, but we can hope to make real progress in more narrowly defined domains, such as the development of high-level visual categories, thanks to improvements in data collecting technology and recent progress in deep learning. In this paper, our goal is precisely to achieve such progress by utilizing modern self-supervised deep learning methods and a recent longitudinal, egocentric video dataset recorded from the perspective of three young children (Sullivan et al., 2020). Our results demonstrate the emergence of powerful, high-level visual representations from developmentally realistic natural videos using generic self-supervised learning objectives.","url_abs":"https://arxiv.org/abs/2007.16189v3","url_pdf":"https://arxiv.org/pdf/2007.16189v3.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"self-supervised-learning-through-the-eyes-of","repo_url":"https://github.com/eminorhan/baby-vision","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":null},{"paper_slug":"self-supervised-learning-through-the-eyes-of","repo_url":"https://github.com/agentic-learning-ai-lab/memory-storyboard","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[{"task_slug":"deep-learning","task_name":"Deep Learning"},{"task_slug":"self-supervised-learning","task_name":"Self-Supervised Learning"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2007.16189","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2007.16189"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/eminorhan/baby-vision","reach":null},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/agentic-learning-ai-lab/memory-storyboard","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"ran_fixture":1,"unverified":10},"by_repo_kind":{"official":{"samples":1,"ran":0,"repositories":1},"listed":{"samples":9,"ran":1,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":1,"samples":[{"code_sha256_prefix":"3e30d88eaef01190","entry":"off_diagonal","repo":"agentic-learning-ai-lab/memory-storyboard","repo_kind":"listed","path":"osiris_model.py","file_url":"https://github.com/agentic-learning-ai-lab/memory-storyboard/blob/HEAD/osiris_model.py","link_basis":"harvester_set","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"3e30d88eaef01190"}},{"code_sha256_prefix":"9b8289076669fe4f","entry":"accuracy","repo":null,"repo_kind":null,"path":null,"file_url":null,"link_basis":"identical_code_first_harvested_elsewhere","language":"python","status":"unverified","verification_level":0,"contract_check":"RAISES","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":null,"inline_ok":false,"mcp_get_code":{"code_sha256":"9b8289076669fe4f"}},{"code_sha256_prefix":"7d7aaaa31a292818","entry":"build_norm_layer","repo":"agentic-learning-ai-lab/memory-storyboard","repo_kind":"listed","path":"resnet.py","file_url":"https://github.com/agentic-learning-ai-lab/memory-storyboard/blob/HEAD/resnet.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"7d7aaaa31a292818"}},{"code_sha256_prefix":"3313ad502a167458","entry":"count_seen_classes","repo":"agentic-learning-ai-lab/memory-storyboard","repo_kind":"listed","path":"dataset_utils.py","file_url":"https://github.com/agentic-learning-ai-lab/memory-storyboard/blob/HEAD/dataset_utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"3313ad502a167458"}},{"code_sha256_prefix":"0a7e98cab5aea2a7","entry":"get_all_fns","repo":"agentic-learning-ai-lab/memory-storyboard","repo_kind":"listed","path":"dataset_utils.py","file_url":"https://github.com/agentic-learning-ai-lab/memory-storyboard/blob/HEAD/dataset_utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"0a7e98cab5aea2a7"}},{"code_sha256_prefix":"1c2b9fdf428c7961","entry":"get_knn_perf","repo":"agentic-learning-ai-lab/memory-storyboard","repo_kind":"listed","path":"evaluate.py","file_url":"https://github.com/agentic-learning-ai-lab/memory-storyboard/blob/HEAD/evaluate.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"1c2b9fdf428c7961"}},{"code_sha256_prefix":"15218baa9671626b","entry":"get_svm_perf","repo":"agentic-learning-ai-lab/memory-storyboard","repo_kind":"listed","path":"evaluate.py","file_url":"https://github.com/agentic-learning-ai-lab/memory-storyboard/blob/HEAD/evaluate.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"15218baa9671626b"}},{"code_sha256_prefix":"1f53b17b0b8cce8d","entry":"load_split_train_test","repo":"agentic-learning-ai-lab/memory-storyboard","repo_kind":"listed","path":"linear_decoding.py","file_url":"https://github.com/agentic-learning-ai-lab/memory-storyboard/blob/HEAD/linear_decoding.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"1f53b17b0b8cce8d"}},{"code_sha256_prefix":"6e21bb915de7277a","entry":"make_res_layer","repo":"agentic-learning-ai-lab/memory-storyboard","repo_kind":"listed","path":"resnet.py","file_url":"https://github.com/agentic-learning-ai-lab/memory-storyboard/blob/HEAD/resnet.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"6e21bb915de7277a"}},{"code_sha256_prefix":"68e213dd1bd7c775","entry":"train","repo":"eminorhan/baby-vision","repo_kind":"official","path":"temporal_classification.py","file_url":"https://github.com/eminorhan/baby-vision/blob/HEAD/temporal_classification.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"68e213dd1bd7c775"}},{"code_sha256_prefix":"9e8c24c5b951741f","entry":"train","repo":"agentic-learning-ai-lab/memory-storyboard","repo_kind":"listed","path":"linear_decoding.py","file_url":"https://github.com/agentic-learning-ai-lab/memory-storyboard/blob/HEAD/linear_decoding.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"9e8c24c5b951741f"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}