{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/the-algonauts-project-2021-challenge-how-the","title":"The Algonauts Project 2021 Challenge: How the Human Brain Makes Sense of a World in Motion","arxiv_id":"2104.13714","date":"2021-04-28","proceeding":null,"authors":["R. M. Cichy","K. Dwivedi","B. Lahner","A. Lascelles","P. Iamshchinina","M. Graumann","A. Andonian","N. A. R. Murty","K. Kay","G. Roig","A. Oliva"],"abstract":"The sciences of natural and artificial intelligence are fundamentally connected. Brain-inspired human-engineered AI are now the standard for predicting human brain responses during vision, and conversely, the brain continues to inspire invention in AI. To promote even deeper connections between these fields, we here release the 2021 edition of the Algonauts Project Challenge: How the Human Brain Makes Sense of a World in Motion (http://algonauts.csail.mit.edu/). We provide whole-brain fMRI responses recorded while 10 human participants viewed a rich set of over 1,000 short video clips depicting everyday events. The goal of the challenge is to accurately predict brain responses to these video clips. The format of our challenge ensures rapid development, makes results directly comparable and transparent, and is open to all. In this way it facilitates interdisciplinary collaboration towards a common goal of understanding visual intelligence. The 2021 Algonauts Project is conducted in collaboration with the Cognitive Computational Neuroscience (CCN) conference.","url_abs":"https://arxiv.org/abs/2104.13714v1","url_pdf":"https://arxiv.org/pdf/2104.13714v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"the-algonauts-project-2021-challenge-how-the","repo_url":"https://github.com/Neural-Dynamics-of-Visual-Cognition-FUB/Algonauts2021_devkit","is_official":1,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"pytorch","reach":null}],"tasks":[{"task_slug":"human-fmri-response-prediction","task_name":"Human fMRI response prediction"}],"methods":[],"datasets_introduced":[{"slug":"algonauts-2021","name":"Algonauts 2021","full_name":"How the Human Brain Makes Sense of a World in Motion"}],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2104.13714","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2104.13714"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/Neural-Dynamics-of-Visual-Cognition-FUB/Algonauts2021_devkit","reach":null}],"summary":{"ran_draft_wrong":1,"unverified":1},"by_repo_kind":{"official":{"samples":2,"ran":1,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":2,"samples":[{"code_sha256_prefix":"f424591c2a63eb9f","entry":"get_activations","repo":"Neural-Dynamics-of-Visual-Cognition-FUB/Algonauts2021_devkit","repo_kind":"official","path":"perform_encoding.py","file_url":"https://github.com/Neural-Dynamics-of-Visual-Cognition-FUB/Algonauts2021_devkit/blob/HEAD/perform_encoding.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"f424591c2a63eb9f"}},{"code_sha256_prefix":"0f97c7bb3ef6ae3c","entry":"load_alexnet","repo":"Neural-Dynamics-of-Visual-Cognition-FUB/Algonauts2021_devkit","repo_kind":"official","path":"feature_extraction/generate_features_alexnet.py","file_url":"https://github.com/Neural-Dynamics-of-Visual-Cognition-FUB/Algonauts2021_devkit/blob/HEAD/feature_extraction/generate_features_alexnet.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"0f97c7bb3ef6ae3c"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}