{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/contributions-of-shape-texture-and-color-in","title":"Contributions of Shape, Texture, and Color in Visual Recognition","arxiv_id":"2207.09510","date":"2022-07-19","proceeding":null,"authors":["Yunhao Ge","Yao Xiao","Zhi Xu","Xingrui Wang","Laurent Itti"],"abstract":"We investigate the contributions of three important features of the human visual system (HVS)~ -- ~shape, texture, and color ~ -- ~to object classification. We build a humanoid vision engine (HVE) that explicitly and separately computes shape, texture, and color features from images. The resulting feature vectors are then concatenated to support the final classification. We show that HVE can summarize and rank-order the contributions of the three features to object recognition. We use human experiments to confirm that both HVE and humans predominantly use some specific features to support the classification of specific classes (e.g., texture is the dominant feature to distinguish a zebra from other quadrupeds, both for humans and HVE). With the help of HVE, given any environment (dataset), we can summarize the most important features for the whole task (task-specific; e.g., color is the most important feature overall for classification with the CUB dataset), and for each class (class-specific; e.g., shape is the most important feature to recognize boats in the iLab-20M dataset). To demonstrate more usefulness of HVE, we use it to simulate the open-world zero-shot learning ability of humans with no attribute labeling. Finally, we show that HVE can also simulate human imagination ability with the combination of different features. We will open-source the HVE engine and corresponding datasets.","url_abs":"https://arxiv.org/abs/2207.09510v1","url_pdf":"https://arxiv.org/pdf/2207.09510v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"contributions-of-shape-texture-and-color-in","repo_url":"https://github.com/gyhandy/humanoid-vision-engine","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[{"task_slug":"attribute","task_name":"Attribute"},{"task_slug":"classification","task_name":"General Classification"},{"task_slug":"object-recognition","task_name":"Object Recognition"},{"task_slug":"zero-shot-learning","task_name":"Zero-Shot Learning"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/2207.09510","atlas_url":"https://app.syntology.ai/?focus=2207.09510","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2207.09510"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-25T09:33:49+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/gyhandy/humanoid-vision-engine","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"ran_draft_wrong":1,"ran_fixture":1,"ran":3,"unverified":3},"by_repo_kind":{"official":{"samples":8,"ran":5,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"16679a24b9881031","entry":"adaptive_instance_normalization","repo":"gyhandy/humanoid-vision-engine","repo_kind":"official","path":"Imagine/models.py","file_url":"https://github.com/gyhandy/humanoid-vision-engine/blob/HEAD/Imagine/models.py","link_basis":"harvester_set","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"16679a24b9881031"}},{"code_sha256_prefix":"38eaf8511dc7bc9c","entry":"calc_mean_std","repo":"gyhandy/humanoid-vision-engine","repo_kind":"official","path":"Imagine/models.py","file_url":"https://github.com/gyhandy/humanoid-vision-engine/blob/HEAD/Imagine/models.py","link_basis":"harvester_set","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"38eaf8511dc7bc9c"}},{"code_sha256_prefix":"82c9ace65355539f","entry":"get_modality_Dataloader","repo":"gyhandy/humanoid-vision-engine","repo_kind":"official","path":"Zero_shot/data_loader_modality.py","file_url":"https://github.com/gyhandy/humanoid-vision-engine/blob/HEAD/Zero_shot/data_loader_modality.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"82c9ace65355539f"}},{"code_sha256_prefix":"134aa92d49baf521","entry":"get_retrival_Dataloader","repo":"gyhandy/humanoid-vision-engine","repo_kind":"official","path":"Zero_shot/data_loader_modality.py","file_url":"https://github.com/gyhandy/humanoid-vision-engine/blob/HEAD/Zero_shot/data_loader_modality.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"134aa92d49baf521"}},{"code_sha256_prefix":"961a212d9dfa61b4","entry":"record_acc","repo":"gyhandy/humanoid-vision-engine","repo_kind":"official","path":"Zero_shot/cross_modality_two_latents.py","file_url":"https://github.com/gyhandy/humanoid-vision-engine/blob/HEAD/Zero_shot/cross_modality_two_latents.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"961a212d9dfa61b4"}},{"code_sha256_prefix":"8aa906b9bc724932","entry":"get_concept_latent","repo":"gyhandy/humanoid-vision-engine","repo_kind":"official","path":"Zero_shot/cross_modality_two_latents.py","file_url":"https://github.com/gyhandy/humanoid-vision-engine/blob/HEAD/Zero_shot/cross_modality_two_latents.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"8aa906b9bc724932"}},{"code_sha256_prefix":"883ccd49b57f68c5","entry":"test","repo":"gyhandy/humanoid-vision-engine","repo_kind":"official","path":"HNN/compute_bias.py","file_url":"https://github.com/gyhandy/humanoid-vision-engine/blob/HEAD/HNN/compute_bias.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"883ccd49b57f68c5"}},{"code_sha256_prefix":"e6fe8a84c5113f3c","entry":"train","repo":"gyhandy/humanoid-vision-engine","repo_kind":"official","path":"Zero_shot/cross_modality_two_latents.py","file_url":"https://github.com/gyhandy/humanoid-vision-engine/blob/HEAD/Zero_shot/cross_modality_two_latents.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"e6fe8a84c5113f3c"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}