{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/affordgrasp-in-context-affordance-reasoning","title":"AffordGrasp: In-Context Affordance Reasoning for Open-Vocabulary Task-Oriented Grasping in Clutter","arxiv_id":"2503.00778","date":"2025-03-02","proceeding":null,"authors":["Yingbo Tang","Shuaike Zhang","Xiaoshuai Hao","Pengwei Wang","Jianlong Wu","Zhongyuan Wang","Shanghang Zhang"],"abstract":"Inferring the affordance of an object and grasping it in a task-oriented manner is crucial for robots to successfully complete manipulation tasks. Affordance indicates where and how to grasp an object by taking its functionality into account, serving as the foundation for effective task-oriented grasping. However, current task-oriented methods often depend on extensive training data that is confined to specific tasks and objects, making it difficult to generalize to novel objects and complex scenes. In this paper, we introduce AffordGrasp, a novel open-vocabulary grasping framework that leverages the reasoning capabilities of vision-language models (VLMs) for in-context affordance reasoning. Unlike existing methods that rely on explicit task and object specifications, our approach infers tasks directly from implicit user instructions, enabling more intuitive and seamless human-robot interaction in everyday scenarios. Building on the reasoning outcomes, our framework identifies task-relevant objects and grounds their part-level affordances using a visual grounding module. This allows us to generate task-oriented grasp poses precisely within the affordance regions of the object, ensuring both functional and context-aware robotic manipulation. Extensive experiments demonstrate that AffordGrasp achieves state-of-the-art performance in both simulation and real-world scenarios, highlighting the effectiveness of our method. We believe our approach advances robotic manipulation techniques and contributes to the broader field of embodied AI. Project website: https://eqcy.github.io/affordgrasp/.","url_abs":"https://arxiv.org/abs/2503.00778v1","url_pdf":"https://arxiv.org/pdf/2503.00778v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"links_only","authors_date_abstract":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license), from the Kaggle arXiv metadata snapshot of 2026-09-12"},"code_links":[{"paper_slug":"affordgrasp-in-context-affordance-reasoning","repo_url":"https://github.com/H-Freax/ThinkGrasp","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2503.00778","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2503.00778"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/H-Freax/ThinkGrasp","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"unverified":8},"by_repo_kind":{"listed":{"samples":8,"ran":0,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"bde90808e65e6ec2","entry":"build_bert_backbone","repo":"H-Freax/ThinkGrasp","repo_kind":"listed","path":"VLP/glip/bert_model.py","file_url":"https://github.com/H-Freax/ThinkGrasp/blob/HEAD/VLP/glip/bert_model.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"bde90808e65e6ec2"}},{"code_sha256_prefix":"b20c34ab2acaf8cb","entry":"create_cropping_box_from_boxes","repo":"H-Freax/ThinkGrasp","repo_kind":"listed","path":"simulation_main.py","file_url":"https://github.com/H-Freax/ThinkGrasp/blob/HEAD/simulation_main.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"b20c34ab2acaf8cb"}},{"code_sha256_prefix":"eab615e8d72bd22e","entry":"get_heightmap","repo":"H-Freax/ThinkGrasp","repo_kind":"listed","path":"utils.py","file_url":"https://github.com/H-Freax/ThinkGrasp/blob/HEAD/utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"eab615e8d72bd22e"}},{"code_sha256_prefix":"b6d3d8977853db90","entry":"get_pointcloud","repo":"H-Freax/ThinkGrasp","repo_kind":"listed","path":"utils.py","file_url":"https://github.com/H-Freax/ThinkGrasp/blob/HEAD/utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"b6d3d8977853db90"}},{"code_sha256_prefix":"90e904e8ec69bd26","entry":"load_image_as_base64","repo":"H-Freax/ThinkGrasp","repo_kind":"listed","path":"realarm.py","file_url":"https://github.com/H-Freax/ThinkGrasp/blob/HEAD/realarm.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"90e904e8ec69bd26"}},{"code_sha256_prefix":"2f62971aa5d9996b","entry":"process_grasping_result","repo":"H-Freax/ThinkGrasp","repo_kind":"listed","path":"realarm.py","file_url":"https://github.com/H-Freax/ThinkGrasp/blob/HEAD/realarm.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"2f62971aa5d9996b"}},{"code_sha256_prefix":"ae08b081b5d182e6","entry":"select_action","repo":"H-Freax/ThinkGrasp","repo_kind":"listed","path":"realarm.py","file_url":"https://github.com/H-Freax/ThinkGrasp/blob/HEAD/realarm.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"ae08b081b5d182e6"}},{"code_sha256_prefix":"09577e75397fa2ab","entry":"transform_pointcloud","repo":"H-Freax/ThinkGrasp","repo_kind":"listed","path":"utils.py","file_url":"https://github.com/H-Freax/ThinkGrasp/blob/HEAD/utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"09577e75397fa2ab"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}