{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/efficient-adaptive-human-object-interaction","title":"Efficient Adaptive Human-Object Interaction Detection with Concept-guided Memory","arxiv_id":"2309.03696","date":"2023-09-07","proceeding":"ICCV 2023 1","authors":["Ting Lei","Fabian Caba","Qingchao Chen","Hailin Jin","Yuxin Peng","Yang Liu"],"abstract":"Human Object Interaction (HOI) detection aims to localize and infer the relationships between a human and an object. Arguably, training supervised models for this task from scratch presents challenges due to the performance drop over rare classes and the high computational cost and time required to handle long-tailed distributions of HOIs in complex HOI scenes in realistic settings. This observation motivates us to design an HOI detector that can be trained even with long-tailed labeled data and can leverage existing knowledge from pre-trained models. Inspired by the powerful generalization ability of the large Vision-Language Models (VLM) on classification and retrieval tasks, we propose an efficient Adaptive HOI Detector with Concept-guided Memory (ADA-CM). ADA-CM has two operating modes. The first mode makes it tunable without learning new parameters in a training-free paradigm. Its second mode incorporates an instance-aware adapter mechanism that can further efficiently boost performance if updating a lightweight set of parameters can be afforded. Our proposed method achieves competitive results with state-of-the-art on the HICO-DET and V-COCO datasets with much less training time. Code can be found at https://github.com/ltttpku/ADA-CM.","url_abs":"https://arxiv.org/abs/2309.03696v1","url_pdf":"https://arxiv.org/pdf/2309.03696v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"efficient-adaptive-human-object-interaction","repo_url":"https://github.com/ltttpku/ada-cm","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"pytorch","reach":{"status":"ok"}}],"tasks":[{"task_slug":"human-object-interaction-detection","task_name":"Human-Object Interaction Detection"},{"task_slug":"retrieval","task_name":"Retrieval"}],"methods":[{"method_slug":"adapter","method_name":"Adapter"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2309.03696","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2309.03696"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/ltttpku/ada-cm","reach":{"status":"ok"}},{"provenance":"deterministic:regex_extraction","url":"https://github.com/ltttpku/ADA-CM","reach":{"status":"ok"}}],"summary":{"unverified":4},"by_repo_kind":{"official":{"samples":4,"ran":0,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":4,"samples":[{"code_sha256_prefix":"8c73b8b7646a5ae4","entry":"custom_collate","repo":"ltttpku/ADA-CM","repo_kind":"official","path":"utils_tip_cache_and_union_finetune.py","file_url":"https://github.com/ltttpku/ADA-CM/blob/HEAD/utils_tip_cache_and_union_finetune.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"8c73b8b7646a5ae4"}},{"code_sha256_prefix":"b5475a6736cac21b","entry":"swig_object_n_verb_to_interaction","repo":"ltttpku/ADA-CM","repo_kind":"official","path":"main_tip_finetune.py","file_url":"https://github.com/ltttpku/ADA-CM/blob/HEAD/main_tip_finetune.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"b5475a6736cac21b"}},{"code_sha256_prefix":"47aecf9da63178bf","entry":"tranverse_and_get_hoi_cooccurence","repo":"ltttpku/ADA-CM","repo_kind":"official","path":"main_tip_finetune.py","file_url":"https://github.com/ltttpku/ADA-CM/blob/HEAD/main_tip_finetune.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"47aecf9da63178bf"}},{"code_sha256_prefix":"918857a5573a14b1","entry":"vcoco_object_n_verb_to_interaction","repo":"ltttpku/ADA-CM","repo_kind":"official","path":"main_tip_finetune.py","file_url":"https://github.com/ltttpku/ADA-CM/blob/HEAD/main_tip_finetune.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"918857a5573a14b1"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}