{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/instance-shadow-detection-with-a-single-stage","title":"Instance Shadow Detection with A Single-Stage Detector","arxiv_id":"2207.04614","date":"2022-07-11","proceeding":null,"authors":["Tianyu Wang","Xiaowei Hu","Pheng-Ann Heng","Chi-Wing Fu"],"abstract":"This paper formulates a new problem, instance shadow detection, which aims to detect shadow instance and the associated object instance that cast each shadow in the input image. To approach this task, we first compile a new dataset with the masks for shadow instances, object instances, and shadow-object associations. We then design an evaluation metric for quantitative evaluation of the performance of instance shadow detection. Further, we design a single-stage detector to perform instance shadow detection in an end-to-end manner, where the bidirectional relation learning module and the deformable maskIoU head are proposed in the detector to directly learn the relation between shadow instances and object instances and to improve the accuracy of the predicted masks. Finally, we quantitatively and qualitatively evaluate our method on the benchmark dataset of instance shadow detection and show the applicability of our method on light direction estimation and photo editing.","url_abs":"https://arxiv.org/abs/2207.04614v1","url_pdf":"https://arxiv.org/pdf/2207.04614v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"instance-shadow-detection-with-a-single-stage","repo_url":"https://github.com/stevewongv/SSIS","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":null},{"paper_slug":"instance-shadow-detection-with-a-single-stage","repo_url":"https://github.com/stevewongv/InstanceShadowDetection","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"pytorch","reach":null}],"tasks":[{"task_slug":"instance-shadow-detection","task_name":"Instance Shadow Detection"},{"task_slug":"object","task_name":"Object"},{"task_slug":null,"task_name":"Relation"},{"task_slug":"shadow-detection","task_name":"Shadow Detection"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[{"leaderboard":"/sota/instance-shadow-detection-on-soba","task":"Instance Shadow Detection","dataset":"SOBA","model":"SSISv2 (TPAMI 2023)","rank_in_archive_order":1,"of":3,"metrics":{"Asso. AP_bbox":"63.0","Asso. AP_segm":"59.2","Bounding Box SOAP":"29.0","Instance AP_bbox":"44.4","Instance AP_segm":"50.2","mask SOAP":"35.3"},"uses_additional_data":false}],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2207.04614","mcp":null,"developers":"https://syntology.ai/developers"},"arxiv_metadata":null,"syntology_extracted_results":null}