{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/a-tri-layer-plugin-to-improve-occluded","title":"A Tri-Layer Plugin to Improve Occluded Detection","arxiv_id":"2210.10046","date":"2022-10-18","proceeding":null,"authors":["Guanqi Zhan","Weidi Xie","Andrew Zisserman"],"abstract":"Detecting occluded objects still remains a challenge for state-of-the-art object detectors. The objective of this work is to improve the detection for such objects, and thereby improve the overall performance of a modern object detector. To this end we make the following four contributions: (1) We propose a simple 'plugin' module for the detection head of two-stage object detectors to improve the recall of partially occluded objects. The module predicts a tri-layer of segmentation masks for the target object, the occluder and the occludee, and by doing so is able to better predict the mask of the target object. (2) We propose a scalable pipeline for generating training data for the module by using amodal completion of existing object detection and instance segmentation training datasets to establish occlusion relationships. (3) We also establish a COCO evaluation dataset to measure the recall performance of partially occluded and separated objects. (4) We show that the plugin module inserted into a two-stage detector can boost the performance significantly, by only fine-tuning the detection head, and with additional improvements if the entire architecture is fine-tuned. COCO results are reported for Mask R-CNN with Swin-T or Swin-S backbones, and Cascade Mask R-CNN with a Swin-B backbone.","url_abs":"https://arxiv.org/abs/2210.10046v1","url_pdf":"https://arxiv.org/pdf/2210.10046v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"a-tri-layer-plugin-to-improve-occluded","repo_url":"https://github.com/Championchess/Tri-Layer_Plugin_Occluded_Detection","is_official":1,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"Apache-2.0"}}],"tasks":[{"task_slug":"instance-segmentation","task_name":"Instance Segmentation"},{"task_slug":"object","task_name":"Object"},{"task_slug":"object-detection","task_name":"Object Detection"},{"task_slug":"semantic-segmentation","task_name":"Semantic Segmentation"},{"task_slug":"object-detection-1","task_name":"object-detection"}],"methods":[{"method_slug":"cascade-mask-r-cnn","method_name":"Cascade Mask R-CNN"},{"method_slug":"convolution","method_name":"Convolution"},{"method_slug":"mask-r-cnn","method_name":"Mask R-CNN"},{"method_slug":"rpn","method_name":"RPN"},{"method_slug":"roi-align","method_name":"RoIAlign"},{"method_slug":"softmax","method_name":"Softmax"}],"datasets_introduced":[{"slug":"occluded-coco","name":"Occluded COCO","full_name":""},{"slug":"separated-coco","name":"Separated COCO","full_name":""}],"methods_introduced":[],"results":[{"leaderboard":"/sota/instance-segmentation-on-coco","task":"Instance Segmentation","dataset":"COCO test-dev","model":"Swin-B + Cascade Mask R-CNN (tri-layer modelling)","rank_in_archive_order":41,"of":112,"metrics":{"mask AP":"45.9"},"uses_additional_data":false},{"leaderboard":"/sota/instance-segmentation-on-occluded-coco","task":"Instance Segmentation","dataset":"Occluded COCO","model":"Swin-B + Cascade Mask R-CNN (tri-layer modelling)","rank_in_archive_order":1,"of":6,"metrics":{"Mean Recall":"63.64"},"uses_additional_data":false},{"leaderboard":"/sota/instance-segmentation-on-occluded-coco","task":"Instance Segmentation","dataset":"Occluded COCO","model":"Swin-S + Mask R-CNN (tri-layer plugin)","rank_in_archive_order":3,"of":6,"metrics":{"Mean Recall":"62.58"},"uses_additional_data":false},{"leaderboard":"/sota/instance-segmentation-on-occluded-coco","task":"Instance Segmentation","dataset":"Occluded COCO","model":"Swin-T + Mask R-CNN (tri-layer plugin)","rank_in_archive_order":4,"of":6,"metrics":{"Mean Recall":"62.00"},"uses_additional_data":false},{"leaderboard":"/sota/instance-segmentation-on-separated-coco","task":"Instance Segmentation","dataset":"Separated COCO","model":"Swin-B + Cascade Mask R-CNN (tri-layer modelling)","rank_in_archive_order":1,"of":6,"metrics":{"Mean Recall":"36.88"},"uses_additional_data":false},{"leaderboard":"/sota/instance-segmentation-on-separated-coco","task":"Instance Segmentation","dataset":"Separated COCO","model":"Swin-S + Mask R-CNN (tri-layer plugin)","rank_in_archive_order":3,"of":6,"metrics":{"Mean Recall":"35.80"},"uses_additional_data":false},{"leaderboard":"/sota/instance-segmentation-on-separated-coco","task":"Instance Segmentation","dataset":"Separated COCO","model":"Swin-T + Mask R-CNN (tri-layer plugin)","rank_in_archive_order":4,"of":6,"metrics":{"Mean Recall":"34.72"},"uses_additional_data":false}],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2210.10046","mcp":null,"developers":"https://syntology.ai/developers"},"arxiv_metadata":null,"syntology_extracted_results":null}