{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/gan-mask-r-cnn-instance-semantic-segmentation","title":"Instance Semantic Segmentation Benefits from Generative Adversarial Networks","arxiv_id":"2010.13757","date":"2020-10-26","proceeding":null,"authors":["Quang H. Le","Kamal Youcef-Toumi","Dzmitry Tsetserukou","Ali Jahanian"],"abstract":"In design of instance segmentation networks that reconstruct masks, segmentation is often taken as its literal definition -- assigning each pixel a label. This has led to thinking the problem as a template matching one with the goal of minimizing the loss between the reconstructed and the ground truth pixels. Rethinking reconstruction networks as a generator, we define the problem of predicting masks as a GANs game framework: A segmentation network generates the masks, and a discriminator network decides on the quality of the masks. To demonstrate this game, we show effective modifications on the general segmentation framework in Mask R-CNN. We find that playing the game in feature space is more effective than the pixel space leading to stable training between the discriminator and the generator, predicting object coordinates should be replaced by predicting contextual regions for objects, and overall the adversarial loss helps the performance and removes the need for any custom settings per different data domain. We test our framework in various domains and report on cellphone recycling, autonomous driving, large-scale object detection, and medical glands. We observe in general GANs yield masks that account for crispier boundaries, clutter, small objects, and details, being in domain of regular shapes or heterogeneous and coalescing shapes. Our code for reproducing the results is available publicly.","url_abs":"https://arxiv.org/abs/2010.13757v2","url_pdf":"https://arxiv.org/pdf/2010.13757v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"gan-mask-r-cnn-instance-semantic-segmentation","repo_url":"https://github.com/quangle2110/GAN_Mask-RCNN","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[{"task_slug":"autonomous-driving","task_name":"Autonomous Driving"},{"task_slug":"instance-segmentation","task_name":"Instance Segmentation"},{"task_slug":"object-detection","task_name":"Object Detection"},{"task_slug":"segmentation","task_name":"Segmentation"},{"task_slug":"semantic-segmentation","task_name":"Semantic Segmentation"},{"task_slug":"template-matching","task_name":"Template Matching"},{"task_slug":"object-detection-1","task_name":"object-detection"}],"methods":[{"method_slug":"convolution","method_name":"Convolution"},{"method_slug":"mask-r-cnn","method_name":"Mask R-CNN"},{"method_slug":"rpn","method_name":"RPN"},{"method_slug":"roi-align","method_name":"RoIAlign"},{"method_slug":"softmax","method_name":"Softmax"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2010.13757","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2010.13757"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/quangle2110/GAN_Mask-RCNN","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"ran":1,"unverified":3},"by_repo_kind":{"official":{"samples":4,"ran":1,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"5362c4106bc79217","entry":"expand_boxes","repo":"quangle2110/GAN_Mask-RCNN","repo_kind":"official","path":"maskrcnn-benchmark/maskrcnn_benchmark/modeling/roi_heads/mask_head/inference.py","file_url":"https://github.com/quangle2110/GAN_Mask-RCNN/blob/HEAD/maskrcnn-benchmark/maskrcnn_benchmark/modeling/roi_heads/mask_head/inference.py","link_basis":"plan_row","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"5362c4106bc79217"}},{"code_sha256_prefix":"762ce037e4512c48","entry":"expand_masks","repo":"quangle2110/GAN_Mask-RCNN","repo_kind":"official","path":"maskrcnn-benchmark/maskrcnn_benchmark/modeling/roi_heads/mask_head/inference.py","file_url":"https://github.com/quangle2110/GAN_Mask-RCNN/blob/HEAD/maskrcnn-benchmark/maskrcnn_benchmark/modeling/roi_heads/mask_head/inference.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"762ce037e4512c48"}},{"code_sha256_prefix":"22c410487cf7934d","entry":"project_masks_on_boxes","repo":"quangle2110/GAN_Mask-RCNN","repo_kind":"official","path":"gan_mrcnn.py","file_url":"https://github.com/quangle2110/GAN_Mask-RCNN/blob/HEAD/gan_mrcnn.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"22c410487cf7934d"}},{"code_sha256_prefix":"7282d9e488dd0a6d","entry":"project_masks_on_boxes","repo":"quangle2110/GAN_Mask-RCNN","repo_kind":"official","path":"maskrcnn-benchmark/maskrcnn_benchmark/modeling/roi_heads/mask_head/loss.py","file_url":"https://github.com/quangle2110/GAN_Mask-RCNN/blob/HEAD/maskrcnn-benchmark/maskrcnn_benchmark/modeling/roi_heads/mask_head/loss.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"7282d9e488dd0a6d"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}