{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/sparse-instance-activation-for-real-time","title":"Sparse Instance Activation for Real-Time Instance Segmentation","arxiv_id":"2203.12827","date":"2022-03-24","proceeding":"CVPR 2022 1","authors":["Tianheng Cheng","Xinggang Wang","Shaoyu Chen","Wenqiang Zhang","Qian Zhang","Chang Huang","Zhaoxiang Zhang","Wenyu Liu"],"abstract":"In this paper, we propose a conceptually novel, efficient, and fully convolutional framework for real-time instance segmentation. Previously, most instance segmentation methods heavily rely on object detection and perform mask prediction based on bounding boxes or dense centers. In contrast, we propose a sparse set of instance activation maps, as a new object representation, to highlight informative regions for each foreground object. Then instance-level features are obtained by aggregating features according to the highlighted regions for recognition and segmentation. Moreover, based on bipartite matching, the instance activation maps can predict objects in a one-to-one style, thus avoiding non-maximum suppression (NMS) in post-processing. Owing to the simple yet effective designs with instance activation maps, SparseInst has extremely fast inference speed and achieves 40 FPS and 37.9 AP on the COCO benchmark, which significantly outperforms the counterparts in terms of speed and accuracy. Code and models are available at https://github.com/hustvl/SparseInst.","url_abs":"https://arxiv.org/abs/2203.12827v1","url_pdf":"https://arxiv.org/pdf/2203.12827v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"sparse-instance-activation-for-real-time","repo_url":"https://github.com/hustvl/sparseinst","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}},{"paper_slug":"sparse-instance-activation-for-real-time","repo_url":"https://github.com/2023-MindSpore-1/ms-code-143","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"pytorch","reach":{"status":"ok"}}],"tasks":[{"task_slug":"instance-segmentation","task_name":"Instance Segmentation"},{"task_slug":"object","task_name":"Object"},{"task_slug":"object-detection","task_name":"Object Detection"},{"task_slug":"real-time-instance-segmentation","task_name":"Real-time Instance Segmentation"},{"task_slug":"segmentation","task_name":"Segmentation"},{"task_slug":"semantic-segmentation","task_name":"Semantic Segmentation"},{"task_slug":"object-detection-1","task_name":"object-detection"}],"methods":[{"method_slug":"speed","method_name":"SPEED"}],"datasets_introduced":[],"methods_introduced":[],"results":[{"leaderboard":"/sota/real-time-instance-segmentation-on-mscoco","task":"Real-time Instance Segmentation","dataset":"MSCOCO","model":"SparseInst-608 (ResNet-50-vd)","rank_in_archive_order":7,"of":22,"metrics":{"AP50":"59.2","AP75":"40.2","APL":"56.9","APM":"39.4","APS":"15.7","Frame (fps)":"40 (2080 Ti)","mask AP":"37.9"},"uses_additional_data":false},{"leaderboard":"/sota/real-time-instance-segmentation-on-mscoco","task":"Real-time Instance Segmentation","dataset":"MSCOCO","model":"SparseInst-448 (ResNet-50-vd)","rank_in_archive_order":10,"of":22,"metrics":{"AP50":"56.5","AP75":"37.7","APL":"57.0","APM":"37.1","APS":"12.3","Frame (fps)":"58.5 (2080 Ti)","mask AP":"35.9"},"uses_additional_data":false}],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2203.12827","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2203.12827"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/2023-MindSpore-1/ms-code-143","reach":{"status":"ok"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/hustvl/sparseinst","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"ran_draft_wrong":1,"ran":1,"ran_honours":1,"unverified":8},"by_repo_kind":{"official":{"samples":11,"ran":3,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"29dbbaafa4be18e1","entry":"aligned_bilinear","repo":"hustvl/sparseinst","repo_kind":"official","path":"sparseinst/utils.py","file_url":"https://github.com/hustvl/sparseinst/blob/HEAD/sparseinst/utils.py","link_basis":"harvester_set","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"29dbbaafa4be18e1"}},{"code_sha256_prefix":"eea0376ea397a1c7","entry":"downsample_conv","repo":"hustvl/sparseinst","repo_kind":"official","path":"sparseinst/backbones/resnet.py","file_url":"https://github.com/hustvl/sparseinst/blob/HEAD/sparseinst/backbones/resnet.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"eea0376ea397a1c7"}},{"code_sha256_prefix":"9b02c1068795fd5b","entry":"get_padding","repo":"hustvl/sparseinst","repo_kind":"official","path":"sparseinst/backbones/resnet.py","file_url":"https://github.com/hustvl/sparseinst/blob/HEAD/sparseinst/backbones/resnet.py","link_basis":"harvester_set","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"9b02c1068795fd5b"}},{"code_sha256_prefix":"fa8b5ab70cd01b52","entry":"compute_mask_iou","repo":"hustvl/sparseinst","repo_kind":"official","path":"sparseinst/loss.py","file_url":"https://github.com/hustvl/sparseinst/blob/HEAD/sparseinst/loss.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"fa8b5ab70cd01b52"}},{"code_sha256_prefix":"9419c6922822ae68","entry":"create_stem","repo":"hustvl/sparseinst","repo_kind":"official","path":"sparseinst/backbones/cspnet.py","file_url":"https://github.com/hustvl/sparseinst/blob/HEAD/sparseinst/backbones/cspnet.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"9419c6922822ae68"}},{"code_sha256_prefix":"2bd30703b07443b2","entry":"dice_loss","repo":"hustvl/sparseinst","repo_kind":"official","path":"sparseinst/loss.py","file_url":"https://github.com/hustvl/sparseinst/blob/HEAD/sparseinst/loss.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"2bd30703b07443b2"}},{"code_sha256_prefix":"a08c2d41f637733e","entry":"dice_score","repo":"hustvl/sparseinst","repo_kind":"official","path":"sparseinst/loss.py","file_url":"https://github.com/hustvl/sparseinst/blob/HEAD/sparseinst/loss.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"a08c2d41f637733e"}},{"code_sha256_prefix":"bf7559951d6574a4","entry":"downsample_avg","repo":"hustvl/sparseinst","repo_kind":"official","path":"sparseinst/backbones/resnet.py","file_url":"https://github.com/hustvl/sparseinst/blob/HEAD/sparseinst/backbones/resnet.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"bf7559951d6574a4"}},{"code_sha256_prefix":"fc67f83665c787db","entry":"nested_masks_from_list","repo":"hustvl/sparseinst","repo_kind":"official","path":"sparseinst/utils.py","file_url":"https://github.com/hustvl/sparseinst/blob/HEAD/sparseinst/utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"fc67f83665c787db"}},{"code_sha256_prefix":"764b0c92414d2fed","entry":"nested_tensor_from_tensor_list","repo":"hustvl/sparseinst","repo_kind":"official","path":"sparseinst/utils.py","file_url":"https://github.com/hustvl/sparseinst/blob/HEAD/sparseinst/utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"764b0c92414d2fed"}},{"code_sha256_prefix":"41822f58ea4816aa","entry":"rescoring_mask","repo":"hustvl/sparseinst","repo_kind":"official","path":"sparseinst/sparseinst.py","file_url":"https://github.com/hustvl/sparseinst/blob/HEAD/sparseinst/sparseinst.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"41822f58ea4816aa"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}