{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/retinamask-learning-to-predict-masks-improves","title":"RetinaMask: Learning to predict masks improves state-of-the-art single-shot detection for free","arxiv_id":"1901.03353","date":"2019-01-10","proceeding":null,"authors":["Cheng-Yang Fu","Mykhailo Shvets","Alexander C. Berg"],"abstract":"Recently two-stage detectors have surged ahead of single-shot detectors in\nthe accuracy-vs-speed trade-off. Nevertheless single-shot detectors are\nimmensely popular in embedded vision applications. This paper brings\nsingle-shot detectors up to the same level as current two-stage techniques. We\ndo this by improving training for the state-of-the-art single-shot detector,\nRetinaNet, in three ways: integrating instance mask prediction for the first\ntime, making the loss function adaptive and more stable, and including\nadditional hard examples in training. We call the resulting augmented network\nRetinaMask. The detection component of RetinaMask has the same computational\ncost as the original RetinaNet, but is more accurate. COCO test-dev results are\nup to 41.4 mAP for RetinaMask-101 vs 39.1mAP for RetinaNet-101, while the\nruntime is the same during evaluation. Adding Group Normalization increases the\nperformance of RetinaMask-101 to 41.7 mAP. Code is\nat:https://github.com/chengyangfu/retinamask","url_abs":"http://arxiv.org/abs/1901.03353v1","url_pdf":"http://arxiv.org/pdf/1901.03353v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"retinamask-learning-to-predict-masks-improves","repo_url":"https://github.com/chengyangfu/retinamask","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"pytorch","reach":null},{"paper_slug":"retinamask-learning-to-predict-masks-improves","repo_url":"https://github.com/BIYTC/mobilenet_maskrcnn","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}},{"paper_slug":"retinamask-learning-to-predict-masks-improves","repo_url":"https://github.com/FluteXu/ms-project","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":null},{"paper_slug":"retinamask-learning-to-predict-masks-improves","repo_url":"https://github.com/GuoLiuFang/maskrcnn-benchmark-lfs","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}},{"paper_slug":"retinamask-learning-to-predict-masks-improves","repo_url":"https://github.com/Iamal1/maskrcnn-benchmark","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}},{"paper_slug":"retinamask-learning-to-predict-masks-improves","repo_url":"https://github.com/Miracle1991/DetectionHub","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok"}},{"paper_slug":"retinamask-learning-to-predict-masks-improves","repo_url":"https://github.com/PeterTKovacs/zold137","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}},{"paper_slug":"retinamask-learning-to-predict-masks-improves","repo_url":"https://github.com/SilvioGiancola/maskrcnn-benchmark","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}},{"paper_slug":"retinamask-learning-to-predict-masks-improves","repo_url":"https://github.com/Zanderzt/TensorRT_Mask_RCNN","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}},{"paper_slug":"retinamask-learning-to-predict-masks-improves","repo_url":"https://github.com/Zhang-Jing-Xuan/MaskRCNN","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"gone","observed_at":"2026-09-18","how":"tree_404+repo_404"}},{"paper_slug":"retinamask-learning-to-predict-masks-improves","repo_url":"https://github.com/Zhangyongtao123/maskrcnn_benchmark","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}},{"paper_slug":"retinamask-learning-to-predict-masks-improves","repo_url":"https://github.com/ZhichengHuang/Food-Project","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":null},{"paper_slug":"retinamask-learning-to-predict-masks-improves","repo_url":"https://github.com/abcxs/maskrcnn-contest","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}},{"paper_slug":"retinamask-learning-to-predict-masks-improves","repo_url":"https://github.com/adamvest/keypoint-baseline","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":null},{"paper_slug":"retinamask-learning-to-predict-masks-improves","repo_url":"https://github.com/alannguyencs/maskrcnn","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}},{"paper_slug":"retinamask-learning-to-predict-masks-improves","repo_url":"https://github.com/banben/maskrcnn-benchmark","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}},{"paper_slug":"retinamask-learning-to-predict-masks-improves","repo_url":"https://github.com/basaltzhang/maskrcnn-benchmark","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}},{"paper_slug":"retinamask-learning-to-predict-masks-improves","repo_url":"https://github.com/bhfs9999/maskrcnn_isic","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":null},{"paper_slug":"retinamask-learning-to-predict-masks-improves","repo_url":"https://github.com/bimal1988/detector","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":null},{"paper_slug":"retinamask-learning-to-predict-masks-improves","repo_url":"https://github.com/ccchang1023/maskrcnn-benchmark","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}},{"paper_slug":"retinamask-learning-to-predict-masks-improves","repo_url":"https://github.com/chencq1234/maskrcnn_facebook","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}},{"paper_slug":"retinamask-learning-to-predict-masks-improves","repo_url":"https://github.com/cshizhe/maskrcnn_benchmark","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}},{"paper_slug":"retinamask-learning-to-predict-masks-improves","repo_url":"https://github.com/cyctrung/DPnet","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}},{"paper_slug":"retinamask-learning-to-predict-masks-improves","repo_url":"https://github.com/feng-lab/nuclei","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}},{"paper_slug":"retinamask-learning-to-predict-masks-improves","repo_url":"https://github.com/howardyclo/maskrcnn-benchmark","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":null},{"paper_slug":"retinamask-learning-to-predict-masks-improves","repo_url":"https://github.com/huaifeng1993/JinNanCompetition2","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":null},{"paper_slug":"retinamask-learning-to-predict-masks-improves","repo_url":"https://github.com/iphyer/DefectDetection-MaskRCNN","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":null},{"paper_slug":"retinamask-learning-to-predict-masks-improves","repo_url":"https://github.com/jahutwb/DL_dosimetry","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}},{"paper_slug":"retinamask-learning-to-predict-masks-improves","repo_url":"https://github.com/jonvthvn90/Project","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}},{"paper_slug":"retinamask-learning-to-predict-masks-improves","repo_url":"https://github.com/latentgnn/maskrcnn-benchmark-latentgnn","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":null},{"paper_slug":"retinamask-learning-to-predict-masks-improves","repo_url":"https://github.com/lipengfeizju/Detection","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}},{"paper_slug":"retinamask-learning-to-predict-masks-improves","repo_url":"https://github.com/lippman1125/maskrcnn_benchmark_mobilenetv2","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}},{"paper_slug":"retinamask-learning-to-predict-masks-improves","repo_url":"https://github.com/lssily/maskrcnn-benchmark-master","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":null},{"paper_slug":"retinamask-learning-to-predict-masks-improves","repo_url":"https://github.com/lzrobots/dgmn","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}},{"paper_slug":"retinamask-learning-to-predict-masks-improves","repo_url":"https://github.com/markson14/WheatDet","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}},{"paper_slug":"retinamask-learning-to-predict-masks-improves","repo_url":"https://github.com/maxsenh/nuclei_cell_detect","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":null},{"paper_slug":"retinamask-learning-to-predict-masks-improves","repo_url":"https://github.com/meryusha/seeds_faster","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":null},{"paper_slug":"retinamask-learning-to-predict-masks-improves","repo_url":"https://github.com/monk-ai/maskrcnn","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}},{"paper_slug":"retinamask-learning-to-predict-masks-improves","repo_url":"https://github.com/mtcld/maskrcnn_benchmark_pytorch","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":null},{"paper_slug":"retinamask-learning-to-predict-masks-improves","repo_url":"https://github.com/oulutan/Drone_FasterRCNN","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}},{"paper_slug":"retinamask-learning-to-predict-masks-improves","repo_url":"https://github.com/qilei123/maskrcnn_benchmark_ROP","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":null},{"paper_slug":"retinamask-learning-to-predict-masks-improves","repo_url":"https://github.com/ryota2425/maskrcnn-benchmark","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}},{"paper_slug":"retinamask-learning-to-predict-masks-improves","repo_url":"https://github.com/sadicLiu/mask_rcnn_code","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":null},{"paper_slug":"retinamask-learning-to-predict-masks-improves","repo_url":"https://github.com/sarrrrry/maskrcnn-benchmark","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}},{"paper_slug":"retinamask-learning-to-predict-masks-improves","repo_url":"https://github.com/squirrelim/sr-frcnn","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":null},{"paper_slug":"retinamask-learning-to-predict-masks-improves","repo_url":"https://github.com/stigma0617/maskrcnn-benchmark-vovnet","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}},{"paper_slug":"retinamask-learning-to-predict-masks-improves","repo_url":"https://github.com/tuananh1007/Faster-R-CNN-and-Mask-R-CNN-in-PyTorch-1.0","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}},{"paper_slug":"retinamask-learning-to-predict-masks-improves","repo_url":"https://github.com/vierachen/maskrcnn","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}},{"paper_slug":"retinamask-learning-to-predict-masks-improves","repo_url":"https://github.com/wangtuo0820/maskrcnn-benchmark-expansion","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":null},{"paper_slug":"retinamask-learning-to-predict-masks-improves","repo_url":"https://github.com/worldlife123/maskrcnn-benchmark","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}},{"paper_slug":"retinamask-learning-to-predict-masks-improves","repo_url":"https://github.com/wuyangzhang/maskrcnn","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}},{"paper_slug":"retinamask-learning-to-predict-masks-improves","repo_url":"https://github.com/zsl1996/mask","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":null},{"paper_slug":"retinamask-learning-to-predict-masks-improves","repo_url":"https://github.com/zy0851/FB-m-RCNN","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[{"task_slug":"object-detection","task_name":"Object Detection"}],"methods":[{"method_slug":"1x1-convolution","method_name":"1x1 Convolution"},{"method_slug":"average-pooling","method_name":"Average Pooling"},{"method_slug":"batch-normalization","method_name":"Batch Normalization"},{"method_slug":"bottleneck-residual-block","method_name":"Bottleneck Residual Block"},{"method_slug":"convolution","method_name":"Convolution"},{"method_slug":"fpn","method_name":"FPN"},{"method_slug":"focal-loss","method_name":"Focal Loss"},{"method_slug":"global-average-pooling","method_name":"Global Average Pooling"},{"method_slug":"group-normalization","method_name":"Group Normalization"},{"method_slug":"grouped-convolution","method_name":"Grouped Convolution"},{"method_slug":"kaiming-initialization","method_name":"Kaiming Initialization"},{"method_slug":"max-pooling","method_name":"Max Pooling"},{"method_slug":"non-maximum-suppression","method_name":"Non Maximum Suppression"},{"method_slug":"relu","method_name":"ReLU"},{"method_slug":"resnext","method_name":"ResNeXt"},{"method_slug":"resnext-block","method_name":"ResNeXt Block"},{"method_slug":"residual-block","method_name":"Residual Block"},{"method_slug":"residual-connection","method_name":"Residual Connection"},{"method_slug":"retinamask","method_name":"RetinaMask"},{"method_slug":"retinanet","method_name":"RetinaNet"},{"method_slug":"roi-align","method_name":"RoIAlign"},{"method_slug":"sgd-with-momentum","method_name":"SGD with Momentum"},{"method_slug":"self-adjusting-smooth-l1-loss","method_name":"Self-Adjusting Smooth L1 Loss"},{"method_slug":"step-decay","method_name":"Step Decay"},{"method_slug":"weight-decay","method_name":"Weight Decay"}],"datasets_introduced":[],"methods_introduced":[{"slug":"retinamask","name":"RetinaMask","full_name":"RetinaMask"},{"slug":"self-adjusting-smooth-l1-loss","name":"Self-Adjusting Smooth L1 Loss","full_name":"Self-Adjusting Smooth L1 Loss"}],"results":[{"leaderboard":"/sota/object-detection-on-coco-minival","task":"Object Detection","dataset":"COCO minival","model":"RetinaMask (ResNet-101-FPN)","rank_in_archive_order":168,"of":220,"metrics":{"AP50":"60.2","AP75":"44.1","box AP":"41.1"},"uses_additional_data":false},{"leaderboard":"/sota/object-detection-on-coco","task":"Object Detection","dataset":"COCO test-dev","model":"RetinaMask (ResNeXt-101-FPN-GN)","rank_in_archive_order":172,"of":225,"metrics":{"AP50":"62.5","AP75":"46.0","APL":"53.8","APM":"45.6","APS":"24.8","Hardware Burden":"12G","box mAP":"42.6"},"uses_additional_data":false},{"leaderboard":"/sota/object-detection-on-coco","task":"Object Detection","dataset":"COCO test-dev","model":"RetinaMask (ResNet-50-FPN)","rank_in_archive_order":204,"of":225,"metrics":{"AP50":"58.6","AP75":"42.3","APL":"51.0","APM":"42.0","APS":"21.9","Hardware Burden":"9G","box mAP":"39.4"},"uses_additional_data":false}],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=1901.03353","mcp":null,"developers":"https://syntology.ai/developers"},"arxiv_metadata":null,"syntology_extracted_results":null}