Papers › REFINE: Prediction Fusion Network for Panoptic Segmentation

REFINE: Prediction Fusion Network for Panoptic Segmentation

15 Dec 2020archive 2025-07-28

Jiawei Ren, Cunjun Yu, Zhongang Cai, Mingyuan Zhang, Chongsong Chen, Haiyu Zhao, Shuai Yi, Hongsheng Li

Panoptic segmentation aims at generating pixel-wise class and instance predictions for each pixel in the input image, which is a challenging task and far more complicated than naively fusing the semantic and instance segmentation results. Prediction fusion is therefore important to achieve accurate panoptic segmentation. In this paper, we present REFINE, pREdiction FusIon NEtwork for panoptic segmentation, to achieve high-quality panoptic segmentation by improving cross-task prediction fusion, and within-task prediction fusion. Our single-model ResNeXt-101 with DCN achieves PQ=51.5 on the COCO dataset, surpassing state-of-the-art performance by a convincing margin and is comparable with ensembled models. Our smaller model with a ResNet-50 backbone achieves PQ=44.9, which is comparable with state-of-the-art methods with larger backbones.

PaperPDF

Code

No code repository is listed for this paper in the archive or in Syntology's graph.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Instance SegmentationPanoptic SegmentationPredictionSegmentationSemantic Segmentation

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Panoptic Segmentation COCO test-dev REFINE (ResNeXt-101-DCN) PQ 51.5 #11 of 38 Archive leaderboard report
Panoptic Segmentation COCO test-dev REFINE (ResNeXt-101-DCN) PQst 39.2 #11 of 38 Archive leaderboard report
Panoptic Segmentation COCO test-dev REFINE (ResNeXt-101-DCN) PQth 59.6 #11 of 38 Archive leaderboard report
Panoptic Segmentation COCO test-dev REFINE (ResNet-101-DCN) PQ 49.6 #16 of 38 Archive leaderboard report
Panoptic Segmentation COCO test-dev REFINE (ResNet-101-DCN) PQst 37.7 #16 of 38 Archive leaderboard report
Panoptic Segmentation COCO test-dev REFINE (ResNet-101-DCN) PQth 57.5 #16 of 38 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections