Papers › Rethinking RGB-D Salient Object Detection: Models, Data Sets, and Large-Scale Benchmarks

Rethinking RGB-D Salient Object Detection: Models, Data Sets, and Large-Scale Benchmarks

15 Jul 2019arXiv:1907.06781archive 2025-07-28

Deng-Ping Fan, Zheng Lin, Jia-Xing Zhao, Yun Liu, Zhao Zhang, Qibin Hou, Menglong Zhu, Ming-Ming Cheng

The use of RGB-D information for salient object detection has been extensively explored in recent years. However, relatively few efforts have been put towards modeling salient object detection in real-world human activity scenes with RGBD. In this work, we fill the gap by making the following contributions to RGB-D salient object detection. (1) We carefully collect a new SIP (salient person) dataset, which consists of ~1K high-resolution images that cover diverse real-world scenes from various viewpoints, poses, occlusions, illuminations, and backgrounds. (2) We conduct a large-scale (and, so far, the most comprehensive) benchmark comparing contemporary methods, which has long been missing in the field and can serve as a baseline for future research. We systematically summarize 32 popular models and evaluate 18 parts of 32 models on seven datasets containing a total of about 97K images. (3) We propose a simple general architecture, called Deep Depth-Depurator Network (D3Net). It consists of a depth depurator unit (DDU) and a three-stream feature learning module (FLM), which performs low-quality depth map filtering and cross-modal feature learning respectively. These components form a nested structure and are elaborately designed to be learned jointly. D3Net exceeds the performance of any prior contenders across all five metrics under consideration, thus serving as a strong model to advance research in this field. We also demonstrate that D3Net can be used to efficiently extract salient object masks from real scenes, enabling effective background changing application with a speed of 65fps on a single GPU. All the saliency maps, our new SIP dataset, the D3Net model, and the evaluation tools are publicly available at https://github.com/DengPingFan/D3NetBenchmark.

PaperPDFCode

In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

Code

DengPingFan/D3NetBenchmark officialmentioned in papermentioned on GitHubpytorch report
taozh2017/RGBD-SODsurvey mentioned on GitHub report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

ObjectObject DetectionRGB Salient Object DetectionRGB-D Salient Object DetectionSalient Object Detectionobject-detection

1 archive task tag without a task page not shown.

Datasets

Introduced by this paper, per the archive.

SIP

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
RGB-D Salient Object Detection LFSD D3Net Average MAE 0.095 #7 of 8 Archive leaderboard report
RGB-D Salient Object Detection LFSD D3Net S-Measure 82.5 #7 of 8 Archive leaderboard report
RGB-D Salient Object Detection LFSD D3Net max E-Measure 86.2 #7 of 8 Archive leaderboard report
RGB-D Salient Object Detection LFSD D3Net max F-Measure 81.0 #7 of 8 Archive leaderboard report
RGB-D Salient Object Detection NJU2K D3Net Average MAE 0.046 #15 of 27 Archive leaderboard report
RGB-D Salient Object Detection NJU2K D3Net S-Measure 90.0 #15 of 27 Archive leaderboard report
RGB-D Salient Object Detection NJU2K D3Net max E-Measure 93.9 #15 of 27 Archive leaderboard report
RGB-D Salient Object Detection NJU2K D3Net max F-Measure 90.0 #15 of 27 Archive leaderboard report
RGB-D Salient Object Detection NLPR D3Net Average MAE 0.030 #12 of 14 Archive leaderboard report
RGB-D Salient Object Detection NLPR D3Net S-Measure 91.2 #12 of 14 Archive leaderboard report
RGB-D Salient Object Detection NLPR D3Net max E-Measure 95.3 #12 of 14 Archive leaderboard report
RGB-D Salient Object Detection NLPR D3Net max F-Measure 89.7 #12 of 14 Archive leaderboard report
RGB-D Salient Object Detection RGBD135 D3Net Average MAE 0.058 #4 of 5 Archive leaderboard report
RGB-D Salient Object Detection RGBD135 D3Net S-Measure 85.7 #4 of 5 Archive leaderboard report
RGB-D Salient Object Detection RGBD135 D3Net max E-Measure 91.0 #4 of 5 Archive leaderboard report
RGB-D Salient Object Detection RGBD135 D3Net max F-Measure 83.4 #4 of 5 Archive leaderboard report
RGB-D Salient Object Detection SIP D3Net Average MAE 0.063 #14 of 16 Archive leaderboard report
RGB-D Salient Object Detection SIP D3Net S-Measure 86.0 #14 of 16 Archive leaderboard report
RGB-D Salient Object Detection SIP D3Net max E-Measure 90.9 #14 of 16 Archive leaderboard report
RGB-D Salient Object Detection SIP D3Net max F-Measure 86.1 #14 of 16 Archive leaderboard report
RGB-D Salient Object Detection STERE D3Net Average MAE 0.046 #12 of 14 Archive leaderboard report
RGB-D Salient Object Detection STERE D3Net S-Measure 89.9 #12 of 14 Archive leaderboard report
RGB-D Salient Object Detection STERE D3Net max E-Measure 93.8 #12 of 14 Archive leaderboard report
RGB-D Salient Object Detection STERE D3Net max F-Measure 89.1 #12 of 14 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Methods

SPEED

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections