Papers › Uncertainty Inspired RGB-D Saliency Detection

Uncertainty Inspired RGB-D Saliency Detection

7 Sep 2020arXiv:2009.03075archive 2025-07-28

Jing Zhang, Deng-Ping Fan, Yuchao Dai, Saeed Anwar, Fatemeh Saleh, Sadegh Aliakbarian, Nick Barnes

We propose the first stochastic framework to employ uncertainty for RGB-D saliency detection by learning from the data labeling process. Existing RGB-D saliency detection models treat this task as a point estimation problem by predicting a single saliency map following a deterministic learning pipeline. We argue that, however, the deterministic solution is relatively ill-posed. Inspired by the saliency data labeling process, we propose a generative architecture to achieve probabilistic RGB-D saliency detection which utilizes a latent variable to model the labeling variations. Our framework includes two main models: 1) a generator model, which maps the input image and latent variable to stochastic saliency prediction, and 2) an inference model, which gradually updates the latent variable by sampling it from the true or approximate posterior distribution. The generator model is an encoder-decoder saliency network. To infer the latent variable, we introduce two different solutions: i) a Conditional Variational Auto-encoder with an extra encoder to approximate the posterior distribution of the latent variable; and ii) an Alternating Back-Propagation technique, which directly samples the latent variable from the true posterior distribution. Qualitative and quantitative results on six challenging RGB-D benchmark datasets show our approach's superior performance in learning the distribution of saliency maps. The source code is publicly available via our project page: https://github.com/JingZhang617/UCNet.

PaperPDFCode

In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

Code

JingZhang617/UCNet officialmentioned in papermentioned on GitHubpytorch report
DengPingFan/SOC-DataAug mentioned on GitHubpytorch report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

DecoderRGB Salient Object DetectionRGB-D Salient Object DetectionSaliency DetectionSaliency Prediction

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
RGB Salient Object Detection DUT-OMRON UCNet-ABP MAE 0.050 #10 of 18 Archive leaderboard report
RGB Salient Object Detection DUT-OMRON UCNet-ABP S-Measure 0.843 #10 of 18 Archive leaderboard report
RGB Salient Object Detection DUT-OMRON UCNet-CVAE MAE 0.051 #11 of 18 Archive leaderboard report
RGB Salient Object Detection DUT-OMRON UCNet-CVAE S-Measure 0.839 #11 of 18 Archive leaderboard report
RGB Salient Object Detection DUTS-TE UCNet-ABP MAE 0.034 #10 of 31 Archive leaderboard report
RGB Salient Object Detection DUTS-TE UCNet-ABP S-Measure 0.890 #10 of 31 Archive leaderboard report
RGB Salient Object Detection DUTS-TE UCNet-ABP mean E-Measure 0.931 #10 of 31 Archive leaderboard report
RGB Salient Object Detection DUTS-TE UCNet-ABP mean F-Measure 0.864 #10 of 31 Archive leaderboard report
RGB Salient Object Detection DUTS-TE UCNet-CVAE MAE 0.034 #11 of 31 Archive leaderboard report
RGB Salient Object Detection DUTS-TE UCNet-CVAE S-Measure 0.888 #11 of 31 Archive leaderboard report
RGB Salient Object Detection DUTS-TE UCNet-CVAE mean E-Measure 0.927 #11 of 31 Archive leaderboard report
RGB Salient Object Detection DUTS-TE UCNet-CVAE mean F-Measure 0.860 #11 of 31 Archive leaderboard report
RGB Salient Object Detection ECSSD UCNet-CVAE MAE 0.035 #6 of 14 Archive leaderboard report
RGB Salient Object Detection ECSSD UCNet-CVAE S-Measure 0.921 #6 of 14 Archive leaderboard report
RGB Salient Object Detection HKU-IS UCNet-CVAE MAE 0.026 #5 of 14 Archive leaderboard report
RGB Salient Object Detection HKU-IS UCNet-CVAE S-Measure 0.921 #5 of 14 Archive leaderboard report
RGB Salient Object Detection HKU-IS UCNet-ABP MAE 0.027 #6 of 14 Archive leaderboard report
RGB Salient Object Detection HKU-IS UCNet-ABP S-Measure 0.917 #6 of 14 Archive leaderboard report
RGB Salient Object Detection SOC UCNet-CVAE Average MAE 0.089 #1 of 7 Archive leaderboard report
RGB Salient Object Detection SOC UCNet-CVAE S-Measure 0.849 #1 of 7 Archive leaderboard report
RGB Salient Object Detection SOC UCNet-CVAE mean E-Measure 0.872 #1 of 7 Archive leaderboard report
RGB Salient Object Detection SOC UCNet-APB Average MAE 0.091 #2 of 7 Archive leaderboard report
RGB Salient Object Detection SOC UCNet-APB S-Measure 0.842 #2 of 7 Archive leaderboard report
RGB Salient Object Detection SOC UCNet-APB mean E-Measure 0.868 #2 of 7 Archive leaderboard report
RGB-D Salient Object Detection DES UCNet-ABP Average MAE 0.016 #3 of 13 Archive leaderboard report
RGB-D Salient Object Detection DES UCNet-ABP S-Measure 94.0 #3 of 13 Archive leaderboard report
RGB-D Salient Object Detection DES UCNet-CVAE Average MAE 0.016 #5 of 13 Archive leaderboard report
RGB-D Salient Object Detection DES UCNet-CVAE S-Measure 93.7 #5 of 13 Archive leaderboard report
RGB-D Salient Object Detection LFSD UCNet-CVAE Average MAE 0.065 #1 of 8 Archive leaderboard report
RGB-D Salient Object Detection LFSD UCNet-CVAE S-Measure 86.8 #1 of 8 Archive leaderboard report
RGB-D Salient Object Detection LFSD UCNet-ABP Average MAE 0.065 #3 of 8 Archive leaderboard report
RGB-D Salient Object Detection LFSD UCNet-ABP S-Measure 86.6 #3 of 8 Archive leaderboard report
RGB-D Salient Object Detection NJU2K UCNet-CVAE Average MAE 0.039 #12 of 27 Archive leaderboard report
RGB-D Salient Object Detection NJU2K UCNet-CVAE S-Measure 90.2 #12 of 27 Archive leaderboard report
RGB-D Salient Object Detection NJU2K UCNet-ABP Average MAE 0.039 #14 of 27 Archive leaderboard report
RGB-D Salient Object Detection NJU2K UCNet-ABP S-Measure 90.0 #14 of 27 Archive leaderboard report
RGB-D Salient Object Detection NLPR UCNet-ABP Average MAE 0.024 #10 of 14 Archive leaderboard report
RGB-D Salient Object Detection NLPR UCNet-ABP S-Measure 91.9 #10 of 14 Archive leaderboard report
RGB-D Salient Object Detection NLPR UCNet-CAVE Average MAE 0.025 #11 of 14 Archive leaderboard report
RGB-D Salient Object Detection NLPR UCNet-CAVE S-Measure 91.7 #11 of 14 Archive leaderboard report
RGB-D Salient Object Detection SIP UCNet-CVAE Average MAE 0.045 #7 of 16 Archive leaderboard report
RGB-D Salient Object Detection SIP UCNet-CVAE S-Measure 88.3 #7 of 16 Archive leaderboard report
RGB-D Salient Object Detection SIP UCNet-ABP Average MAE 0.049 #11 of 16 Archive leaderboard report
RGB-D Salient Object Detection SIP UCNet-ABP S-Measure 87.6 #11 of 16 Archive leaderboard report
RGB-D Salient Object Detection STERE UCNet-ABP Average MAE 0.037 #9 of 14 Archive leaderboard report
RGB-D Salient Object Detection STERE UCNet-ABP S-Measure 90.4 #9 of 14 Archive leaderboard report
RGB-D Salient Object Detection STERE UCNet-CVAE Average MAE 0.039 #13 of 14 Archive leaderboard report
RGB-D Salient Object Detection STERE UCNet-CVAE S-Measure 89.8 #13 of 14 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections