Papers › PiCANet: Learning Pixel-wise Contextual Attention for Saliency Detection

PiCANet: Learning Pixel-wise Contextual Attention for Saliency Detection

21 Aug 2017CVPR 2018 6arXiv:1708.06433archive 2025-07-28

Nian Liu, Junwei Han, Ming-Hsuan Yang

Contexts play an important role in the saliency detection task. However, given a context region, not all contextual information is helpful for the final task. In this paper, we propose a novel pixel-wise contextual attention network, i.e., the PiCANet, to learn to selectively attend to informative context locations for each pixel. Specifically, for each pixel, it can generate an attention map in which each attention weight corresponds to the contextual relevance at each context location. An attended contextual feature can then be constructed by selectively aggregating the contextual information. We formulate the proposed PiCANet in both global and local forms to attend to global and local contexts, respectively. Both models are fully differentiable and can be embedded into CNNs for joint training. We also incorporate the proposed models with the U-Net architecture to detect salient objects. Extensive experiments show that the proposed PiCANets can consistently improve saliency detection performance. The global and local PiCANets facilitate learning global contrast and homogeneousness, respectively. As a result, our saliency model can detect salient objects more accurately and uniformly, thus performing favorably against the state-of-the-art methods.

PaperPDFConference PDFCode

Code

Ugness/PiCANet-Implementation mentioned on GitHubpytorch report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

RGB Salient Object DetectionSaliency Detection

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
RGB Salient Object Detection DUTS-TE PiCANet MAE 0.050 #15 of 31 Archive leaderboard report
RGB Salient Object Detection DUTS-TE PiCANet S-Measure 0.842 #15 of 31 Archive leaderboard report
RGB Salient Object Detection DUTS-TE PiCANet max F-measure 0.863 #15 of 31 Archive leaderboard report
RGB Salient Object Detection DUTS-TE PiCANet mean E-Measure 0.853 #15 of 31 Archive leaderboard report
RGB Salient Object Detection DUTS-TE PiCANet mean F-Measure 0.757 #15 of 31 Archive leaderboard report
RGB Salient Object Detection SOC PiCANet Average MAE 0.133 #7 of 7 Archive leaderboard report
RGB Salient Object Detection SOC PiCANet S-Measure 0.801 #7 of 7 Archive leaderboard report
RGB Salient Object Detection SOC PiCANet mean E-Measure 0.810 #7 of 7 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Methods

Concatenated Skip ConnectionConvolutionMax PoolingReLUU-Net

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections