Papers › Pyramid Dilated Deeper ConvLSTM for Video Salient Object Detection

Pyramid Dilated Deeper ConvLSTM for Video Salient Object Detection

1 Sep 2018ECCV 2018 9archive 2025-07-28

Hongmei Song, Wenguan Wang, Sanyuan Zhao, Jianbing Shen, Kin-Man Lam

This paper proposes a fast video salient object detection model, based on a novel recurrent network architecture, named Pyramid Dilated Bidirectional ConvLSTM (PDB-ConvLSTM). A Pyramid Dilated Convolution (PDC) module is first designed for simultaneously extracting spatial features at multiple scales. These spatial features are then concatenated and fed into an extended Deeper Bidirectional ConvLSTM (DB-ConvLSTM) to learn spatiotemporal information. Forward and backward ConvLSTM units are placed in two layers and connected in a cascaded way, encouraging information flow between the bi-directional streams and leading to deeper feature extraction. We further augment DB-ConvLSTM with a PDC-like structure, by adopting several dilated DB-ConvLSTMs to extract multi-scale spatiotemporal information. Extensive experimental results show that our method outperforms previous video saliency models in a large margin, with a real-time speed of 20 fps on a single GPU. With unsupervised video object segmentation as an example application, the proposed model (with a CRF-based post-process) achieves state-of-the-art results on two popular benchmarks, well demonstrating its superior performance and high applicability.

PaperPDF

Code

No code repository is listed for this paper in the archive or in Syntology's graph.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

ObjectObject DetectionRGB Salient Object DetectionSalient Object DetectionSemantic SegmentationUnsupervised Video Object SegmentationVideo Object SegmentationVideo Salient Object DetectionVideo Semantic Segmentationobject-detection

1 archive task tag without a task page not shown.

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Unsupervised Video Object Segmentation DAVIS 2016 val PDB F 74.5 #25 of 25 Archive leaderboard report
Unsupervised Video Object Segmentation DAVIS 2016 val PDB G 75.9 #25 of 25 Archive leaderboard report
Unsupervised Video Object Segmentation DAVIS 2016 val PDB J 77.2 #25 of 25 Archive leaderboard report
Unsupervised Video Object Segmentation DAVIS 2017 (test-dev) PDB F-measure (Decay) 3.7 #5 of 6 Archive leaderboard report
Unsupervised Video Object Segmentation DAVIS 2017 (test-dev) PDB F-measure (Mean) 43.0 #5 of 6 Archive leaderboard report
Unsupervised Video Object Segmentation DAVIS 2017 (test-dev) PDB F-measure (Recall) 44.6 #5 of 6 Archive leaderboard report
Unsupervised Video Object Segmentation DAVIS 2017 (test-dev) PDB J&F 40.4 #5 of 6 Archive leaderboard report
Unsupervised Video Object Segmentation DAVIS 2017 (test-dev) PDB Jaccard (Decay) 4.0 #5 of 6 Archive leaderboard report
Unsupervised Video Object Segmentation DAVIS 2017 (test-dev) PDB Jaccard (Mean) 37.7 #5 of 6 Archive leaderboard report
Unsupervised Video Object Segmentation DAVIS 2017 (test-dev) PDB Jaccard (Recall) 42.6 #5 of 6 Archive leaderboard report
Unsupervised Video Object Segmentation DAVIS 2017 (val) PDB F-measure (Mean) 57.0 #9 of 10 Archive leaderboard report
Unsupervised Video Object Segmentation DAVIS 2017 (val) PDB F-measure (Recall) 60.2 #9 of 10 Archive leaderboard report
Unsupervised Video Object Segmentation DAVIS 2017 (val) PDB J&F 55.1 #9 of 10 Archive leaderboard report
Unsupervised Video Object Segmentation DAVIS 2017 (val) PDB Jaccard (Mean) 53.2 #9 of 10 Archive leaderboard report
Unsupervised Video Object Segmentation DAVIS 2017 (val) PDB Jaccard (Recall) 58.9 #9 of 10 Archive leaderboard report
Unsupervised Video Object Segmentation FBMS test PDB J 74.0 #15 of 15 Archive leaderboard report
Unsupervised Video Object Segmentation YouTube-Objects PDB J 65.5 #16 of 16 Archive leaderboard report
Video Salient Object Detection DAVIS-2016 PDB AVERAGE MAE 0.028 #6 of 11 Archive leaderboard report
Video Salient Object Detection DAVIS-2016 PDB MAX E-MEASURE 0.951 #6 of 11 Archive leaderboard report
Video Salient Object Detection DAVIS-2016 PDB S-Measure 0.882 #6 of 11 Archive leaderboard report
Video Salient Object Detection DAVSOD-Difficult20 PDB Average MAE 0.107 #3 of 8 Archive leaderboard report
Video Salient Object Detection DAVSOD-Difficult20 PDB S-Measure 0.608 #3 of 8 Archive leaderboard report
Video Salient Object Detection DAVSOD-Difficult20 PDB max E-measure 0.678 #3 of 8 Archive leaderboard report
Video Salient Object Detection DAVSOD-Normal25 PDB Average MAE 0.132 #2 of 8 Archive leaderboard report
Video Salient Object Detection DAVSOD-Normal25 PDB S-Measure 0.649 #2 of 8 Archive leaderboard report
Video Salient Object Detection DAVSOD-Normal25 PDB max E-measure 0.698 #2 of 8 Archive leaderboard report
Video Salient Object Detection DAVSOD-easy35 PDB Average MAE 0.114 #3 of 9 Archive leaderboard report
Video Salient Object Detection DAVSOD-easy35 PDB S-Measure 0.706 #3 of 9 Archive leaderboard report
Video Salient Object Detection DAVSOD-easy35 PDB max E-Measure 0.749 #3 of 9 Archive leaderboard report
Video Salient Object Detection DAVSOD-easy35 PDB max F-Measure 0.591 #3 of 9 Archive leaderboard report
Video Salient Object Detection FBMS-59 PDB AVERAGE MAE 0.064 #6 of 16 Archive leaderboard report
Video Salient Object Detection FBMS-59 PDB MAX F-MEASURE 0.821 #6 of 16 Archive leaderboard report
Video Salient Object Detection FBMS-59 PDB S-Measure 0.851 #6 of 16 Archive leaderboard report
Video Salient Object Detection MCL PDB AVERAGE MAE 0.021 #1 of 8 Archive leaderboard report
Video Salient Object Detection MCL PDB MAX E-MEASURE 0.911 #1 of 8 Archive leaderboard report
Video Salient Object Detection MCL PDB S-Measure 0.856 #1 of 8 Archive leaderboard report
Video Salient Object Detection SegTrack v2 PDB AVERAGE MAE 0.024 #2 of 8 Archive leaderboard report
Video Salient Object Detection SegTrack v2 PDB S-Measure 0.864 #2 of 8 Archive leaderboard report
Video Salient Object Detection SegTrack v2 PDB max E-measure 0.935 #2 of 8 Archive leaderboard report
Video Salient Object Detection UVSD PDB Average MAE 0.018 #1 of 8 Archive leaderboard report
Video Salient Object Detection UVSD PDB S-Measure 0.901 #1 of 8 Archive leaderboard report
Video Salient Object Detection UVSD PDB max E-measure 0.975 #1 of 8 Archive leaderboard report
Video Salient Object Detection VOS-T PDB Average MAE 0.078 #3 of 9 Archive leaderboard report
Video Salient Object Detection VOS-T PDB S-Measure 0.818 #3 of 9 Archive leaderboard report
Video Salient Object Detection VOS-T PDB max E-measure 0.837 #3 of 9 Archive leaderboard report
Video Salient Object Detection ViSal PDB Average MAE 0.032 #4 of 10 Archive leaderboard report
Video Salient Object Detection ViSal PDB S-Measure 0.907 #4 of 10 Archive leaderboard report
Video Salient Object Detection ViSal PDB max E-measure 0.846 #4 of 10 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Methods

ConvLSTMConvolutionDilated ConvolutionSPEEDSigmoid ActivationTanh Activation

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections