{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/contextual-encoder-decoder-network-for-visual","title":"Contextual Encoder-Decoder Network for Visual Saliency Prediction","arxiv_id":"1902.06634","date":"2019-02-18","proceeding":null,"authors":["Alexander Kroner","Mario Senden","Kurt Driessens","Rainer Goebel"],"abstract":"Predicting salient regions in natural images requires the detection of objects that are present in a scene. To develop robust representations for this challenging task, high-level visual features at multiple spatial scales must be extracted and augmented with contextual information. However, existing models aimed at explaining human fixation maps do not incorporate such a mechanism explicitly. Here we propose an approach based on a convolutional neural network pre-trained on a large-scale image classification task. The architecture forms an encoder-decoder structure and includes a module with multiple convolutional layers at different dilation rates to capture multi-scale features in parallel. Moreover, we combine the resulting representations with global scene information for accurately predicting visual saliency. Our model achieves competitive and consistent results across multiple evaluation metrics on two public saliency benchmarks and we demonstrate the effectiveness of the suggested approach on five datasets and selected examples. Compared to state of the art approaches, the network is based on a lightweight image classification backbone and hence presents a suitable choice for applications with limited computational resources, such as (virtual) robotic systems, to estimate human fixations across complex natural scenes.","url_abs":"https://arxiv.org/abs/1902.06634v4","url_pdf":"https://arxiv.org/pdf/1902.06634v4.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"contextual-encoder-decoder-network-for-visual","repo_url":"https://github.com/alexanderkroner/saliency","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"tf","reach":{"status":"ok","spdx":"MIT"}},{"paper_slug":"contextual-encoder-decoder-network-for-visual","repo_url":"https://github.com/gradio-app/saliency","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"tf","reach":{"status":"ok","spdx":"MIT"}},{"paper_slug":"contextual-encoder-decoder-network-for-visual","repo_url":"https://github.com/nvinden/7ChannelEML","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"tf","reach":{"status":"ok","spdx":"MIT"}},{"paper_slug":"contextual-encoder-decoder-network-for-visual","repo_url":"https://github.com/yahsieh37/Visual-Saliency-Prediction","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"tf","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[{"task_slug":"decoder","task_name":"Decoder"},{"task_slug":"classification","task_name":"General Classification"},{"task_slug":"image-classification","task_name":"Image Classification"},{"task_slug":"prediction","task_name":"Prediction"},{"task_slug":"saliency-prediction","task_name":"Saliency Prediction"},{"task_slug":"video-saliency-detection","task_name":"Video Saliency Detection"},{"task_slug":"image-classification","task_name":"image-classification"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[{"leaderboard":"/sota/video-saliency-detection-on-msu-video","task":"Video Saliency Detection","dataset":"MSU Video Saliency Prediction","model":"MSI-Net (dutomron)","rank_in_archive_order":5,"of":14,"metrics":{"AUC-J":"0.852","CC":"0.690","FPS":"1.28","KLDiv":"0.537","NSS":"1.82","SIM":"0.607"},"uses_additional_data":false}],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=1902.06634","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1902.06634"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/nvinden/7ChannelEML","reach":{"status":"ok","spdx":"MIT"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/yahsieh37/Visual-Saliency-Prediction","reach":{"status":"ok","spdx":"MIT"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/alexanderkroner/saliency","reach":{"status":"ok","spdx":"MIT"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/gradio-app/saliency","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"unverified":6},"by_repo_kind":{"official":{"samples":2,"ran":0,"repositories":1},"listed":{"samples":4,"ran":0,"repositories":2}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"9c443f7129e629ea","entry":"best_window","repo":"gradio-app/saliency","repo_kind":"listed","path":"run-gradio.py","file_url":"https://github.com/gradio-app/saliency/blob/HEAD/run-gradio.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"9c443f7129e629ea"}},{"code_sha256_prefix":"691d327878968b6f","entry":"define_paths","repo":"yahsieh37/Visual-Saliency-Prediction","repo_kind":"listed","path":"main_bn.py","file_url":"https://github.com/yahsieh37/Visual-Saliency-Prediction/blob/HEAD/main_bn.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"691d327878968b6f"}},{"code_sha256_prefix":"322172a6d004fad1","entry":"define_paths","repo":"yahsieh37/Visual-Saliency-Prediction","repo_kind":"listed","path":"main_sc.py","file_url":"https://github.com/yahsieh37/Visual-Saliency-Prediction/blob/HEAD/main_sc.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"322172a6d004fad1"}},{"code_sha256_prefix":"9dab209344bbb498","entry":"kld","repo":"alexanderkroner/saliency","repo_kind":"official","path":"loss.py","file_url":"https://github.com/alexanderkroner/saliency/blob/HEAD/loss.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"9dab209344bbb498"}},{"code_sha256_prefix":"5fe9cf5eb2f32b05","entry":"overlay_saliency","repo":"gradio-app/saliency","repo_kind":"listed","path":"run-gradio.py","file_url":"https://github.com/gradio-app/saliency/blob/HEAD/run-gradio.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"5fe9cf5eb2f32b05"}},{"code_sha256_prefix":"d3834cb8ddc46b5d","entry":"postprocess_saliency_map","repo":"alexanderkroner/saliency","repo_kind":"official","path":"data.py","file_url":"https://github.com/alexanderkroner/saliency/blob/HEAD/data.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"d3834cb8ddc46b5d"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}