{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/explicit-visual-prompting-for-low-level","title":"Explicit Visual Prompting for Low-Level Structure Segmentations","arxiv_id":"2303.10883","date":"2023-03-20","proceeding":"CVPR 2023 1","authors":["Weihuang Liu","Xi Shen","Chi-Man Pun","Xiaodong Cun"],"abstract":"We consider the generic problem of detecting low-level structures in images, which includes segmenting the manipulated parts, identifying out-of-focus pixels, separating shadow regions, and detecting concealed objects. Whereas each such topic has been typically addressed with a domain-specific solution, we show that a unified approach performs well across all of them. We take inspiration from the widely-used pre-training and then prompt tuning protocols in NLP and propose a new visual prompting model, named Explicit Visual Prompting (EVP). Different from the previous visual prompting which is typically a dataset-level implicit embedding, our key insight is to enforce the tunable parameters focusing on the explicit visual content from each individual image, i.e., the features from frozen patch embeddings and the input's high-frequency components. The proposed EVP significantly outperforms other parameter-efficient tuning protocols under the same amount of tunable parameters (5.7% extra trainable parameters of each task). EVP also achieves state-of-the-art performances on diverse low-level structure segmentation tasks compared to task-specific solutions. Our code is available at: https://github.com/NiFangBaAGe/Explicit-Visual-Prompt.","url_abs":"https://arxiv.org/abs/2303.10883v2","url_pdf":"https://arxiv.org/pdf/2303.10883v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"explicit-visual-prompting-for-low-level","repo_url":"https://github.com/nifangbaage/explicit-visual-prompt","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":null}],"tasks":[{"task_slug":"camouflaged-object-segmentation","task_name":"Camouflaged Object Segmentation"},{"task_slug":"defocus-blur-detection","task_name":"Defocus Blur Detection"},{"task_slug":"foreground-segmentation","task_name":"Foreground Segmentation"},{"task_slug":"image-manipulation-detection","task_name":"Image Manipulation Detection"},{"task_slug":"salient-object-detection-1","task_name":"Salient Object Detection"},{"task_slug":"shadow-detection","task_name":"Shadow Detection"},{"task_slug":"visual-prompting","task_name":"Visual Prompting"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[{"leaderboard":"/sota/camouflaged-object-segmentation-on-camo","task":"Camouflaged Object Segmentation","dataset":"CAMO","model":"EVPv1","rank_in_archive_order":6,"of":14,"metrics":{"MAE":"0.059","S-Measure":"0.846","Weighted F-Measure":"0.777"},"uses_additional_data":false},{"leaderboard":"/sota/camouflaged-object-segmentation-on-cod","task":"Camouflaged Object Segmentation","dataset":"COD","model":"EVPv1","rank_in_archive_order":7,"of":12,"metrics":{"MAE":"0.029","S-Measure":"0.843","Weighted F-Measure":"0.742"},"uses_additional_data":false},{"leaderboard":"/sota/salient-object-detection-on-ecssd-1","task":"Salient Object Detection","dataset":"ECSSD","model":"EVPv1","rank_in_archive_order":4,"of":10,"metrics":{"E-measure":"0.957","MAE":"0.027","S-measure":"0.935","max_F1":"0.960"},"uses_additional_data":false},{"leaderboard":"/sota/salient-object-detection-on-hku-is-1","task":"Salient Object Detection","dataset":"HKU-IS","model":"EVPv1","rank_in_archive_order":4,"of":9,"metrics":{"E-measure":"0.961","MAE":"0.024","S-measure":"0.931","max_F1":"0.952"},"uses_additional_data":false},{"leaderboard":"/sota/salient-object-detection-on-pascal-s-1","task":"Salient Object Detection","dataset":"PASCAL-S","model":"EVPv1","rank_in_archive_order":4,"of":10,"metrics":{"E-measure":"0.917","MAE":"0.054","S-measure":"0.878","max_F1":"0.872"},"uses_additional_data":false}],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2303.10883","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2303.10883"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/nifangbaage/explicit-visual-prompt","reach":null}],"summary":{"ran":4},"by_repo_kind":{"official":{"samples":4,"ran":4,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"f8888ddf26984020","entry":"GaussianFilter","repo":"nifangbaage/explicit-visual-prompt","repo_kind":"official","path":"models/mmseg/models/backbones/mix_transformer_evp.py","file_url":"https://github.com/nifangbaage/explicit-visual-prompt/blob/HEAD/models/mmseg/models/backbones/mix_transformer_evp.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"BSD-3-Clause","inline_ok":true,"mcp_get_code":{"code_sha256":"f8888ddf26984020"}},{"code_sha256_prefix":"fd382d2bcab3fdde","entry":"OverlapPatchEmbed","repo":"nifangbaage/explicit-visual-prompt","repo_kind":"official","path":"models/mmseg/models/backbones/mix_transformer_evp.py","file_url":"https://github.com/nifangbaage/explicit-visual-prompt/blob/HEAD/models/mmseg/models/backbones/mix_transformer_evp.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"BSD-3-Clause","inline_ok":true,"mcp_get_code":{"code_sha256":"fd382d2bcab3fdde"}},{"code_sha256_prefix":"1260af12c9528947","entry":"PromptGenerator","repo":"nifangbaage/explicit-visual-prompt","repo_kind":"official","path":"models/mmseg/models/backbones/mix_transformer_evp.py","file_url":"https://github.com/nifangbaage/explicit-visual-prompt/blob/HEAD/models/mmseg/models/backbones/mix_transformer_evp.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"BSD-3-Clause","inline_ok":true,"mcp_get_code":{"code_sha256":"1260af12c9528947"}},{"code_sha256_prefix":"899db2d7c10da202","entry":"SRMFilter","repo":"nifangbaage/explicit-visual-prompt","repo_kind":"official","path":"models/mmseg/models/backbones/mix_transformer_evp.py","file_url":"https://github.com/nifangbaage/explicit-visual-prompt/blob/HEAD/models/mmseg/models/backbones/mix_transformer_evp.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"BSD-3-Clause","inline_ok":true,"mcp_get_code":{"code_sha256":"899db2d7c10da202"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}