{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/image-manipulation-detection-by-multi-view","title":"Image Manipulation Detection by Multi-View Multi-Scale Supervision","arxiv_id":"2104.06832","date":"2021-04-14","proceeding":"ICCV 2021 10","authors":["Xinru Chen","Chengbo Dong","Jiaqi Ji","Juan Cao","Xirong Li"],"abstract":"The key challenge of image manipulation detection is how to learn generalizable features that are sensitive to manipulations in novel data, whilst specific to prevent false alarms on authentic images. Current research emphasizes the sensitivity, with the specificity overlooked. In this paper we address both aspects by multi-view feature learning and multi-scale supervision. By exploiting noise distribution and boundary artifact surrounding tampered regions, the former aims to learn semantic-agnostic and thus more generalizable features. The latter allows us to learn from authentic images which are nontrivial to be taken into account by current semantic segmentation network based methods. Our thoughts are realized by a new network which we term MVSS-Net. Extensive experiments on five benchmark sets justify the viability of MVSS-Net for both pixel-level and image-level manipulation detection.","url_abs":"https://arxiv.org/abs/2104.06832v2","url_pdf":"https://arxiv.org/pdf/2104.06832v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"image-manipulation-detection-by-multi-view","repo_url":"https://github.com/dong03/MVSS-Net","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok"}},{"paper_slug":"image-manipulation-detection-by-multi-view","repo_url":"https://github.com/dddb11/MVSS-Net","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"pytorch","reach":null}],"tasks":[{"task_slug":"image-manipulation","task_name":"Image Manipulation"},{"task_slug":"image-manipulation-detection","task_name":"Image Manipulation Detection"},{"task_slug":"image-manipulation-localization","task_name":"Image Manipulation Localization"},{"task_slug":"semantic-segmentation","task_name":"Semantic Segmentation"},{"task_slug":"specificity","task_name":"Specificity"}],"methods":[],"datasets_introduced":[{"slug":"casia-v1","name":"Casia V1+","full_name":""}],"methods_introduced":[],"results":[{"leaderboard":"/sota/image-manipulation-detection-on-coverage","task":"Image Manipulation Detection","dataset":"COVERAGE","model":"MVSS-Net","rank_in_archive_order":5,"of":8,"metrics":{"AUC":".733","Balanced Accuracy":".514"},"uses_additional_data":false},{"leaderboard":"/sota/image-manipulation-detection-on-casia-v1","task":"Image Manipulation Detection","dataset":"Casia V1+","model":"MVSS-Net","rank_in_archive_order":5,"of":9,"metrics":{"AUC":".932","Balanced Accuracy":".528"},"uses_additional_data":false},{"leaderboard":"/sota/image-manipulation-detection-on-cocoglide","task":"Image Manipulation Detection","dataset":"CocoGlide","model":"MVSS-Net","rank_in_archive_order":8,"of":8,"metrics":{"AUC":".654","Balanced Accuracy":".117"},"uses_additional_data":false},{"leaderboard":"/sota/image-manipulation-detection-on-columbia","task":"Image Manipulation Detection","dataset":"Columbia","model":"MVSS-Net","rank_in_archive_order":5,"of":8,"metrics":{"AUC":".984","Balanced Accuracy":".729"},"uses_additional_data":false},{"leaderboard":"/sota/image-manipulation-detection-on-dso-1","task":"Image Manipulation Detection","dataset":"DSO-1","model":"MVSS-Net","rank_in_archive_order":6,"of":9,"metrics":{"AUC":".552","Balanced Accuracy":".358"},"uses_additional_data":false},{"leaderboard":"/sota/image-manipulation-localization-on-coverage","task":"Image Manipulation Localization","dataset":"COVERAGE","model":"MVSS-Net","rank_in_archive_order":7,"of":11,"metrics":{"Average Pixel F1(Fixed threshold)":".514"},"uses_additional_data":false},{"leaderboard":"/sota/image-manipulation-localization-on-casia-v1","task":"Image Manipulation Localization","dataset":"Casia V1+","model":"MVSS-Net","rank_in_archive_order":8,"of":11,"metrics":{"Average Pixel F1(Fixed threshold)":".528"},"uses_additional_data":false},{"leaderboard":"/sota/image-manipulation-localization-on-cocoglide","task":"Image Manipulation Localization","dataset":"CocoGlide","model":"MVSS-Net","rank_in_archive_order":8,"of":11,"metrics":{"Average Pixel F1(Fixed threshold)":".486"},"uses_additional_data":false},{"leaderboard":"/sota/image-manipulation-localization-on-columbia","task":"Image Manipulation Localization","dataset":"Columbia","model":"MVSS-Net","rank_in_archive_order":9,"of":11,"metrics":{"Average Pixel F1(Fixed threshold)":".729"},"uses_additional_data":false},{"leaderboard":"/sota/image-manipulation-localization-on-dso-1","task":"Image Manipulation Localization","dataset":"DSO-1","model":"MVSS-Net","rank_in_archive_order":9,"of":11,"metrics":{"Average Pixel F1(Fixed threshold)":".358"},"uses_additional_data":false}],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2104.06832","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2104.06832"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/dong03/MVSS-Net","reach":{"status":"ok"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/dddb11/MVSS-Net","reach":null}],"summary":{"ran":7,"ran_draft_wrong":1,"ran_fixture":1,"unverified":4},"by_repo_kind":{"listed":{"samples":13,"ran":9,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":13,"samples":[{"code_sha256_prefix":"c469afb90ce9cd96","entry":"BayarConv2d","repo":"dddb11/MVSS-Net","repo_kind":"listed","path":"models/mvssnet.py","file_url":"https://github.com/dddb11/MVSS-Net/blob/HEAD/models/mvssnet.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"c469afb90ce9cd96"}},{"code_sha256_prefix":"e432930680d7b4f8","entry":"Bottleneck","repo":"dddb11/MVSS-Net","repo_kind":"listed","path":"models/mvssnet.py","file_url":"https://github.com/dddb11/MVSS-Net/blob/HEAD/models/mvssnet.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"invariant","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"e432930680d7b4f8"}},{"code_sha256_prefix":"3581f82d3aee559a","entry":"ERB","repo":"dddb11/MVSS-Net","repo_kind":"listed","path":"models/mvssnet.py","file_url":"https://github.com/dddb11/MVSS-Net/blob/HEAD/models/mvssnet.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"3581f82d3aee559a"}},{"code_sha256_prefix":"667a6a18f99f5023","entry":"_ChannelAttentionModule","repo":"dddb11/MVSS-Net","repo_kind":"listed","path":"models/mvssnet.py","file_url":"https://github.com/dddb11/MVSS-Net/blob/HEAD/models/mvssnet.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"667a6a18f99f5023"}},{"code_sha256_prefix":"b214075bd517a861","entry":"_PositionAttentionModule","repo":"dddb11/MVSS-Net","repo_kind":"listed","path":"models/mvssnet.py","file_url":"https://github.com/dddb11/MVSS-Net/blob/HEAD/models/mvssnet.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"invariant","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"b214075bd517a861"}},{"code_sha256_prefix":"651f53dd4f7e2c7c","entry":"get_sobel","repo":"dddb11/MVSS-Net","repo_kind":"listed","path":"models/mvssnet.py","file_url":"https://github.com/dddb11/MVSS-Net/blob/HEAD/models/mvssnet.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"651f53dd4f7e2c7c"}},{"code_sha256_prefix":"347edfdb24594db1","entry":"resnet","repo":"dddb11/MVSS-Net","repo_kind":"listed","path":"models/mvssnet.py","file_url":"https://github.com/dddb11/MVSS-Net/blob/HEAD/models/mvssnet.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"347edfdb24594db1"}},{"code_sha256_prefix":"b35342be7644a30d","entry":"rgb2gray","repo":"dddb11/MVSS-Net","repo_kind":"listed","path":"models/mvssnet.py","file_url":"https://github.com/dddb11/MVSS-Net/blob/HEAD/models/mvssnet.py","link_basis":"first_harvest_node","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"b35342be7644a30d"}},{"code_sha256_prefix":"487884cadfe96c20","entry":"run_sobel","repo":"dddb11/MVSS-Net","repo_kind":"listed","path":"models/mvssnet.py","file_url":"https://github.com/dddb11/MVSS-Net/blob/HEAD/models/mvssnet.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"487884cadfe96c20"}},{"code_sha256_prefix":"d454078d41b0ac8a","entry":"MVSSNet","repo":"dddb11/MVSS-Net","repo_kind":"listed","path":"models/mvssnet.py","file_url":"https://github.com/dddb11/MVSS-Net/blob/HEAD/models/mvssnet.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"d454078d41b0ac8a"}},{"code_sha256_prefix":"265e41c87f161ef2","entry":"ResNet","repo":"dddb11/MVSS-Net","repo_kind":"listed","path":"models/mvssnet.py","file_url":"https://github.com/dddb11/MVSS-Net/blob/HEAD/models/mvssnet.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"265e41c87f161ef2"}},{"code_sha256_prefix":"b909864635991eb1","entry":"ResNet50","repo":"dddb11/MVSS-Net","repo_kind":"listed","path":"models/mvssnet.py","file_url":"https://github.com/dddb11/MVSS-Net/blob/HEAD/models/mvssnet.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"b909864635991eb1"}},{"code_sha256_prefix":"3e3f2fa2e378bd8b","entry":"_DAHead","repo":"dddb11/MVSS-Net","repo_kind":"listed","path":"models/mvssnet.py","file_url":"https://github.com/dddb11/MVSS-Net/blob/HEAD/models/mvssnet.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"3e3f2fa2e378bd8b"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}