{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/mantra-net-manipulation-tracing-network-for","title":"ManTra-Net: Manipulation Tracing Network for Detection and Localization of Image Forgeries With Anomalous Features","arxiv_id":null,"date":"2019-06-01","proceeding":"CVPR 2019 6","authors":["Yue Wu"," Wael AbdAlmageed"," Premkumar Natarajan"],"abstract":"   To fight against real-life image forgery, which  commonly involves different types and combined manipulations, we propose a unified deep neural architecture called ManTra-Net. Unlike many existing solutions, ManTra-Net is an end-to-end network that performs both detection and localization without extra preprocessing and postprocessing. \\manifold   is a fully convolutional network and handles images of arbitrary sizes and many known forgery types such splicing, copy-move, removal, enhancement, and even unknown types. This paper has three salient contributions. We design a simple yet effective self-supervised learning task to learn robust image manipulation traces from classifying 385 image manipulation types. Further, we formulate the forgery localization problem as a local anomaly detection problem, design a Z-score feature to capture local anomaly, and propose a novel long short-term memory solution to assess local anomalies. Finally, we carefully conduct ablation experiments to systematically optimize the proposed network design. Our extensive experimental results demonstrate the generalizability, robustness and superiority of ManTra-Net, not only in single types of manipulations/forgeries, but also in their complicated combinations. \r","url_abs":"http://openaccess.thecvf.com/content_CVPR_2019/html/Wu_ManTra-Net_Manipulation_Tracing_Network_for_Detection_and_Localization_of_Image_CVPR_2019_paper.html","url_pdf":"http://openaccess.thecvf.com/content_CVPR_2019/papers/Wu_ManTra-Net_Manipulation_Tracing_Network_for_Detection_and_Localization_of_Image_CVPR_2019_paper.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"mantra-net-manipulation-tracing-network-for","repo_url":"https://github.com/ISICV/ManTraNet","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"tf","reach":null},{"paper_slug":"mantra-net-manipulation-tracing-network-for","repo_url":"https://github.com/RonyAbecidan/Mantranet-pytorch","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"pytorch","reach":null},{"paper_slug":"mantra-net-manipulation-tracing-network-for","repo_url":"https://github.com/SunnyHaze/ManTraNet-Pytorch","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"pytorch","reach":null}],"tasks":[{"task_slug":"anomaly-detection","task_name":"Anomaly Detection"},{"task_slug":"fake-image-detection","task_name":"Fake Image Detection"},{"task_slug":"image-forensics","task_name":"Image Forensics"},{"task_slug":"image-manipulation","task_name":"Image Manipulation"},{"task_slug":"image-manipulation-detection","task_name":"Image Manipulation Detection"},{"task_slug":"image-manipulation-localization","task_name":"Image Manipulation Localization"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[{"leaderboard":"/sota/image-manipulation-detection-on-casia-osn","task":"Image Manipulation Detection","dataset":"CASIA (OSN-transmitted - Facebook)","model":"Mantra-Net","rank_in_archive_order":3,"of":4,"metrics":{"AUC":"0.763","F-score":"0.102","Intersection over Union":"0 .065"},"uses_additional_data":false},{"leaderboard":"/sota/image-manipulation-detection-on-casia-osn-1","task":"Image Manipulation Detection","dataset":"CASIA (OSN-transmitted - Wechat)","model":"ManTra-Net","rank_in_archive_order":3,"of":4,"metrics":{"AUC":"0.724","Intersection over Union":"0.080","f-Score":"0.048"},"uses_additional_data":false},{"leaderboard":"/sota/image-manipulation-detection-on-casia-osn-3","task":"Image Manipulation Detection","dataset":"CASIA (OSN-transmitted - Weibo)","model":"ManTra-Net","rank_in_archive_order":3,"of":4,"metrics":{"AUC":"0.754","Intersection over Union":"0.063","f-Score":"0.099"},"uses_additional_data":false},{"leaderboard":"/sota/image-manipulation-detection-on-casia-osn-2","task":"Image Manipulation Detection","dataset":"CASIA (OSN-transmitted - Whatsapp)","model":"ManTra-Net","rank_in_archive_order":3,"of":4,"metrics":{"AUC":"0.763","Intersection over Union":"0.063","f-Score":"0.099"},"uses_additional_data":false},{"leaderboard":"/sota/image-manipulation-detection-on-coverage","task":"Image Manipulation Detection","dataset":"COVERAGE","model":"ManTraNet","rank_in_archive_order":6,"of":8,"metrics":{"AUC":".760","Balanced Accuracy":".500"},"uses_additional_data":false},{"leaderboard":"/sota/image-manipulation-detection-on-casia-v1","task":"Image Manipulation Detection","dataset":"Casia V1+","model":"ManTraNet","rank_in_archive_order":6,"of":9,"metrics":{"AUC":".644","Balanced Accuracy":".500"},"uses_additional_data":false},{"leaderboard":"/sota/image-manipulation-detection-on-cocoglide","task":"Image Manipulation Detection","dataset":"CocoGlide","model":"ManTraNet","rank_in_archive_order":5,"of":8,"metrics":{"AUC":".778","Balanced Accuracy":".500"},"uses_additional_data":false},{"leaderboard":"/sota/image-manipulation-detection-on-columbia","task":"Image Manipulation Detection","dataset":"Columbia","model":"ManTraNet","rank_in_archive_order":7,"of":8,"metrics":{"AUC":".810","Balanced Accuracy":".500"},"uses_additional_data":false},{"leaderboard":"/sota/image-manipulation-detection-on-columbia-osn","task":"Image Manipulation Detection","dataset":"Columbia (OSN-transmitted - Facebook)","model":"ManTra-Net","rank_in_archive_order":3,"of":4,"metrics":{"AUC":"0.626","Intersection over Union":"0.056","f-Score":"0.103"},"uses_additional_data":false},{"leaderboard":"/sota/image-manipulation-detection-on-columbia-osn-1","task":"Image Manipulation Detection","dataset":"Columbia (OSN-transmitted - Wechat)","model":"ManTra-Net","rank_in_archive_order":4,"of":4,"metrics":{"AUC":"0.613","Intersection over Union":"0.125","f-Score":"0.199"},"uses_additional_data":false},{"leaderboard":"/sota/image-manipulation-detection-on-columbia-osn-3","task":"Image Manipulation Detection","dataset":"Columbia (OSN-transmitted - Weibo)","model":"ManTra-Net","rank_in_archive_order":3,"of":4,"metrics":{"AUC":"0.620","Intersection over Union":"0.056","f-Score":"0.103"},"uses_additional_data":false},{"leaderboard":"/sota/image-manipulation-detection-on-columbia-osn-2","task":"Image Manipulation Detection","dataset":"Columbia (OSN-transmitted - Whatsapp)","model":"ManTra-Net","rank_in_archive_order":3,"of":4,"metrics":{"AUC":"0.630","Intersection over Union":"0.052","f-Score":"0.098"},"uses_additional_data":false},{"leaderboard":"/sota/image-manipulation-detection-on-dso-osn","task":"Image Manipulation Detection","dataset":"DSO (OSN-transmitted - Facebook)","model":"ManTra-Net","rank_in_archive_order":4,"of":4,"metrics":{"AUC":"0.638","Intersection over Union":"0.071","f-Score":"0.109"},"uses_additional_data":false},{"leaderboard":"/sota/image-manipulation-detection-on-dso-osn-1","task":"Image Manipulation Detection","dataset":"DSO (OSN-transmitted - Wechat)","model":"ManTra-Net","rank_in_archive_order":3,"of":4,"metrics":{"AUC":"0.582","Intersection over Union":"0.045","f-Score":"0.076"},"uses_additional_data":false},{"leaderboard":"/sota/image-manipulation-detection-on-dso-osn-3","task":"Image Manipulation Detection","dataset":"DSO (OSN-transmitted - Weibo)","model":"ManTra-Net","rank_in_archive_order":3,"of":4,"metrics":{"AUC":"0.606","Intersection over Union":"0.036","f-Score":"0.057"},"uses_additional_data":false},{"leaderboard":"/sota/image-manipulation-detection-on-dso-osn-2","task":"Image Manipulation Detection","dataset":"DSO (OSN-transmitted - Whatsapp)","model":"ManTra-Net","rank_in_archive_order":3,"of":4,"metrics":{"AUC":"0.616","Intersection over Union":"0.052","f-Score":"0.081"},"uses_additional_data":false},{"leaderboard":"/sota/image-manipulation-detection-on-dso-1","task":"Image Manipulation Detection","dataset":"DSO-1","model":"ManTraNet","rank_in_archive_order":5,"of":9,"metrics":{"AUC":".874","Balanced Accuracy":".500"},"uses_additional_data":false},{"leaderboard":"/sota/image-manipulation-detection-on-nist-osn","task":"Image Manipulation Detection","dataset":"NIST (OSN-transmitted - Facebook)","model":"ManTra-Net","rank_in_archive_order":3,"of":4,"metrics":{"AUC":"0.652","Intersection over Union":"0.057","f-Score":"0.095"},"uses_additional_data":false},{"leaderboard":"/sota/image-manipulation-detection-on-nist-osn-1","task":"Image Manipulation Detection","dataset":"NIST (OSN-transmitted - Wechat)","model":"ManTra-Net","rank_in_archive_order":3,"of":4,"metrics":{"AUC":"0.654","Intersection over Union":"0.057","f-Score":"0.095"},"uses_additional_data":false},{"leaderboard":"/sota/image-manipulation-detection-on-nist-osn-3","task":"Image Manipulation Detection","dataset":"NIST (OSN-transmitted - Weibo)","model":"ManTra-Net","rank_in_archive_order":3,"of":4,"metrics":{"AUC":"0.671","Intersection over Union":"0.053","f-Score":"0.088"},"uses_additional_data":false},{"leaderboard":"/sota/image-manipulation-detection-on-nist-osn-2","task":"Image Manipulation Detection","dataset":"NIST (OSN-transmitted - Whatsapp)","model":"ManTra-Net","rank_in_archive_order":3,"of":4,"metrics":{"AUC":"0.702","Intersection over Union":"0.062","f-Score":"0.101"},"uses_additional_data":false},{"leaderboard":"/sota/image-manipulation-localization-on-casiav1","task":"Image Manipulation Localization","dataset":"CASIAv1(Protoclo-CAT)","model":"Mantra-Net","rank_in_archive_order":8,"of":8,"metrics":{"Pixel Binary F1":"0.327"},"uses_additional_data":false},{"leaderboard":"/sota/image-manipulation-localization-on-coverage","task":"Image Manipulation Localization","dataset":"COVERAGE","model":"ManTraNet","rank_in_archive_order":10,"of":11,"metrics":{"Average Pixel F1(Fixed threshold)":".317"},"uses_additional_data":false},{"leaderboard":"/sota/image-manipulation-localization-on-coverage-1","task":"Image Manipulation Localization","dataset":"COVERAGE(Protocol-CAT)","model":"Mantra-Net","rank_in_archive_order":8,"of":8,"metrics":{"Pixel Binary F1":"0.196"},"uses_additional_data":false},{"leaderboard":"/sota/image-manipulation-localization-on-casia-v1","task":"Image Manipulation Localization","dataset":"Casia V1+","model":"ManTraNet","rank_in_archive_order":10,"of":11,"metrics":{"Average Pixel F1(Fixed threshold)":".180"},"uses_additional_data":false},{"leaderboard":"/sota/image-manipulation-localization-on-cocoglide","task":"Image Manipulation Localization","dataset":"CocoGlide","model":"ManTraNet","rank_in_archive_order":6,"of":11,"metrics":{"Average Pixel F1(Fixed threshold)":".516"},"uses_additional_data":false},{"leaderboard":"/sota/image-manipulation-localization-on-columbia","task":"Image Manipulation Localization","dataset":"Columbia","model":"ManTraNet","rank_in_archive_order":11,"of":11,"metrics":{"Average Pixel F1(Fixed threshold)":".508"},"uses_additional_data":false},{"leaderboard":"/sota/image-manipulation-localization-on-columbia-1","task":"Image Manipulation Localization","dataset":"Columbia(Protocol-CAT)","model":"Mantra-Net","rank_in_archive_order":8,"of":8,"metrics":{"Pixel Binary F1":"0.462"},"uses_additional_data":false},{"leaderboard":"/sota/image-manipulation-localization-on-dso-1","task":"Image Manipulation Localization","dataset":"DSO-1","model":"ManTraNet","rank_in_archive_order":8,"of":11,"metrics":{"Average Pixel F1(Fixed threshold)":".412"},"uses_additional_data":false},{"leaderboard":"/sota/image-manipulation-localization-on-nist16","task":"Image Manipulation Localization","dataset":"NIST16(Protocol-CAT)","model":"Mantra-Net","rank_in_archive_order":8,"of":8,"metrics":{"Pixel Binary F1":"0.193"},"uses_additional_data":false}],"syntology":{"syntology_url":null,"atlas_url":null,"mcp":null,"developers":"https://syntology.ai/developers"},"arxiv_metadata":null,"syntology_extracted_results":null}