Papers › MMFusion: Combining Image Forensic Filters for Visual Manipulation Detection and Localization

MMFusion: Combining Image Forensic Filters for Visual Manipulation Detection and Localization

4 Dec 2023arXiv:2312.01790archive 2025-07-28

Kostas Triaridis, Konstantinos Tsigos, Vasileios Mezaris

Recent image manipulation localization and detection techniques typically leverage forensic artifacts and traces that are produced by a noise-sensitive filter, such as SRM or Bayar convolution. In this paper, we showcase that different filters commonly used in such approaches excel at unveiling different types of manipulations and provide complementary forensic traces. Thus, we explore ways of combining the outputs of such filters to leverage the complementary nature of the produced artifacts for performing image manipulation localization and detection (IMLD). We assess two distinct combination methods: one that produces independent features from each forensic filter and then fuses them (this is referred to as late fusion) and one that performs early mixing of different modal outputs and produces combined features (this is referred to as early fusion). We use the latter as a feature encoding mechanism, accompanied by a new decoding mechanism that encompasses feature re-weighting, for formulating the proposed MMFusion architecture. We demonstrate that MMFusion achieves competitive performance for both image manipulation localization and detection, outperforming state-of-the-art models across several image and video datasets. We also investigate further the contribution of each forensic filter within MMFusion for addressing different types of manipulations, building on recent AI explainability measures.

PaperPDFCode

Code

idt-iti/mmfusion-iml officialmentioned in papermentioned on GitHubpytorch report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Detecting Image ManipulationImage ForensicsImage Forgery DetectionImage ManipulationImage Manipulation DetectionImage Manipulation Localization

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Image Manipulation Detection COVERAGE Early Fusion AUC .839 #1 of 8 Archive leaderboard report
Image Manipulation Detection COVERAGE Early Fusion Balanced Accuracy .770 #1 of 8 Archive leaderboard report
Image Manipulation Detection COVERAGE Late Fusion AUC .792 #2 of 8 Archive leaderboard report
Image Manipulation Detection COVERAGE Late Fusion Balanced Accuracy .720 #2 of 8 Archive leaderboard report
Image Manipulation Detection Casia V1+ Late Fusion AUC .930 #1 of 9 Archive leaderboard report
Image Manipulation Detection Casia V1+ Late Fusion Balanced Accuracy .860 #1 of 9 Archive leaderboard report
Image Manipulation Detection Casia V1+ Early Fusion AUC .929 #2 of 9 Archive leaderboard report
Image Manipulation Detection Casia V1+ Early Fusion Balanced Accuracy .845 #2 of 9 Archive leaderboard report
Image Manipulation Detection CocoGlide Late Fusion AUC .760 #1 of 8 Archive leaderboard report
Image Manipulation Detection CocoGlide Late Fusion Balanced Accuracy .677 #1 of 8 Archive leaderboard report
Image Manipulation Detection CocoGlide Early Fusion AUC .755 #2 of 8 Archive leaderboard report
Image Manipulation Detection CocoGlide Early Fusion Balanced Accuracy .660 #2 of 8 Archive leaderboard report
Image Manipulation Detection Columbia Early Fusion AUC .996 #2 of 8 Archive leaderboard report
Image Manipulation Detection Columbia Early Fusion Balanced Accuracy .962 #2 of 8 Archive leaderboard report
Image Manipulation Detection Columbia Late Fusion AUC .977 #3 of 8 Archive leaderboard report
Image Manipulation Detection Columbia Late Fusion Balanced Accuracy .822 #3 of 8 Archive leaderboard report
Image Manipulation Detection DSO-1 Early Fusion AUC .966 #1 of 9 Archive leaderboard report
Image Manipulation Detection DSO-1 Early Fusion Balanced Accuracy .935 #1 of 9 Archive leaderboard report
Image Manipulation Detection DSO-1 Late Fusion AUC .958 #3 of 9 Archive leaderboard report
Image Manipulation Detection DSO-1 Late Fusion Balanced Accuracy .830 #3 of 9 Archive leaderboard report
Image Manipulation Localization COVERAGE Early Fusion Average Pixel F1(Fixed threshold) .663 #1 of 11 Archive leaderboard report
Image Manipulation Localization COVERAGE Late Fusion Average Pixel F1(Fixed threshold) .641 #2 of 11 Archive leaderboard report
Image Manipulation Localization Casia V1+ Early Fusion Average Pixel F1(Fixed threshold) .784 #2 of 11 Archive leaderboard report
Image Manipulation Localization Casia V1+ Late Fusion Average Pixel F1(Fixed threshold) .775 #3 of 11 Archive leaderboard report
Image Manipulation Localization CocoGlide Late Fusion Average Pixel F1(Fixed threshold) .574 #2 of 11 Archive leaderboard report
Image Manipulation Localization CocoGlide Early Fusion Average Pixel F1(Fixed threshold) .553 #4 of 11 Archive leaderboard report
Image Manipulation Localization Columbia Early Fusion Average Pixel F1(Fixed threshold) .888 #1 of 11 Archive leaderboard report
Image Manipulation Localization Columbia Late Fusion Average Pixel F1(Fixed threshold) .864 #4 of 11 Archive leaderboard report
Image Manipulation Localization DSO-1 Late Fusion Average Pixel F1(Fixed threshold) .899 #2 of 11 Archive leaderboard report
Image Manipulation Localization DSO-1 Early Fusion Average Pixel F1(Fixed threshold) .869 #4 of 11 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections