Papers › Forensic Similarity for Digital Images

Forensic Similarity for Digital Images

13 Feb 2019arXiv:1902.04684archive 2025-07-28

Owen Mayer, Matthew C. Stamm

In this paper we introduce a new digital image forensics approach called forensic similarity, which determines whether two image patches contain the same forensic trace or different forensic traces. One benefit of this approach is that prior knowledge, e.g. training samples, of a forensic trace are not required to make a forensic similarity decision on it in the future. To do this, we propose a two part deep-learning system composed of a CNN-based feature extractor and a three-layer neural network, called the similarity network. This system maps pairs of image patches to a score indicating whether they contain the same or different forensic traces. We evaluated system accuracy of determining whether two image patches were 1) captured by the same or different camera model, 2) manipulated by the same or different editing operation, and 3) manipulated by the same or different manipulation parameter, given a particular editing operation. Experiments demonstrate applicability to a variety of forensic traces, and importantly show efficacy on "unknown" forensic traces that were not used to train the system. Experiments also show that the proposed system significantly improves upon prior art, reducing error rates by more than half. Furthermore, we demonstrated the utility of the forensic similarity approach in two practical applications: forgery detection and localization, and database consistency verification.

PaperPDFCode

In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

Code

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Image ForensicsImage Manipulation Detection

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Image Manipulation Detection CASIA (OSN-transmitted - Facebook) ForSim AUC 0.537 #4 of 4 Archive leaderboard report
Image Manipulation Detection CASIA (OSN-transmitted - Facebook) ForSim F-score 0.157 #4 of 4 Archive leaderboard report
Image Manipulation Detection CASIA (OSN-transmitted - Facebook) ForSim Intersection over Union 0.094 #4 of 4 Archive leaderboard report
Image Manipulation Detection CASIA (OSN-transmitted - Wechat) ForSim AUC 0.532 #4 of 4 Archive leaderboard report
Image Manipulation Detection CASIA (OSN-transmitted - Wechat) ForSim Intersection over Union 0.153 #4 of 4 Archive leaderboard report
Image Manipulation Detection CASIA (OSN-transmitted - Wechat) ForSim f-Score 0.091 #4 of 4 Archive leaderboard report
Image Manipulation Detection CASIA (OSN-transmitted - Weibo) ForSim AUC 0.542 #4 of 4 Archive leaderboard report
Image Manipulation Detection CASIA (OSN-transmitted - Weibo) ForSim Intersection over Union 0.100 #4 of 4 Archive leaderboard report
Image Manipulation Detection CASIA (OSN-transmitted - Weibo) ForSim f-Score 0.165 #4 of 4 Archive leaderboard report
Image Manipulation Detection CASIA (OSN-transmitted - Whatsapp) ForSim AUC 0.525 #4 of 4 Archive leaderboard report
Image Manipulation Detection CASIA (OSN-transmitted - Whatsapp) ForSim Intersection over Union 0.091 #4 of 4 Archive leaderboard report
Image Manipulation Detection CASIA (OSN-transmitted - Whatsapp) ForSim f-Score 0.151 #4 of 4 Archive leaderboard report
Image Manipulation Detection Columbia (OSN-transmitted - Facebook) ForSim AUC 0.607 #4 of 4 Archive leaderboard report
Image Manipulation Detection Columbia (OSN-transmitted - Facebook) ForSim Intersection over Union 0.304 #4 of 4 Archive leaderboard report
Image Manipulation Detection Columbia (OSN-transmitted - Facebook) ForSim f-Score 0.450 #4 of 4 Archive leaderboard report
Image Manipulation Detection Columbia (OSN-transmitted - Wechat) ForSim AUC 0.650 #3 of 4 Archive leaderboard report
Image Manipulation Detection Columbia (OSN-transmitted - Wechat) ForSim Intersection over Union 0.354 #3 of 4 Archive leaderboard report
Image Manipulation Detection Columbia (OSN-transmitted - Wechat) ForSim f-Score 0.496 #3 of 4 Archive leaderboard report
Image Manipulation Detection Columbia (OSN-transmitted - Weibo) ForSim AUC 0.610 #4 of 4 Archive leaderboard report
Image Manipulation Detection Columbia (OSN-transmitted - Weibo) ForSim Intersection over Union 0.312 #4 of 4 Archive leaderboard report
Image Manipulation Detection Columbia (OSN-transmitted - Weibo) ForSim f-Score 0.453 #4 of 4 Archive leaderboard report
Image Manipulation Detection Columbia (OSN-transmitted - Whatsapp) ForSim AUC 0.595 #4 of 4 Archive leaderboard report
Image Manipulation Detection Columbia (OSN-transmitted - Whatsapp) ForSim Intersection over Union 0.294 #4 of 4 Archive leaderboard report
Image Manipulation Detection Columbia (OSN-transmitted - Whatsapp) ForSim f-Score 0.436 #4 of 4 Archive leaderboard report
Image Manipulation Detection DSO (OSN-transmitted - Facebook) ForSim AUC 0.689 #3 of 4 Archive leaderboard report
Image Manipulation Detection DSO (OSN-transmitted - Facebook) ForSim Intersection over Union 0.238 #3 of 4 Archive leaderboard report
Image Manipulation Detection DSO (OSN-transmitted - Facebook) ForSim f-Score 0.356 #3 of 4 Archive leaderboard report
Image Manipulation Detection DSO (OSN-transmitted - Wechat) ForSim AUC 0.564 #4 of 4 Archive leaderboard report
Image Manipulation Detection DSO (OSN-transmitted - Wechat) ForSim Intersection over Union 0.147 #4 of 4 Archive leaderboard report
Image Manipulation Detection DSO (OSN-transmitted - Wechat) ForSim f-Score 0.247 #4 of 4 Archive leaderboard report
Image Manipulation Detection DSO (OSN-transmitted - Weibo) ForSim AUC 0.568 #4 of 4 Archive leaderboard report
Image Manipulation Detection DSO (OSN-transmitted - Weibo) ForSim Intersection over Union 0.165 #4 of 4 Archive leaderboard report
Image Manipulation Detection DSO (OSN-transmitted - Weibo) ForSim f-Score 0.260 #4 of 4 Archive leaderboard report
Image Manipulation Detection DSO (OSN-transmitted - Whatsapp) ForSim AUC 0.542 #4 of 4 Archive leaderboard report
Image Manipulation Detection DSO (OSN-transmitted - Whatsapp) ForSim Intersection over Union 0.139 #4 of 4 Archive leaderboard report
Image Manipulation Detection DSO (OSN-transmitted - Whatsapp) ForSim f-Score 0.233 #4 of 4 Archive leaderboard report
Image Manipulation Detection NIST (OSN-transmitted - Facebook) ForSim AUC 0.580 #4 of 4 Archive leaderboard report
Image Manipulation Detection NIST (OSN-transmitted - Facebook) ForSim Intersection over Union 0.085 #4 of 4 Archive leaderboard report
Image Manipulation Detection NIST (OSN-transmitted - Facebook) ForSim f-Score 0.140 #4 of 4 Archive leaderboard report
Image Manipulation Detection NIST (OSN-transmitted - Wechat) ForSim AUC 0.581 #4 of 4 Archive leaderboard report
Image Manipulation Detection NIST (OSN-transmitted - Wechat) ForSim Intersection over Union 0.082 #4 of 4 Archive leaderboard report
Image Manipulation Detection NIST (OSN-transmitted - Wechat) ForSim f-Score 0.136 #4 of 4 Archive leaderboard report
Image Manipulation Detection NIST (OSN-transmitted - Weibo) ForSim AUC 0.581 #4 of 4 Archive leaderboard report
Image Manipulation Detection NIST (OSN-transmitted - Weibo) ForSim Intersection over Union 0.094 #4 of 4 Archive leaderboard report
Image Manipulation Detection NIST (OSN-transmitted - Weibo) ForSim f-Score 0.150 #4 of 4 Archive leaderboard report
Image Manipulation Detection NIST (OSN-transmitted - Whatsapp) ForSim AUC 0.586 #4 of 4 Archive leaderboard report
Image Manipulation Detection NIST (OSN-transmitted - Whatsapp) ForSim Intersection over Union 0.082 #4 of 4 Archive leaderboard report
Image Manipulation Detection NIST (OSN-transmitted - Whatsapp) ForSim f-Score 0.137 #4 of 4 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Methods

Accumulating Eligibility Trace

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections