{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/hierarchical-fine-grained-image-forgery","title":"Hierarchical Fine-Grained Image Forgery Detection and Localization","arxiv_id":"2303.17111","date":"2023-03-30","proceeding":"CVPR 2023 1","authors":["Xiao Guo","Xiaohong Liu","Zhiyuan Ren","Steven Grosz","Iacopo Masi","Xiaoming Liu"],"abstract":"Differences in forgery attributes of images generated in CNN-synthesized and image-editing domains are large, and such differences make a unified image forgery detection and localization (IFDL) challenging. To this end, we present a hierarchical fine-grained formulation for IFDL representation learning. Specifically, we first represent forgery attributes of a manipulated image with multiple labels at different levels. Then we perform fine-grained classification at these levels using the hierarchical dependency between them. As a result, the algorithm is encouraged to learn both comprehensive features and inherent hierarchical nature of different forgery attributes, thereby improving the IFDL representation. Our proposed IFDL framework contains three components: multi-branch feature extractor, localization and classification modules. Each branch of the feature extractor learns to classify forgery attributes at one level, while localization and classification modules segment the pixel-level forgery region and detect image-level forgery, respectively. Lastly, we construct a hierarchical fine-grained dataset to facilitate our study. We demonstrate the effectiveness of our method on $7$ different benchmarks, for both tasks of IFDL and forgery attribute classification. Our source code and dataset can be found: \\href{https://github.com/CHELSEA234/HiFi_IFDL}{github.com/CHELSEA234/HiFi-IFDL}.","url_abs":"https://arxiv.org/abs/2303.17111v1","url_pdf":"https://arxiv.org/pdf/2303.17111v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"hierarchical-fine-grained-image-forgery","repo_url":"https://github.com/chelsea234/hifi_ifdl","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":null}],"tasks":[{"task_slug":"attribute","task_name":"Attribute"},{"task_slug":"classification-1","task_name":"Classification"},{"task_slug":"image-forgery-detection","task_name":"Image Forgery Detection"},{"task_slug":"representation-learning","task_name":"Representation Learning"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2303.17111","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2303.17111"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/chelsea234/hifi_ifdl","reach":null},{"provenance":"deterministic:regex_extraction","url":"https://github.com/CHELSEA234/HiFi-IFDL","reach":{"status":"gone","observed_at":"2026-09-17","how":"tree_404+repo_404"}}],"summary":{"ran":11,"ran_fixture":1,"ran_draft_wrong":1,"unverified":5},"by_repo_kind":{"official":{"samples":18,"ran":13,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"7b178f825d37ad2c","entry":"BasicBlock","repo":"chelsea234/hifi_ifdl","repo_kind":"official","path":"HiFi_Net.py","file_url":"https://github.com/chelsea234/hifi_ifdl/blob/HEAD/HiFi_Net.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"7b178f825d37ad2c"}},{"code_sha256_prefix":"e1e3fde5abbd1dba","entry":"Bottleneck","repo":"chelsea234/hifi_ifdl","repo_kind":"official","path":"HiFi_Net.py","file_url":"https://github.com/chelsea234/hifi_ifdl/blob/HEAD/HiFi_Net.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"e1e3fde5abbd1dba"}},{"code_sha256_prefix":"9b8d5c657020b3da","entry":"BranchCLS","repo":"chelsea234/hifi_ifdl","repo_kind":"official","path":"HiFi_Net.py","file_url":"https://github.com/chelsea234/hifi_ifdl/blob/HEAD/HiFi_Net.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"9b8d5c657020b3da"}},{"code_sha256_prefix":"0600f3020a10ac5f","entry":"CatDepth","repo":"chelsea234/hifi_ifdl","repo_kind":"official","path":"HiFi_Net.py","file_url":"https://github.com/chelsea234/hifi_ifdl/blob/HEAD/HiFi_Net.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"0600f3020a10ac5f"}},{"code_sha256_prefix":"e1419c05ef8cd25e","entry":"Flatten","repo":"chelsea234/hifi_ifdl","repo_kind":"official","path":"HiFi_Net.py","file_url":"https://github.com/chelsea234/hifi_ifdl/blob/HEAD/HiFi_Net.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"e1419c05ef8cd25e"}},{"code_sha256_prefix":"e68d2ed847dcdb77","entry":"GaussianSmoothing","repo":"chelsea234/hifi_ifdl","repo_kind":"official","path":"HiFi_Net.py","file_url":"https://github.com/chelsea234/hifi_ifdl/blob/HEAD/HiFi_Net.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"e68d2ed847dcdb77"}},{"code_sha256_prefix":"d856f64b0cf32633","entry":"HighResolutionModule","repo":"chelsea234/hifi_ifdl","repo_kind":"official","path":"HiFi_Net.py","file_url":"https://github.com/chelsea234/hifi_ifdl/blob/HEAD/HiFi_Net.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"d856f64b0cf32633"}},{"code_sha256_prefix":"4ba5a22538ab5b90","entry":"IsolatingLossFunction","repo":"chelsea234/hifi_ifdl","repo_kind":"official","path":"HiFi_Net.py","file_url":"https://github.com/chelsea234/hifi_ifdl/blob/HEAD/HiFi_Net.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"4ba5a22538ab5b90"}},{"code_sha256_prefix":"8fdceb4ff7b0075d","entry":"LaPlacianMs","repo":"chelsea234/hifi_ifdl","repo_kind":"official","path":"HiFi_Net.py","file_url":"https://github.com/chelsea234/hifi_ifdl/blob/HEAD/HiFi_Net.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"8fdceb4ff7b0075d"}},{"code_sha256_prefix":"a0d87098e844ddaa","entry":"PartialConv","repo":"chelsea234/hifi_ifdl","repo_kind":"official","path":"HiFi_Net.py","file_url":"https://github.com/chelsea234/hifi_ifdl/blob/HEAD/HiFi_Net.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"a0d87098e844ddaa"}},{"code_sha256_prefix":"15843f1133de84f5","entry":"get_cfg_defaults","repo":"chelsea234/hifi_ifdl","repo_kind":"official","path":"HiFi_Net.py","file_url":"https://github.com/chelsea234/hifi_ifdl/blob/HEAD/HiFi_Net.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"15843f1133de84f5"}},{"code_sha256_prefix":"eaead4d829ddf732","entry":"load_center_radius_api","repo":"chelsea234/hifi_ifdl","repo_kind":"official","path":"HiFi_Net.py","file_url":"https://github.com/chelsea234/hifi_ifdl/blob/HEAD/HiFi_Net.py","link_basis":"first_harvest_node","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"eaead4d829ddf732"}},{"code_sha256_prefix":"e9036b6dc10ccc06","entry":"weights_init","repo":"chelsea234/hifi_ifdl","repo_kind":"official","path":"HiFi_Net.py","file_url":"https://github.com/chelsea234/hifi_ifdl/blob/HEAD/HiFi_Net.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"e9036b6dc10ccc06"}},{"code_sha256_prefix":"e7ef253ae9fcb7da","entry":"HiFi_Net","repo":"chelsea234/hifi_ifdl","repo_kind":"official","path":"HiFi_Net.py","file_url":"https://github.com/chelsea234/hifi_ifdl/blob/HEAD/HiFi_Net.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"e7ef253ae9fcb7da"}},{"code_sha256_prefix":"2b378f9963d3fa84","entry":"HighResolutionNet","repo":"chelsea234/hifi_ifdl","repo_kind":"official","path":"HiFi_Net.py","file_url":"https://github.com/chelsea234/hifi_ifdl/blob/HEAD/HiFi_Net.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"2b378f9963d3fa84"}},{"code_sha256_prefix":"cb1672e1db145750","entry":"NLCDetection","repo":"chelsea234/hifi_ifdl","repo_kind":"official","path":"HiFi_Net.py","file_url":"https://github.com/chelsea234/hifi_ifdl/blob/HEAD/HiFi_Net.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"cb1672e1db145750"}},{"code_sha256_prefix":"a5749e5ab8a1fe26","entry":"NonLocalMask","repo":"chelsea234/hifi_ifdl","repo_kind":"official","path":"HiFi_Net.py","file_url":"https://github.com/chelsea234/hifi_ifdl/blob/HEAD/HiFi_Net.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"a5749e5ab8a1fe26"}},{"code_sha256_prefix":"4020f7c8f5a456b0","entry":"get_seg_model","repo":"chelsea234/hifi_ifdl","repo_kind":"official","path":"HiFi_Net.py","file_url":"https://github.com/chelsea234/hifi_ifdl/blob/HEAD/HiFi_Net.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"4020f7c8f5a456b0"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}