{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/do-localization-methods-actually-localize","title":"Do Localization Methods Actually Localize Memorized Data in LLMs? A Tale of Two Benchmarks","arxiv_id":"2311.09060","date":"2023-11-15","proceeding":null,"authors":["Ting-Yun Chang","Jesse Thomason","Robin Jia"],"abstract":"The concept of localization in LLMs is often mentioned in prior work; however, methods for localization have never been systematically and directly evaluated. We propose two complementary benchmarks that evaluate the ability of localization methods to pinpoint LLM components responsible for memorized data. In our INJ benchmark, we actively inject a piece of new information into a small subset of LLM weights, enabling us to directly evaluate whether localization methods can identify these \"ground truth\" weights. In our DEL benchmark, we evaluate localization by measuring how much dropping out identified neurons deletes a memorized pretrained sequence. Despite their different perspectives, our two benchmarks yield consistent rankings of five localization methods. Methods adapted from network pruning perform well on both benchmarks, and all evaluated methods show promising localization ability. On the other hand, even successful methods identify neurons that are not specific to a single memorized sequence.","url_abs":"https://arxiv.org/abs/2311.09060v2","url_pdf":"https://arxiv.org/pdf/2311.09060v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"do-localization-methods-actually-localize","repo_url":"https://github.com/terarachang/memdata","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"Apache-2.0"}},{"paper_slug":"do-localization-methods-actually-localize","repo_url":"https://github.com/terarachang/mempi","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"Apache-2.0"}}],"tasks":[{"task_slug":"benchmarking","task_name":"Benchmarking"},{"task_slug":"network-pruning","task_name":"Network Pruning"}],"methods":[{"method_slug":"pruning","method_name":"Pruning"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2311.09060","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2311.09060"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/terarachang/mempi","reach":{"status":"ok","spdx":"Apache-2.0"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/terarachang/memdata","reach":{"status":"ok","spdx":"Apache-2.0"}}],"summary":{"ran":6,"unverified":9},"by_repo_kind":{"official":{"samples":15,"ran":6,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"3e749274a50f3a6c","entry":"get_attr_str","repo":"terarachang/memdata","repo_kind":"official","path":"utils.py","file_url":"https://github.com/terarachang/memdata/blob/HEAD/utils.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"3e749274a50f3a6c"}},{"code_sha256_prefix":"5ce650a8d673a1a5","entry":"get_attributes","repo":"terarachang/memdata","repo_kind":"official","path":"utils.py","file_url":"https://github.com/terarachang/memdata/blob/HEAD/utils.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"5ce650a8d673a1a5"}},{"code_sha256_prefix":"e940807d016b1ec0","entry":"get_batch_data","repo":"terarachang/memdata","repo_kind":"official","path":"find_memorized_data.py","file_url":"https://github.com/terarachang/memdata/blob/HEAD/find_memorized_data.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"e940807d016b1ec0"}},{"code_sha256_prefix":"7145470f99f9e88b","entry":"levenshtein_distance","repo":"terarachang/memdata","repo_kind":"official","path":"downstream.py","file_url":"https://github.com/terarachang/memdata/blob/HEAD/downstream.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"7145470f99f9e88b"}},{"code_sha256_prefix":"cb5a6337f362e74e","entry":"levenshtein_distance","repo":"terarachang/memdata","repo_kind":"official","path":"downstream_manual.py","file_url":"https://github.com/terarachang/memdata/blob/HEAD/downstream_manual.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"cb5a6337f362e74e"}},{"code_sha256_prefix":"f86605a76e151998","entry":"pack_results","repo":"terarachang/memdata","repo_kind":"official","path":"downstream_manual.py","file_url":"https://github.com/terarachang/memdata/blob/HEAD/downstream_manual.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"f86605a76e151998"}},{"code_sha256_prefix":"0a03035d9cf7aaff","entry":"aggressive_dedup","repo":"terarachang/memdata","repo_kind":"official","path":"find_memorized_data.py","file_url":"https://github.com/terarachang/memdata/blob/HEAD/find_memorized_data.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"0a03035d9cf7aaff"}},{"code_sha256_prefix":"e41b013e37943676","entry":"compute_binary_pct","repo":"terarachang/memdata","repo_kind":"official","path":"hardconcrete.py","file_url":"https://github.com/terarachang/memdata/blob/HEAD/hardconcrete.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"e41b013e37943676"}},{"code_sha256_prefix":"f81fe8ab79c71f6d","entry":"compute_half_pct","repo":"terarachang/memdata","repo_kind":"official","path":"hardconcrete.py","file_url":"https://github.com/terarachang/memdata/blob/HEAD/hardconcrete.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"f81fe8ab79c71f6d"}},{"code_sha256_prefix":"edd9bacc8fb9cfe9","entry":"generate","repo":"terarachang/memdata","repo_kind":"official","path":"utils.py","file_url":"https://github.com/terarachang/memdata/blob/HEAD/utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"edd9bacc8fb9cfe9"}},{"code_sha256_prefix":"a4a37915114cedbf","entry":"get_memo_scores","repo":"terarachang/memdata","repo_kind":"official","path":"downstream.py","file_url":"https://github.com/terarachang/memdata/blob/HEAD/downstream.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"a4a37915114cedbf"}},{"code_sha256_prefix":"f3c2a67fe122ccdc","entry":"get_memo_scores","repo":"terarachang/memdata","repo_kind":"official","path":"downstream_manual.py","file_url":"https://github.com/terarachang/memdata/blob/HEAD/downstream_manual.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"f3c2a67fe122ccdc"}},{"code_sha256_prefix":"c5bca863e8e455ff","entry":"get_sparsity","repo":"terarachang/memdata","repo_kind":"official","path":"hardconcrete.py","file_url":"https://github.com/terarachang/memdata/blob/HEAD/hardconcrete.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"c5bca863e8e455ff"}},{"code_sha256_prefix":"3f196d79bda511ce","entry":"load_pretrained_","repo":"terarachang/memdata","repo_kind":"official","path":"find_memorized_data.py","file_url":"https://github.com/terarachang/memdata/blob/HEAD/find_memorized_data.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"3f196d79bda511ce"}},{"code_sha256_prefix":"3768a7b1e8d9fea1","entry":"test","repo":"terarachang/memdata","repo_kind":"official","path":"downstream.py","file_url":"https://github.com/terarachang/memdata/blob/HEAD/downstream.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"3768a7b1e8d9fea1"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}