{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/cure4rec-a-benchmark-for-recommendation","title":"CURE4Rec: A Benchmark for Recommendation Unlearning with Deeper Influence","arxiv_id":"2408.14393","date":"2024-08-26","proceeding":null,"authors":["Chaochao Chen","Jiaming Zhang","Yizhao Zhang","Li Zhang","Lingjuan Lyu","Yuyuan Li","Biao Gong","Chenggang Yan"],"abstract":"With increasing privacy concerns in artificial intelligence, regulations have mandated the right to be forgotten, granting individuals the right to withdraw their data from models. Machine unlearning has emerged as a potential solution to enable selective forgetting in models, particularly in recommender systems where historical data contains sensitive user information. Despite recent advances in recommendation unlearning, evaluating unlearning methods comprehensively remains challenging due to the absence of a unified evaluation framework and overlooked aspects of deeper influence, e.g., fairness. To address these gaps, we propose CURE4Rec, the first comprehensive benchmark for recommendation unlearning evaluation. CURE4Rec covers four aspects, i.e., unlearning Completeness, recommendation Utility, unleaRning efficiency, and recommendation fairnEss, under three data selection strategies, i.e., core data, edge data, and random data. Specifically, we consider the deeper influence of unlearning on recommendation fairness and robustness towards data with varying impact levels. We construct multiple datasets with CURE4Rec evaluation and conduct extensive experiments on existing recommendation unlearning methods. Our code is released at https://github.com/xiye7lai/CURE4Rec.","url_abs":"https://arxiv.org/abs/2408.14393v2","url_pdf":"https://arxiv.org/pdf/2408.14393v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"cure4rec-a-benchmark-for-recommendation","repo_url":"https://github.com/xiye7lai/cure4rec","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"pytorch","reach":{"status":"ok"}}],"tasks":[{"task_slug":"fairness","task_name":"Fairness"},{"task_slug":"machine-unlearning","task_name":"Machine Unlearning"},{"task_slug":"recommendation-systems","task_name":"Recommendation Systems"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":null,"atlas_url":"https://app.syntology.ai/?focus=2408.14393","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2408.14393"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"deterministic:regex_extraction","url":"https://github.com/xiye7lai/CURE4Rec","reach":{"status":"ok"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/xiye7lai/cure4rec","reach":{"status":"ok"}}],"summary":{"ran":7,"unverified":1},"by_repo_kind":{"official":{"samples":8,"ran":7,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":8,"samples":[{"code_sha256_prefix":"53bda340dc84e5fd","entry":"delete","repo":"xiye7lai/CURE4Rec","repo_kind":"official","path":"read.py","file_url":"https://github.com/xiye7lai/CURE4Rec/blob/HEAD/read.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"53bda340dc84e5fd"}},{"code_sha256_prefix":"c498be7e96bf0f2a","entry":"hit","repo":"xiye7lai/CURE4Rec","repo_kind":"official","path":"utils.py","file_url":"https://github.com/xiye7lai/CURE4Rec/blob/HEAD/utils.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"c498be7e96bf0f2a"}},{"code_sha256_prefix":"cc11dff4ef1f068f","entry":"load_data","repo":"xiye7lai/CURE4Rec","repo_kind":"official","path":"lightgcn.py","file_url":"https://github.com/xiye7lai/CURE4Rec/blob/HEAD/lightgcn.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"cc11dff4ef1f068f"}},{"code_sha256_prefix":"39735390276869a4","entry":"load_edge","repo":"xiye7lai/CURE4Rec","repo_kind":"official","path":"lightgcn.py","file_url":"https://github.com/xiye7lai/CURE4Rec/blob/HEAD/lightgcn.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"39735390276869a4"}},{"code_sha256_prefix":"7f429335b5cc6bd3","entry":"ndcg","repo":"xiye7lai/CURE4Rec","repo_kind":"official","path":"utils.py","file_url":"https://github.com/xiye7lai/CURE4Rec/blob/HEAD/utils.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"7f429335b5cc6bd3"}},{"code_sha256_prefix":"5b317e8c27e7a44d","entry":"readRating_full","repo":"xiye7lai/CURE4Rec","repo_kind":"official","path":"read.py","file_url":"https://github.com/xiye7lai/CURE4Rec/blob/HEAD/read.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"5b317e8c27e7a44d"}},{"code_sha256_prefix":"ff17fff81e0dc53c","entry":"sample_batch","repo":"xiye7lai/CURE4Rec","repo_kind":"official","path":"lightgcn.py","file_url":"https://github.com/xiye7lai/CURE4Rec/blob/HEAD/lightgcn.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"ff17fff81e0dc53c"}},{"code_sha256_prefix":"2c050c3d08821002","entry":"baseTrain","repo":"xiye7lai/CURE4Rec","repo_kind":"official","path":"utils.py","file_url":"https://github.com/xiye7lai/CURE4Rec/blob/HEAD/utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"2c050c3d08821002"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}