{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/make-landscape-flatter-in-differentially","title":"Make Landscape Flatter in Differentially Private Federated Learning","arxiv_id":"2303.11242","date":"2023-03-20","proceeding":"CVPR 2023 1","authors":["Yifan Shi","Yingqi Liu","Kang Wei","Li Shen","Xueqian Wang","DaCheng Tao"],"abstract":"To defend the inference attacks and mitigate the sensitive information leakages in Federated Learning (FL), client-level Differentially Private FL (DPFL) is the de-facto standard for privacy protection by clipping local updates and adding random noise. However, existing DPFL methods tend to make a sharper loss landscape and have poorer weight perturbation robustness, resulting in severe performance degradation. To alleviate these issues, we propose a novel DPFL algorithm named DP-FedSAM, which leverages gradient perturbation to mitigate the negative impact of DP. Specifically, DP-FedSAM integrates Sharpness Aware Minimization (SAM) optimizer to generate local flatness models with better stability and weight perturbation robustness, which results in the small norm of local updates and robustness to DP noise, thereby improving the performance. From the theoretical perspective, we analyze in detail how DP-FedSAM mitigates the performance degradation induced by DP. Meanwhile, we give rigorous privacy guarantees with R\\'enyi DP and present the sensitivity analysis of local updates. At last, we empirically confirm that our algorithm achieves state-of-the-art (SOTA) performance compared with existing SOTA baselines in DPFL. Code is available at https://github.com/YMJS-Irfan/DP-FedSAM","url_abs":"https://arxiv.org/abs/2303.11242v2","url_pdf":"https://arxiv.org/pdf/2303.11242v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"make-landscape-flatter-in-differentially","repo_url":"https://github.com/YMJS-Irfan/DP-FedSAM","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":null}],"tasks":[{"task_slug":"federated-learning","task_name":"Federated Learning"}],"methods":[{"method_slug":"aware","method_name":"AWARE"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2303.11242","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2303.11242"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/YMJS-Irfan/DP-FedSAM","reach":null}],"summary":{"ran":3,"ran_draft_wrong":3,"unverified":1},"by_repo_kind":{"official":{"samples":7,"ran":6,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":7,"samples":[{"code_sha256_prefix":"e33f907725fe74f0","entry":"BasicBlock","repo":"YMJS-Irfan/DP-FedSAM","repo_kind":"official","path":"fedml_api/dpfedsam/dpfedsam_api.py","file_url":"https://github.com/YMJS-Irfan/DP-FedSAM/blob/HEAD/fedml_api/dpfedsam/dpfedsam_api.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"e33f907725fe74f0"}},{"code_sha256_prefix":"802338e78be8feeb","entry":"Client","repo":"YMJS-Irfan/DP-FedSAM","repo_kind":"official","path":"fedml_api/dpfedsam/dpfedsam_api.py","file_url":"https://github.com/YMJS-Irfan/DP-FedSAM/blob/HEAD/fedml_api/dpfedsam/dpfedsam_api.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"802338e78be8feeb"}},{"code_sha256_prefix":"a82d59d1e60ad8ba","entry":"ResNet","repo":"YMJS-Irfan/DP-FedSAM","repo_kind":"official","path":"fedml_api/dpfedsam/dpfedsam_api.py","file_url":"https://github.com/YMJS-Irfan/DP-FedSAM/blob/HEAD/fedml_api/dpfedsam/dpfedsam_api.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"a82d59d1e60ad8ba"}},{"code_sha256_prefix":"5db9fffe698896fb","entry":"add","repo":"YMJS-Irfan/DP-FedSAM","repo_kind":"official","path":"fedml_api/dpfedsam/dpfedsam_api.py","file_url":"https://github.com/YMJS-Irfan/DP-FedSAM/blob/HEAD/fedml_api/dpfedsam/dpfedsam_api.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"5db9fffe698896fb"}},{"code_sha256_prefix":"27e31d2f411bf9ff","entry":"customized_resnet18","repo":"YMJS-Irfan/DP-FedSAM","repo_kind":"official","path":"fedml_api/dpfedsam/dpfedsam_api.py","file_url":"https://github.com/YMJS-Irfan/DP-FedSAM/blob/HEAD/fedml_api/dpfedsam/dpfedsam_api.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"27e31d2f411bf9ff"}},{"code_sha256_prefix":"9de0604eb0032d08","entry":"subtract","repo":"YMJS-Irfan/DP-FedSAM","repo_kind":"official","path":"fedml_api/dpfedsam/dpfedsam_api.py","file_url":"https://github.com/YMJS-Irfan/DP-FedSAM/blob/HEAD/fedml_api/dpfedsam/dpfedsam_api.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"9de0604eb0032d08"}},{"code_sha256_prefix":"43d885e7d8f5ad3d","entry":"DPFedSAMAPI","repo":"YMJS-Irfan/DP-FedSAM","repo_kind":"official","path":"fedml_api/dpfedsam/dpfedsam_api.py","file_url":"https://github.com/YMJS-Irfan/DP-FedSAM/blob/HEAD/fedml_api/dpfedsam/dpfedsam_api.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"43d885e7d8f5ad3d"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}