{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/2408-03220","title":"Masked Random Noise for Communication Efficient Federated Learning","arxiv_id":"2408.03220","date":"2024-08-06","proceeding":null,"authors":["Shiwei Li","Yingyi Cheng","Haozhao Wang","Xing Tang","Shijie Xu","Weihong Luo","Yuhua Li","Dugang Liu","Xiuqiang He","Ruixuan Li"],"abstract":"Federated learning is a promising distributed training paradigm that effectively safeguards data privacy. However, it may involve significant communication costs, which hinders training efficiency. In this paper, we aim to enhance communication efficiency from a new perspective. Specifically, we request the distributed clients to find optimal model updates relative to global model parameters within predefined random noise. For this purpose, we propose Federated Masked Random Noise (FedMRN), a novel framework that enables clients to learn a 1-bit mask for each model parameter and apply masked random noise (i.e., the Hadamard product of random noise and masks) to represent model updates. To make FedMRN feasible, we propose an advanced mask training strategy, called progressive stochastic masking (PSM). After local training, each client only need to transmit local masks and a random seed to the server. Additionally, we provide theoretical guarantees for the convergence of FedMRN under both strongly convex and non-convex assumptions. Extensive experiments are conducted on four popular datasets. The results show that FedMRN exhibits superior convergence speed and test accuracy compared to relevant baselines, while attaining a similar level of accuracy as FedAvg.","url_abs":"https://arxiv.org/abs/2408.03220v2","url_pdf":"https://arxiv.org/pdf/2408.03220v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"2408-03220","repo_url":"https://github.com/Leopold1423/fedmrn-mm24","is_official":1,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"pytorch","reach":{"status":"ok"}}],"tasks":[{"task_slug":"federated-learning","task_name":"Federated Learning"}],"methods":[{"method_slug":"speed","method_name":"SPEED"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2408.03220","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2408.03220"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/Leopold1423/fedmrn-mm24","reach":{"status":"ok"}}],"summary":{"ran":4,"ran_draft_wrong":1,"unverified":4},"by_repo_kind":{"official":{"samples":9,"ran":5,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":9,"samples":[{"code_sha256_prefix":"7daaffd338513f27","entry":"get_device","repo":"Leopold1423/fedmrn-mm24","repo_kind":"official","path":"utils/tool.py","file_url":"https://github.com/Leopold1423/fedmrn-mm24/blob/HEAD/utils/tool.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"7daaffd338513f27"}},{"code_sha256_prefix":"f235ae9d22982450","entry":"get_log","repo":"Leopold1423/fedmrn-mm24","repo_kind":"official","path":"utils/logger.py","file_url":"https://github.com/Leopold1423/fedmrn-mm24/blob/HEAD/utils/logger.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"f235ae9d22982450"}},{"code_sha256_prefix":"0858fffb5ce6a31c","entry":"get_server_test_dataloader","repo":"Leopold1423/fedmrn-mm24","repo_kind":"official","path":"dataloader/dataloader.py","file_url":"https://github.com/Leopold1423/fedmrn-mm24/blob/HEAD/dataloader/dataloader.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"0858fffb5ce6a31c"}},{"code_sha256_prefix":"a1b6b6404ceaede9","entry":"print_client_data_stats","repo":"Leopold1423/fedmrn-mm24","repo_kind":"official","path":"dataloader/datapartition.py","file_url":"https://github.com/Leopold1423/fedmrn-mm24/blob/HEAD/dataloader/datapartition.py","link_basis":"plan_row","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"a1b6b6404ceaede9"}},{"code_sha256_prefix":"8671511823d366de","entry":"test","repo":"Leopold1423/fedmrn-mm24","repo_kind":"official","path":"train/trainer.py","file_url":"https://github.com/Leopold1423/fedmrn-mm24/blob/HEAD/train/trainer.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"8671511823d366de"}},{"code_sha256_prefix":"85c698b0a695ab66","entry":"get_client_train_dataloader","repo":"Leopold1423/fedmrn-mm24","repo_kind":"official","path":"dataloader/dataloader.py","file_url":"https://github.com/Leopold1423/fedmrn-mm24/blob/HEAD/dataloader/dataloader.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"85c698b0a695ab66"}},{"code_sha256_prefix":"83457b9b9949394d","entry":"get_data","repo":"Leopold1423/fedmrn-mm24","repo_kind":"official","path":"dataloader/dataloader.py","file_url":"https://github.com/Leopold1423/fedmrn-mm24/blob/HEAD/dataloader/dataloader.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"83457b9b9949394d"}},{"code_sha256_prefix":"4cace57f545ae012","entry":"get_data","repo":"Leopold1423/fedmrn-mm24","repo_kind":"official","path":"dataloader/datapartition.py","file_url":"https://github.com/Leopold1423/fedmrn-mm24/blob/HEAD/dataloader/datapartition.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"4cace57f545ae012"}},{"code_sha256_prefix":"575977373e082077","entry":"partition_train_data","repo":"Leopold1423/fedmrn-mm24","repo_kind":"official","path":"dataloader/datapartition.py","file_url":"https://github.com/Leopold1423/fedmrn-mm24/blob/HEAD/dataloader/datapartition.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"575977373e082077"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}