{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/2408-03215","title":"FedBAT: Communication-Efficient Federated Learning via Learnable Binarization","arxiv_id":"2408.03215","date":"2024-08-06","proceeding":null,"authors":["Shiwei Li","Wenchao Xu","Haozhao Wang","Xing Tang","Yining Qi","Shijie Xu","Weihong Luo","Yuhua Li","Xiuqiang He","Ruixuan Li"],"abstract":"Federated learning is a promising distributed machine learning paradigm that can effectively exploit large-scale data without exposing users' privacy. However, it may incur significant communication overhead, thereby potentially impairing the training efficiency. To address this challenge, numerous studies suggest binarizing the model updates. Nonetheless, traditional methods usually binarize model updates in a post-training manner, resulting in significant approximation errors and consequent degradation in model accuracy. To this end, we propose Federated Binarization-Aware Training (FedBAT), a novel framework that directly learns binary model updates during the local training process, thus inherently reducing the approximation errors. FedBAT incorporates an innovative binarization operator, along with meticulously designed derivatives to facilitate efficient learning. In addition, we establish theoretical guarantees regarding the convergence of FedBAT. Extensive experiments are conducted on four popular datasets. The results show that FedBAT significantly accelerates the convergence and exceeds the accuracy of baselines by up to 9\\%, even surpassing that of FedAvg in some cases.","url_abs":"https://arxiv.org/abs/2408.03215v1","url_pdf":"https://arxiv.org/pdf/2408.03215v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"2408-03215","repo_url":"https://github.com/Leopold1423/fedbat-icml24","is_official":1,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"pytorch","reach":null}],"tasks":[{"task_slug":"binarization","task_name":"Binarization"},{"task_slug":"federated-learning","task_name":"Federated Learning"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2408.03215","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2408.03215"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/Leopold1423/fedbat-icml24","reach":null}],"summary":{"ran":1,"ran_draft_wrong":1,"ran_honours":1,"unverified":1},"by_repo_kind":{"official":{"samples":4,"ran":3,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":4,"samples":[{"code_sha256_prefix":"c89c976efe0755aa","entry":"bat","repo":"Leopold1423/fedbat-icml24","repo_kind":"official","path":"model/bat.py","file_url":"https://github.com/Leopold1423/fedbat-icml24/blob/HEAD/model/bat.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"c89c976efe0755aa"}},{"code_sha256_prefix":"a1b6b6404ceaede9","entry":"print_client_data_stats","repo":"leopold1423/fedbat-icml24","repo_kind":"official","path":"dataloader/datapartition.py","file_url":"https://github.com/leopold1423/fedbat-icml24/blob/HEAD/dataloader/datapartition.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"a1b6b6404ceaede9"}},{"code_sha256_prefix":"2e802c7ca8369630","entry":"test","repo":"leopold1423/fedbat-icml24","repo_kind":"official","path":"train/trainer.py","file_url":"https://github.com/leopold1423/fedbat-icml24/blob/HEAD/train/trainer.py","link_basis":"first_harvest_node","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":"well_formed","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"2e802c7ca8369630"}},{"code_sha256_prefix":"e2162845d5ef5ebb","entry":"partition_train_data","repo":"leopold1423/fedbat-icml24","repo_kind":"official","path":"dataloader/datapartition.py","file_url":"https://github.com/leopold1423/fedbat-icml24/blob/HEAD/dataloader/datapartition.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"e2162845d5ef5ebb"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}