{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/arxiv-2603-05116","title":"FedBCD:Communication-Efficient Accelerated Block Coordinate Gradient Descent for Federated Learning","arxiv_id":"2603.05116","date":"2026-03-05","proceeding":null,"authors":["Junkang Liu","Fanhua Shang","Yuanyuan Liu","Hongying Liu","Yuangang Li","YunXiang Gong"],"abstract":"Although Federated Learning has been widely studied in recent years, there are still high overhead expenses in each communication round for large-scale models such as Vision Transformer. To lower the communication complexity, we propose a novel Federated Block Coordinate Gradient Descent (FedBCGD) method for communication efficiency. The proposed method splits model parameters into several blocks, including a shared block and enables uploading a specific parameter block by each client, which can significantly reduce communication overhead. Moreover, we also develop an accelerated FedBCGD algorithm (called FedBCGD+) with client drift control and stochastic variance reduction. To the best of our knowledge, this paper is the first work on parameter block communication for training large-scale deep models. We also provide the convergence analysis for the proposed algorithms. Our theoretical results show that the communication complexities of our algorithms are a factor $1/N$ lower than those of existing methods, where $N$ is the number of parameter blocks, and they enjoy much faster convergence than their counterparts. Empirical results indicate the superiority of the proposed algorithms compared to state-of-the-art algorithms. The code is available at https://github.com/junkangLiu0/FedBCGD.","url_abs":"https://arxiv.org/abs/2603.05116","url_pdf":"https://arxiv.org/pdf/2603.05116","source":{"archive":null,"snapshot":"2025-07-28","note":"not in the Papers with Code archive (frozen at the snapshot)","row_kind":"graph","title_abstract_authors_date":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)"},"code_links":[],"tasks":[],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2603.05116","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2603.05116"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"mentioned_in_github":null,"is_official":null,"provenance":"deterministic:regex_extraction","mentioned_in_paper":null,"url":"https://github.com/junkangLiu0/FedBCGD","reach":null}],"summary":{"ran_fixture":1,"ran_honours":1,"unverified":14},"by_repo_kind":{"found_in_text":{"samples":16,"ran":2,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":16,"samples":[{"code_sha256_prefix":"fe7d4321dbeef661","entry":"drop_path","repo":"junkangLiu0/FedBCGD","repo_kind":"found_in_text","path":"vit_model.py","file_url":"https://github.com/junkangLiu0/FedBCGD/blob/HEAD/vit_model.py","link_basis":"plan_row","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":"invariant","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"fe7d4321dbeef661"}},{"code_sha256_prefix":"1df9a5ffd9b38c34","entry":"pil_loader","repo":"junkangLiu0/FedBCGD","repo_kind":"found_in_text","path":"dataset/tiny_imagenet.py","file_url":"https://github.com/junkangLiu0/FedBCGD/blob/HEAD/dataset/tiny_imagenet.py","link_basis":"plan_row","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":"well_formed","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"1df9a5ffd9b38c34"}},{"code_sha256_prefix":"0c476b33924be46e","entry":"ResNet10","repo":"junkangLiu0/FedBCGD","repo_kind":"found_in_text","path":"models/resnet.py","file_url":"https://github.com/junkangLiu0/FedBCGD/blob/HEAD/models/resnet.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"0c476b33924be46e"}},{"code_sha256_prefix":"2a2273f5859157b9","entry":"ResNet18","repo":"junkangLiu0/FedBCGD","repo_kind":"found_in_text","path":"models/resnet.py","file_url":"https://github.com/junkangLiu0/FedBCGD/blob/HEAD/models/resnet.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"2a2273f5859157b9"}},{"code_sha256_prefix":"779e90045d3680d8","entry":"ResNet34","repo":"junkangLiu0/FedBCGD","repo_kind":"found_in_text","path":"models/resnet.py","file_url":"https://github.com/junkangLiu0/FedBCGD/blob/HEAD/models/resnet.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"779e90045d3680d8"}},{"code_sha256_prefix":"1ab70033e19f0d48","entry":"accimage_loader","repo":"junkangLiu0/FedBCGD","repo_kind":"found_in_text","path":"dataset/tiny_imagenet.py","file_url":"https://github.com/junkangLiu0/FedBCGD/blob/HEAD/dataset/tiny_imagenet.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"1ab70033e19f0d48"}},{"code_sha256_prefix":"a070d59ac8a182c7","entry":"blockVGG","repo":"junkangLiu0/FedBCGD","repo_kind":"found_in_text","path":"models/VGG.py","file_url":"https://github.com/junkangLiu0/FedBCGD/blob/HEAD/models/VGG.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"a070d59ac8a182c7"}},{"code_sha256_prefix":"f8455b2ed4982ac2","entry":"default_loader","repo":"junkangLiu0/FedBCGD","repo_kind":"found_in_text","path":"dataset/tiny_imagenet.py","file_url":"https://github.com/junkangLiu0/FedBCGD/blob/HEAD/dataset/tiny_imagenet.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"f8455b2ed4982ac2"}},{"code_sha256_prefix":"c85b4fb48916556b","entry":"deit_tiny","repo":"junkangLiu0/FedBCGD","repo_kind":"found_in_text","path":"models/DeiTTiny.py","file_url":"https://github.com/junkangLiu0/FedBCGD/blob/HEAD/models/DeiTTiny.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"c85b4fb48916556b"}},{"code_sha256_prefix":"2202fd90583e6341","entry":"drop_path_f","repo":"junkangLiu0/FedBCGD","repo_kind":"found_in_text","path":"model.py","file_url":"https://github.com/junkangLiu0/FedBCGD/blob/HEAD/model.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"2202fd90583e6341"}},{"code_sha256_prefix":"8585520f9491c162","entry":"find_cls","repo":"junkangLiu0/FedBCGD","repo_kind":"found_in_text","path":"dirichlet_data.py","file_url":"https://github.com/junkangLiu0/FedBCGD/blob/HEAD/dirichlet_data.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"8585520f9491c162"}},{"code_sha256_prefix":"f6feefbc37e07e56","entry":"get_data_loader","repo":"junkangLiu0/FedBCGD","repo_kind":"found_in_text","path":"FedBCGD.py","file_url":"https://github.com/junkangLiu0/FedBCGD/blob/HEAD/FedBCGD.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"f6feefbc37e07e56"}},{"code_sha256_prefix":"d7c42c9e714cbf81","entry":"vit_base_patch16_224","repo":"junkangLiu0/FedBCGD","repo_kind":"found_in_text","path":"vit_model.py","file_url":"https://github.com/junkangLiu0/FedBCGD/blob/HEAD/vit_model.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"d7c42c9e714cbf81"}},{"code_sha256_prefix":"7ea1677c2a7788dc","entry":"vit_base_patch16_224_in21k","repo":"junkangLiu0/FedBCGD","repo_kind":"found_in_text","path":"vit_model.py","file_url":"https://github.com/junkangLiu0/FedBCGD/blob/HEAD/vit_model.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"7ea1677c2a7788dc"}},{"code_sha256_prefix":"1244e2f07fb63623","entry":"window_partition","repo":"junkangLiu0/FedBCGD","repo_kind":"found_in_text","path":"model.py","file_url":"https://github.com/junkangLiu0/FedBCGD/blob/HEAD/model.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"1244e2f07fb63623"}},{"code_sha256_prefix":"d14e0252b43325ae","entry":"window_reverse","repo":"junkangLiu0/FedBCGD","repo_kind":"found_in_text","path":"model.py","file_url":"https://github.com/junkangLiu0/FedBCGD/blob/HEAD/model.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"d14e0252b43325ae"}}]},"arxiv_metadata":{"licence":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)","fields":["title","abstract","authors","date"],"primary_category":"cs.LG","source":"arxiv_2026.jsonl"},"syntology_extracted_results":null}