{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/from-deterioration-to-acceleration-a","title":"From Deterioration to Acceleration: A Calibration Approach to Rehabilitating Step Asynchronism in Federated Optimization","arxiv_id":"2112.09355","date":"2021-12-17","proceeding":null,"authors":["Feijie Wu","Song Guo","Haozhao Wang","Zhihao Qu","Haobo Zhang","Jie Zhang","Ziming Liu"],"abstract":"In the setting of federated optimization, where a global model is aggregated periodically, step asynchronism occurs when participants conduct model training by efficiently utilizing their computational resources. It is well acknowledged that step asynchronism leads to objective inconsistency under non-i.i.d. data, which degrades the model's accuracy. To address this issue, we propose a new algorithm FedaGrac, which calibrates the local direction to a predictive global orientation. Taking advantage of the estimated orientation, we guarantee that the aggregated model does not excessively deviate from the global optimum while fully utilizing the local updates of faster nodes. We theoretically prove that FedaGrac holds an improved order of convergence rate than the state-of-the-art approaches and eliminates the negative effect of step asynchronism. Empirical results show that our algorithm accelerates the training and enhances the final accuracy.","url_abs":"https://arxiv.org/abs/2112.09355v2","url_pdf":"https://arxiv.org/pdf/2112.09355v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"from-deterioration-to-acceleration-a","repo_url":"https://github.com/harliwu/fedagrac","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2112.09355","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2112.09355"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/harliwu/fedagrac","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"unverified":10},"by_repo_kind":{"official":{"samples":10,"ran":0,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"3e9b4994435f386d","entry":"LR","repo":"harliwu/fedagrac","repo_kind":"official","path":"models/a9a.py","file_url":"https://github.com/harliwu/fedagrac/blob/HEAD/models/a9a.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"3e9b4994435f386d"}},{"code_sha256_prefix":"a562384a7ca1c64a","entry":"LR","repo":"harliwu/fedagrac","repo_kind":"official","path":"models/cifar10.py","file_url":"https://github.com/harliwu/fedagrac/blob/HEAD/models/cifar10.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"a562384a7ca1c64a"}},{"code_sha256_prefix":"8fa3cb971dc2d90e","entry":"LR","repo":"harliwu/fedagrac","repo_kind":"official","path":"models/w8a.py","file_url":"https://github.com/harliwu/fedagrac/blob/HEAD/models/w8a.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"8fa3cb971dc2d90e"}},{"code_sha256_prefix":"69c404d0dde4b404","entry":"ResNet18","repo":"harliwu/fedagrac","repo_kind":"official","path":"models/cifar10.py","file_url":"https://github.com/harliwu/fedagrac/blob/HEAD/models/cifar10.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"69c404d0dde4b404"}},{"code_sha256_prefix":"a089e0d1b026fcb7","entry":"ResNet18","repo":"harliwu/fedagrac","repo_kind":"official","path":"models/cifar100.py","file_url":"https://github.com/harliwu/fedagrac/blob/HEAD/models/cifar100.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"a089e0d1b026fcb7"}},{"code_sha256_prefix":"0190ae141e474538","entry":"get_num_steps","repo":"harliwu/fedagrac","repo_kind":"official","path":"federated_learning/FedaGrac/learner.py","file_url":"https://github.com/harliwu/fedagrac/blob/HEAD/federated_learning/FedaGrac/learner.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"0190ae141e474538"}},{"code_sha256_prefix":"9e2e2ab560ced428","entry":"load_cifar_datasets","repo":"harliwu/fedagrac","repo_kind":"official","path":"models/cifar10.py","file_url":"https://github.com/harliwu/fedagrac/blob/HEAD/models/cifar10.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"9e2e2ab560ced428"}},{"code_sha256_prefix":"6b42ef2e550649fd","entry":"load_mnist_datasets","repo":"harliwu/fedagrac","repo_kind":"official","path":"models/fmnist.py","file_url":"https://github.com/harliwu/fedagrac/blob/HEAD/models/fmnist.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"6b42ef2e550649fd"}},{"code_sha256_prefix":"e7e218672e353c59","entry":"new_arguments","repo":"harliwu/fedagrac","repo_kind":"official","path":"federated_learning/start.py","file_url":"https://github.com/harliwu/fedagrac/blob/HEAD/federated_learning/start.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"e7e218672e353c59"}},{"code_sha256_prefix":"d18d8999c71dc4a7","entry":"test_model","repo":"harliwu/fedagrac","repo_kind":"official","path":"federated_learning/FedaGrac/param_server.py","file_url":"https://github.com/harliwu/fedagrac/blob/HEAD/federated_learning/FedaGrac/param_server.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"d18d8999c71dc4a7"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}