{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/straggler-resilient-personalized-federated","title":"Straggler-Resilient Personalized Federated Learning","arxiv_id":"2206.02078","date":"2022-06-05","proceeding":null,"authors":["Isidoros Tziotis","Zebang Shen","Ramtin Pedarsani","Hamed Hassani","Aryan Mokhtari"],"abstract":"Federated Learning is an emerging learning paradigm that allows training models from samples distributed across a large network of clients while respecting privacy and communication restrictions. Despite its success, federated learning faces several challenges related to its decentralized nature. In this work, we develop a novel algorithmic procedure with theoretical speedup guarantees that simultaneously handles two of these hurdles, namely (i) data heterogeneity, i.e., data distributions can vary substantially across clients, and (ii) system heterogeneity, i.e., the computational power of the clients could differ significantly. Our method relies on ideas from representation learning theory to find a global common representation using all clients' data and learn a user-specific set of parameters leading to a personalized solution for each client. Furthermore, our method mitigates the effects of stragglers by adaptively selecting clients based on their computational characteristics and statistical significance, thus achieving, for the first time, near optimal sample complexity and provable logarithmic speedup. Experimental results support our theoretical findings showing the superiority of our method over alternative personalized federated schemes in system and data heterogeneous environments.","url_abs":"https://arxiv.org/abs/2206.02078v1","url_pdf":"https://arxiv.org/pdf/2206.02078v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"straggler-resilient-personalized-federated","repo_url":"https://github.com/shenzebang/SRPFL","is_official":1,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[{"task_slug":"federated-learning","task_name":"Federated Learning"},{"task_slug":"learning-theory","task_name":"Learning Theory"},{"task_slug":"personalized-federated-learning","task_name":"Personalized Federated Learning"},{"task_slug":"representation-learning","task_name":"Representation Learning"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":null,"atlas_url":"https://app.syntology.ai/?focus=2206.02078","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2206.02078"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/shenzebang/SRPFL","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"ran_honours":1,"unverified":10},"by_repo_kind":{"official":{"samples":11,"ran":1,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"c05f9655534eb098","entry":"relabel_class","repo":"shenzebang/SRPFL","repo_kind":"official","path":"my_sample.py","file_url":"https://github.com/shenzebang/SRPFL/blob/HEAD/my_sample.py","link_basis":"harvester_set","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":"well_formed","behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"c05f9655534eb098"}},{"code_sha256_prefix":"e87571901eb57d76","entry":"dispatch","repo":"shenzebang/SRPFL","repo_kind":"official","path":"AFA-CD.py","file_url":"https://github.com/shenzebang/SRPFL/blob/HEAD/AFA-CD.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"e87571901eb57d76"}},{"code_sha256_prefix":"944fedd1c33c8b12","entry":"line_to_indices","repo":"shenzebang/SRPFL","repo_kind":"official","path":"models/language_utils.py","file_url":"https://github.com/shenzebang/SRPFL/blob/HEAD/models/language_utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"944fedd1c33c8b12"}},{"code_sha256_prefix":"91339fc6f68d3a1f","entry":"load_image","repo":"shenzebang/SRPFL","repo_kind":"official","path":"my_sample.py","file_url":"https://github.com/shenzebang/SRPFL/blob/HEAD/my_sample.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"91339fc6f68d3a1f"}},{"code_sha256_prefix":"e01f7b48b569a79e","entry":"local_update","repo":"shenzebang/SRPFL","repo_kind":"official","path":"AFA-CD.py","file_url":"https://github.com/shenzebang/SRPFL/blob/HEAD/AFA-CD.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"e01f7b48b569a79e"}},{"code_sha256_prefix":"70443626b59d55b5","entry":"ray_dispatch","repo":"shenzebang/SRPFL","repo_kind":"official","path":"FEDAVG-ray.py","file_url":"https://github.com/shenzebang/SRPFL/blob/HEAD/FEDAVG-ray.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"70443626b59d55b5"}},{"code_sha256_prefix":"7a76637cf7a9284d","entry":"ray_dispatch","repo":"shenzebang/SRPFL","repo_kind":"official","path":"FEDME-ray.py","file_url":"https://github.com/shenzebang/SRPFL/blob/HEAD/FEDME-ray.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"7a76637cf7a9284d"}},{"code_sha256_prefix":"223cbef354009719","entry":"ray_dispatch","repo":"shenzebang/SRPFL","repo_kind":"official","path":"HFMAML-ray.py","file_url":"https://github.com/shenzebang/SRPFL/blob/HEAD/HFMAML-ray.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"223cbef354009719"}},{"code_sha256_prefix":"036a5062a158bbe3","entry":"ray_dispatch","repo":"shenzebang/SRPFL","repo_kind":"official","path":"LG-ray.py","file_url":"https://github.com/shenzebang/SRPFL/blob/HEAD/LG-ray.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"036a5062a158bbe3"}},{"code_sha256_prefix":"fa409d7a7fea4818","entry":"split_line","repo":"shenzebang/SRPFL","repo_kind":"official","path":"models/language_utils.py","file_url":"https://github.com/shenzebang/SRPFL/blob/HEAD/models/language_utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"fa409d7a7fea4818"}},{"code_sha256_prefix":"33132cebb0573dc3","entry":"word_to_indices","repo":"shenzebang/SRPFL","repo_kind":"official","path":"models/language_utils.py","file_url":"https://github.com/shenzebang/SRPFL/blob/HEAD/models/language_utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"33132cebb0573dc3"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}