{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/arxiv-2603-11992","title":"Few-for-Many Personalized Federated Learning","arxiv_id":"2603.11992","date":"2026-03-12","proceeding":null,"authors":["Ping Guo","Tiantian Zhang","Xi Lin","Xiang Li","Zhi-Ri Tang","Qingfu Zhang"],"abstract":"Personalized Federated Learning (PFL) aims to train customized models for clients with highly heterogeneous data distributions while preserving data privacy. Existing approaches often rely on heuristics like clustering or model interpolation, which lack principled mechanisms for balancing heterogeneous client objectives. Serving $M$ clients with distinct data distributions is inherently a multi-objective optimization problem, where achieving optimal personalization ideally requires $M$ distinct models on the Pareto front. However, maintaining $M$ separate models poses significant scalability challenges in federated settings with hundreds or thousands of clients. To address this challenge, we reformulate PFL as a few-for-many optimization problem that maintains only $K$ shared server models ($K \\ll M$) to collectively serve all $M$ clients. We prove that this framework achieves near-optimal personalization: the approximation error diminishes as $K$ increases and each client's model converges to each client's optimum as data grows. Building on this reformulation, we propose FedFew, a practical algorithm that jointly optimizes the $K$ server models through efficient gradient-based updates. Unlike clustering-based approaches that require manual client partitioning or interpolation-based methods that demand careful hyperparameter tuning, FedFew automatically discovers the optimal model diversity through its optimization process. Experiments across vision, NLP, and real-world medical imaging datasets demonstrate that FedFew, with just 3 models, consistently outperforms other state-of-the-art approaches. Code is available at https://github.com/pgg3/FedFew.","url_abs":"https://arxiv.org/abs/2603.11992","url_pdf":"https://arxiv.org/pdf/2603.11992","source":{"archive":null,"snapshot":"2025-07-28","note":"not in the Papers with Code archive (frozen at the snapshot)","row_kind":"graph","title_abstract_authors_date":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)"},"code_links":[],"tasks":[],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2603.11992","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2603.11992"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"mentioned_in_github":null,"is_official":null,"provenance":"deterministic:regex_extraction","mentioned_in_paper":null,"url":"https://github.com/pgg3/FedFew","reach":null}],"summary":{"ran":1,"ran_draft_wrong":3,"unverified":4},"by_repo_kind":{"found_in_text":{"samples":8,"ran":4,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"f16cc0fcf384ba3b","entry":"_get_dataset_root","repo":"pgg3/FedFew","repo_kind":"found_in_text","path":"PFLlib/system/flcore/servers/serverfedfews.py","file_url":"https://github.com/pgg3/FedFew/blob/HEAD/PFLlib/system/flcore/servers/serverfedfews.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"f16cc0fcf384ba3b"}},{"code_sha256_prefix":"c7e7971b001d0d94","entry":"process_image","repo":"pgg3/FedFew","repo_kind":"found_in_text","path":"PFLlib/system/flcore/servers/serverfedfews.py","file_url":"https://github.com/pgg3/FedFew/blob/HEAD/PFLlib/system/flcore/servers/serverfedfews.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"c7e7971b001d0d94"}},{"code_sha256_prefix":"30123ffcd4022409","entry":"read_client_data","repo":"pgg3/FedFew","repo_kind":"found_in_text","path":"PFLlib/system/flcore/servers/serverfedfews.py","file_url":"https://github.com/pgg3/FedFew/blob/HEAD/PFLlib/system/flcore/servers/serverfedfews.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"30123ffcd4022409"}},{"code_sha256_prefix":"d13245af66b72045","entry":"read_data","repo":"pgg3/FedFew","repo_kind":"found_in_text","path":"PFLlib/system/flcore/servers/serverfedfews.py","file_url":"https://github.com/pgg3/FedFew/blob/HEAD/PFLlib/system/flcore/servers/serverfedfews.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"d13245af66b72045"}},{"code_sha256_prefix":"26ccd2730c4ba2c8","entry":"Client","repo":"pgg3/FedFew","repo_kind":"found_in_text","path":"PFLlib/system/flcore/servers/serverfedfews.py","file_url":"https://github.com/pgg3/FedFew/blob/HEAD/PFLlib/system/flcore/servers/serverfedfews.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"26ccd2730c4ba2c8"}},{"code_sha256_prefix":"987451b5ad544d35","entry":"FedFewS","repo":"pgg3/FedFew","repo_kind":"found_in_text","path":"PFLlib/system/flcore/servers/serverfedfews.py","file_url":"https://github.com/pgg3/FedFew/blob/HEAD/PFLlib/system/flcore/servers/serverfedfews.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"987451b5ad544d35"}},{"code_sha256_prefix":"892305b1fbfbb8cb","entry":"Server","repo":"pgg3/FedFew","repo_kind":"found_in_text","path":"PFLlib/system/flcore/servers/serverfedfews.py","file_url":"https://github.com/pgg3/FedFew/blob/HEAD/PFLlib/system/flcore/servers/serverfedfews.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"892305b1fbfbb8cb"}},{"code_sha256_prefix":"d8cd91ba76b905db","entry":"clientFedFewS","repo":"pgg3/FedFew","repo_kind":"found_in_text","path":"PFLlib/system/flcore/servers/serverfedfews.py","file_url":"https://github.com/pgg3/FedFew/blob/HEAD/PFLlib/system/flcore/servers/serverfedfews.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"d8cd91ba76b905db"}}]},"arxiv_metadata":{"licence":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)","fields":["title","abstract","authors","date"],"primary_category":"cs.LG","source":"arxiv_2026.jsonl"},"syntology_extracted_results":null}