{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/personalized-federated-learning-under-mixture","title":"Personalized Federated Learning under Mixture of Distributions","arxiv_id":"2305.01068","date":"2023-05-01","proceeding":null,"authors":["Yue Wu","Shuaicheng Zhang","Wenchao Yu","Yanchi Liu","Quanquan Gu","Dawei Zhou","Haifeng Chen","Wei Cheng"],"abstract":"The recent trend towards Personalized Federated Learning (PFL) has garnered significant attention as it allows for the training of models that are tailored to each client while maintaining data privacy. However, current PFL techniques primarily focus on modeling the conditional distribution heterogeneity (i.e. concept shift), which can result in suboptimal performance when the distribution of input data across clients diverges (i.e. covariate shift). Additionally, these techniques often lack the ability to adapt to unseen data, further limiting their effectiveness in real-world scenarios. To address these limitations, we propose a novel approach, FedGMM, which utilizes Gaussian mixture models (GMM) to effectively fit the input data distributions across diverse clients. The model parameters are estimated by maximum likelihood estimation utilizing a federated Expectation-Maximization algorithm, which is solved in closed form and does not assume gradient similarity. Furthermore, FedGMM possesses an additional advantage of adapting to new clients with minimal overhead, and it also enables uncertainty quantification. Empirical evaluations on synthetic and benchmark datasets demonstrate the superior performance of our method in both PFL classification and novel sample detection.","url_abs":"https://arxiv.org/abs/2305.01068v1","url_pdf":"https://arxiv.org/pdf/2305.01068v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"personalized-federated-learning-under-mixture","repo_url":"https://github.com/zshuai8/FedGMM_ICML2023","is_official":1,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[{"task_slug":"federated-learning","task_name":"Federated Learning"},{"task_slug":"personalized-federated-learning","task_name":"Personalized Federated Learning"},{"task_slug":"uncertainty-quantification","task_name":"Uncertainty Quantification"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2305.01068","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2305.01068"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/zshuai8/FedGMM_ICML2023","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"unverified":10},"by_repo_kind":{"official":{"samples":10,"ran":0,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"0fb07fcd00e9a795","entry":"evalute_batch","repo":"zshuai8/FedGMM_ICML2023","repo_kind":"official","path":"ood_em.py","file_url":"https://github.com/zshuai8/FedGMM_ICML2023/blob/HEAD/ood_em.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"0fb07fcd00e9a795"}},{"code_sha256_prefix":"7f801fe50e913058","entry":"get_mobilenet","repo":"zshuai8/FedGMM_ICML2023","repo_kind":"official","path":"models.py","file_url":"https://github.com/zshuai8/FedGMM_ICML2023/blob/HEAD/models.py","link_basis":"plan_row","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"7f801fe50e913058"}},{"code_sha256_prefix":"6725864ab93354db","entry":"get_squeezenet","repo":"zshuai8/FedGMM_ICML2023","repo_kind":"official","path":"models.py","file_url":"https://github.com/zshuai8/FedGMM_ICML2023/blob/HEAD/models.py","link_basis":"plan_row","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"6725864ab93354db"}},{"code_sha256_prefix":"c62118f0aae4e1f5","entry":"get_vgg11","repo":"zshuai8/FedGMM_ICML2023","repo_kind":"official","path":"models.py","file_url":"https://github.com/zshuai8/FedGMM_ICML2023/blob/HEAD/models.py","link_basis":"plan_row","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"c62118f0aae4e1f5"}},{"code_sha256_prefix":"ae7b10d3672e7026","entry":"grayscale","repo":"zshuai8/FedGMM_ICML2023","repo_kind":"official","path":"datasets.py","file_url":"https://github.com/zshuai8/FedGMM_ICML2023/blob/HEAD/datasets.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"ae7b10d3672e7026"}},{"code_sha256_prefix":"f4f86bc5b5427a5f","entry":"init_clients","repo":"zshuai8/FedGMM_ICML2023","repo_kind":"official","path":"ood.py","file_url":"https://github.com/zshuai8/FedGMM_ICML2023/blob/HEAD/ood.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"f4f86bc5b5427a5f"}},{"code_sha256_prefix":"30259c744405c874","entry":"rand_label","repo":"zshuai8/FedGMM_ICML2023","repo_kind":"official","path":"ood.py","file_url":"https://github.com/zshuai8/FedGMM_ICML2023/blob/HEAD/ood.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"30259c744405c874"}},{"code_sha256_prefix":"fda05b799d510a22","entry":"random_invert","repo":"zshuai8/FedGMM_ICML2023","repo_kind":"official","path":"datasets.py","file_url":"https://github.com/zshuai8/FedGMM_ICML2023/blob/HEAD/datasets.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"fda05b799d510a22"}},{"code_sha256_prefix":"5e304b1b4a9be39a","entry":"random_rotation","repo":"zshuai8/FedGMM_ICML2023","repo_kind":"official","path":"datasets.py","file_url":"https://github.com/zshuai8/FedGMM_ICML2023/blob/HEAD/datasets.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"5e304b1b4a9be39a"}},{"code_sha256_prefix":"592303d3ca37b03a","entry":"sigmoid","repo":"zshuai8/FedGMM_ICML2023","repo_kind":"official","path":"fedem_plot.py","file_url":"https://github.com/zshuai8/FedGMM_ICML2023/blob/HEAD/fedem_plot.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"592303d3ca37b03a"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}