{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/think-locally-act-globally-federated-learning","title":"Think Locally, Act Globally: Federated Learning with Local and Global Representations","arxiv_id":"2001.01523","date":"2020-01-06","proceeding":null,"authors":["Paul Pu Liang","Terrance Liu","Liu Ziyin","Nicholas B. Allen","Randy P. Auerbach","David Brent","Ruslan Salakhutdinov","Louis-Philippe Morency"],"abstract":"Federated learning is a method of training models on private data distributed over multiple devices. To keep device data private, the global model is trained by only communicating parameters and updates which poses scalability challenges for large models. To this end, we propose a new federated learning algorithm that jointly learns compact local representations on each device and a global model across all devices. As a result, the global model can be smaller since it only operates on local representations, reducing the number of communicated parameters. Theoretically, we provide a generalization analysis which shows that a combination of local and global models reduces both variance in the data as well as variance across device distributions. Empirically, we demonstrate that local models enable communication-efficient training while retaining performance. We also evaluate on the task of personalized mood prediction from real-world mobile data where privacy is key. Finally, local models handle heterogeneous data from new devices, and learn fair representations that obfuscate protected attributes such as race, age, and gender.","url_abs":"https://arxiv.org/abs/2001.01523v3","url_pdf":"https://arxiv.org/pdf/2001.01523v3.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"think-locally-act-globally-federated-learning","repo_url":"https://github.com/pliang279/LG-FedAvg","is_official":1,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":null},{"paper_slug":"think-locally-act-globally-federated-learning","repo_url":"https://github.com/KarhouTam/FL-bench","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"GPL-3.0"}},{"paper_slug":"think-locally-act-globally-federated-learning","repo_url":"https://github.com/TsingZ0/GFL","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"Apache-2.0"}},{"paper_slug":"think-locally-act-globally-federated-learning","repo_url":"https://github.com/TsingZ0/PFL-Non-IID","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":null}],"tasks":[{"task_slug":"federated-learning","task_name":"Federated Learning"},{"task_slug":"representation-learning","task_name":"Representation Learning"},{"task_slug":"visual-navigation","task_name":"Visual Navigation"},{"task_slug":"visual-question-answering","task_name":"Visual Question Answering (VQA)"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/2001.01523","atlas_url":"https://app.syntology.ai/?focus=2001.01523","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2001.01523"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-25T09:33:49+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"deterministic:regex_extraction","url":"https://github.com/equialgo/fairness-in-ml","reach":{"status":"ok","spdx":"MIT"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/TsingZ0/PFL-Non-IID","reach":null},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/KarhouTam/FL-bench","reach":{"status":"ok","spdx":"GPL-3.0"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/TsingZ0/GFL","reach":{"status":"ok","spdx":"Apache-2.0"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/pliang279/LG-FedAvg","reach":null}],"summary":{"ran":1,"ran_fixture":1,"unverified":4},"by_repo_kind":{"official":{"samples":1,"ran":0,"repositories":1},"listed":{"samples":2,"ran":0,"repositories":1},"found_in_text":{"samples":3,"ran":2,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"0181c19a421956e8","entry":"load_ICU_data","repo":"equialgo/fairness-in-ml","repo_kind":"found_in_text","path":"fairness/helpers.py","file_url":"https://github.com/equialgo/fairness-in-ml/blob/HEAD/fairness/helpers.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"0181c19a421956e8"}},{"code_sha256_prefix":"a2d149f660861fa8","entry":"p_rule","repo":"equialgo/fairness-in-ml","repo_kind":"found_in_text","path":"fairness/helpers.py","file_url":"https://github.com/equialgo/fairness-in-ml/blob/HEAD/fairness/helpers.py","link_basis":"plan_row","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"a2d149f660861fa8"}},{"code_sha256_prefix":"f4e73be5aa126345","entry":"Client","repo":"TsingZ0/PFL-Non-IID","repo_kind":"listed","path":"system/flcore/clients/clientlg.py","file_url":"https://github.com/TsingZ0/PFL-Non-IID/blob/HEAD/system/flcore/clients/clientlg.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"f4e73be5aa126345"}},{"code_sha256_prefix":"f65212878af7e7e8","entry":"LocalUpdateMTL","repo":"pliang279/LG-FedAvg","repo_kind":"official","path":"models/Update.py","file_url":"https://github.com/pliang279/LG-FedAvg/blob/HEAD/models/Update.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"f65212878af7e7e8"}},{"code_sha256_prefix":"6131bb5c52732f46","entry":"clientLG","repo":"TsingZ0/PFL-Non-IID","repo_kind":"listed","path":"system/flcore/clients/clientlg.py","file_url":"https://github.com/TsingZ0/PFL-Non-IID/blob/HEAD/system/flcore/clients/clientlg.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"6131bb5c52732f46"}},{"code_sha256_prefix":"d664e568b39b2254","entry":"plot_distributions","repo":"equialgo/fairness-in-ml","repo_kind":"found_in_text","path":"fairness/helpers.py","file_url":"https://github.com/equialgo/fairness-in-ml/blob/HEAD/fairness/helpers.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"d664e568b39b2254"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}