{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/fedbabu-towards-enhanced-representation-for","title":"FedBABU: Towards Enhanced Representation for Federated Image Classification","arxiv_id":"2106.06042","date":"2021-06-04","proceeding":null,"authors":["Jaehoon Oh","Sangmook Kim","Se-Young Yun"],"abstract":"Federated learning has evolved to improve a single global model under data heterogeneity (as a curse) or to develop multiple personalized models using data heterogeneity (as a blessing). However, little research has considered both directions simultaneously. In this paper, we first investigate the relationship between them by analyzing Federated Averaging at the client level and determine that a better federated global model performance does not constantly improve personalization. To elucidate the cause of this personalization performance degradation problem, we decompose the entire network into the body (extractor), which is related to universality, and the head (classifier), which is related to personalization. We then point out that this problem stems from training the head. Based on this observation, we propose a novel federated learning algorithm, coined FedBABU, which only updates the body of the model during federated training (i.e., the head is randomly initialized and never updated), and the head is fine-tuned for personalization during the evaluation process. Extensive experiments show consistent performance improvements and an efficient personalization of FedBABU. The code is available at https://github.com/jhoon-oh/FedBABU.","url_abs":"https://arxiv.org/abs/2106.06042v3","url_pdf":"https://arxiv.org/pdf/2106.06042v3.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"fedbabu-towards-enhanced-representation-for","repo_url":"https://github.com/jhoon-oh/fedbabu","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}},{"paper_slug":"fedbabu-towards-enhanced-representation-for","repo_url":"https://github.com/KarhouTam/FL-bench","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"GPL-3.0"}},{"paper_slug":"fedbabu-towards-enhanced-representation-for","repo_url":"https://github.com/TsingZ0/PFL-Non-IID","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":null}],"tasks":[{"task_slug":"classification-1","task_name":"Classification"},{"task_slug":"federated-learning","task_name":"Federated Learning"},{"task_slug":"image-classification","task_name":"Image Classification"},{"task_slug":"image-classification","task_name":"image-classification"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/2106.06042","atlas_url":"https://app.syntology.ai/?focus=2106.06042","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2106.06042"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-25T09:33:49+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"deterministic:regex_extraction","url":"https://github.com/jhoon-oh/FedBABU","reach":{"status":"ok","spdx":"MIT"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/TsingZ0/PFL-Non-IID","reach":null},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/KarhouTam/FL-bench","reach":{"status":"ok","spdx":"GPL-3.0"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/jhoon-oh/fedbabu","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"ran":3,"ran_draft_wrong":2,"unverified":4},"by_repo_kind":{"official":{"samples":5,"ran":4,"repositories":1},"listed":{"samples":4,"ran":1,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"1048b2e2fa3a6bf4","entry":"Client","repo":"TsingZ0/PFL-Non-IID","repo_kind":"listed","path":"system/flcore/servers/serverbabu.py","file_url":"https://github.com/TsingZ0/PFL-Non-IID/blob/HEAD/system/flcore/servers/serverbabu.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"1048b2e2fa3a6bf4"}},{"code_sha256_prefix":"f9964d719c5cb8f4","entry":"FedAvg","repo":"jhoon-oh/fedbabu","repo_kind":"official","path":"models/Fed.py","file_url":"https://github.com/jhoon-oh/fedbabu/blob/HEAD/models/Fed.py","link_basis":"plan_row","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"f9964d719c5cb8f4"}},{"code_sha256_prefix":"0f23e7e681845fe0","entry":"ResNet18","repo":"jhoon-oh/fedbabu","repo_kind":"official","path":"models/ResNet.py","file_url":"https://github.com/jhoon-oh/fedbabu/blob/HEAD/models/ResNet.py","link_basis":"plan_row","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"0f23e7e681845fe0"}},{"code_sha256_prefix":"21ba14c82993c2fe","entry":"ResNet50","repo":"jhoon-oh/fedbabu","repo_kind":"official","path":"models/ResNet.py","file_url":"https://github.com/jhoon-oh/fedbabu/blob/HEAD/models/ResNet.py","link_basis":"plan_row","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"21ba14c82993c2fe"}},{"code_sha256_prefix":"7eccbc3004b9fde7","entry":"conv3x3","repo":"jhoon-oh/fedbabu","repo_kind":"official","path":"models/Nets.py","file_url":"https://github.com/jhoon-oh/fedbabu/blob/HEAD/models/Nets.py","link_basis":"plan_row","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"7eccbc3004b9fde7"}},{"code_sha256_prefix":"94f3fdefbfd44006","entry":"FedBABU","repo":"TsingZ0/PFL-Non-IID","repo_kind":"listed","path":"system/flcore/servers/serverbabu.py","file_url":"https://github.com/TsingZ0/PFL-Non-IID/blob/HEAD/system/flcore/servers/serverbabu.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"94f3fdefbfd44006"}},{"code_sha256_prefix":"ac3dd06d1a08c549","entry":"ResNet34","repo":"jhoon-oh/fedbabu","repo_kind":"official","path":"models/ResNet.py","file_url":"https://github.com/jhoon-oh/fedbabu/blob/HEAD/models/ResNet.py","link_basis":"plan_row","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"ac3dd06d1a08c549"}},{"code_sha256_prefix":"c9022996c28dd496","entry":"Server","repo":"TsingZ0/PFL-Non-IID","repo_kind":"listed","path":"system/flcore/servers/serverbabu.py","file_url":"https://github.com/TsingZ0/PFL-Non-IID/blob/HEAD/system/flcore/servers/serverbabu.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"c9022996c28dd496"}},{"code_sha256_prefix":"b2f6d4c187b737c7","entry":"clientBABU","repo":"TsingZ0/PFL-Non-IID","repo_kind":"listed","path":"system/flcore/servers/serverbabu.py","file_url":"https://github.com/TsingZ0/PFL-Non-IID/blob/HEAD/system/flcore/servers/serverbabu.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"b2f6d4c187b737c7"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}