{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/fedkim-adaptive-federated-knowledge-injection","title":"FEDKIM: Adaptive Federated Knowledge Injection into Medical Foundation Models","arxiv_id":"2408.10276","date":"2024-08-17","proceeding":null,"authors":["Xiaochen Wang","Jiaqi Wang","Houping Xiao","Jinghui Chen","Fenglong Ma"],"abstract":"Foundation models have demonstrated remarkable capabilities in handling diverse modalities and tasks, outperforming conventional artificial intelligence (AI) approaches that are highly task-specific and modality-reliant. In the medical domain, however, the development of comprehensive foundation models is constrained by limited access to diverse modalities and stringent privacy regulations. To address these constraints, this study introduces a novel knowledge injection approach, FedKIM, designed to scale the medical foundation model within a federated learning framework. FedKIM leverages lightweight local models to extract healthcare knowledge from private data and integrates this knowledge into a centralized foundation model using a designed adaptive Multitask Multimodal Mixture Of Experts (M3OE) module. This method not only preserves privacy but also enhances the model's ability to handle complex medical tasks involving multiple modalities. Our extensive experiments across twelve tasks in seven modalities demonstrate the effectiveness of FedKIM in various settings, highlighting its potential to scale medical foundation models without direct access to sensitive data.","url_abs":"https://arxiv.org/abs/2408.10276v4","url_pdf":"https://arxiv.org/pdf/2408.10276v4.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"fedkim-adaptive-federated-knowledge-injection","repo_url":"https://github.com/XiaochenWang-PSU/FedKIM","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"pytorch","reach":{"status":"ok"}}],"tasks":[{"task_slug":"federated-learning","task_name":"Federated Learning"},{"task_slug":"mixture-of-experts","task_name":"Mixture-of-Experts"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2408.10276","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2408.10276"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/XiaochenWang-PSU/FedKIM","reach":{"status":"ok"}}],"summary":{"ran":7},"by_repo_kind":{"official":{"samples":7,"ran":7,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":7,"samples":[{"code_sha256_prefix":"4c7b6b7d100843c7","entry":"build_evaluator","repo":"XiaochenWang-PSU/FedKIM","repo_kind":"official","path":"FedKIM/src/ChEF/evaluator.py","file_url":"https://github.com/XiaochenWang-PSU/FedKIM/blob/HEAD/FedKIM/src/ChEF/evaluator.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"4c7b6b7d100843c7"}},{"code_sha256_prefix":"5129eae6a80ce5f9","entry":"clip","repo":"XiaochenWang-PSU/FedKIM","repo_kind":"official","path":"FedKIM/src/datasets/dataset.py","file_url":"https://github.com/XiaochenWang-PSU/FedKIM/blob/HEAD/FedKIM/src/datasets/dataset.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"5129eae6a80ce5f9"}},{"code_sha256_prefix":"78e54f470017d052","entry":"is_number","repo":"XiaochenWang-PSU/FedKIM","repo_kind":"official","path":"FedKIM/src/datasets/utils.py","file_url":"https://github.com/XiaochenWang-PSU/FedKIM/blob/HEAD/FedKIM/src/datasets/utils.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"78e54f470017d052"}},{"code_sha256_prefix":"b80626b4df041fc1","entry":"load_Omni","repo":"XiaochenWang-PSU/FedKIM","repo_kind":"official","path":"FedKIM/src/ChEF/data_process/Omnibenchmark.py","file_url":"https://github.com/XiaochenWang-PSU/FedKIM/blob/HEAD/FedKIM/src/ChEF/data_process/Omnibenchmark.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"b80626b4df041fc1"}},{"code_sha256_prefix":"fb66043ff5364d4a","entry":"load_yaml","repo":"XiaochenWang-PSU/FedKIM","repo_kind":"official","path":"FedKIM/src/ChEF/evaluator.py","file_url":"https://github.com/XiaochenWang-PSU/FedKIM/blob/HEAD/FedKIM/src/ChEF/evaluator.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"fb66043ff5364d4a"}},{"code_sha256_prefix":"c08da74e57caf534","entry":"parse_num","repo":"XiaochenWang-PSU/FedKIM","repo_kind":"official","path":"FedKIM/src/datasets/utils.py","file_url":"https://github.com/XiaochenWang-PSU/FedKIM/blob/HEAD/FedKIM/src/datasets/utils.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"c08da74e57caf534"}},{"code_sha256_prefix":"a93d0c45daff9074","entry":"sample_dataset","repo":"XiaochenWang-PSU/FedKIM","repo_kind":"official","path":"FedKIM/src/ChEF/evaluator.py","file_url":"https://github.com/XiaochenWang-PSU/FedKIM/blob/HEAD/FedKIM/src/ChEF/evaluator.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"a93d0c45daff9074"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}