{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/arxiv-2607-07565","title":"Collaborative Synthetic Data Generation for Knowledge Transfer in Federated Learning","arxiv_id":"2607.07565","date":"2026-07-08","proceeding":null,"authors":["Maximilian Andreas Hoefler","Karsten Mueller","Wojciech Samek"],"abstract":"One-shot federated learning (OSFL) addresses the communication overhead of federated learning by limiting training to a single round, but doing so without sacrificing model quality is non-trivial, particularly when client data distributions diverge. Recent work has addressed this challenge by aggregating client knowledge on the server through the construction of transferable synthetic datasets or distillates. However, most of these methods lack formal privacy guarantees, leaving a gap in jointly achieving low communication, robustness to heterogeneity, and rigorous privacy. We propose FedKT-CSD (Federated Knowledge Transfer via Collaborative Synthetic Data), a framework inspired by neural image compression that closes this gap by leveraging publicly pretrained autoencoders as a shared latent space. Each client encodes its private data in a single forward pass, computes class-conditional latent statistics, and transmits these to the server. The server aggregates these statistics via secure aggregation, adds calibrated differential privacy noise, and decodes a synthetic dataset for training a global model and further downstream tasks. This design provides formal $(\\varepsilon,δ)$-differential privacy by construction, while keeping client-side computation and communication lightweight. Despite operating under privacy constraints, FedKT-CSD is competitive with and even outperforms non-private baselines across diverse datasets and heterogeneity settings, and scales to a large number of clients. Our code is available at: https://github.com/an7123/FedKT-CSD","url_abs":"https://arxiv.org/abs/2607.07565","url_pdf":"https://arxiv.org/pdf/2607.07565","source":{"archive":null,"snapshot":"2025-07-28","note":"not in the Papers with Code archive (frozen at the snapshot)","row_kind":"graph","title_abstract_authors_date":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)"},"code_links":[],"tasks":[],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2607.07565","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2607.07565"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"mentioned_in_github":null,"is_official":null,"provenance":"deterministic:regex_extraction","mentioned_in_paper":null,"url":"https://github.com/an7123/FedKT-CSD","reach":null}],"summary":{"ran":6,"unverified":1},"by_repo_kind":{"found_in_text":{"samples":7,"ran":6,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":7,"samples":[{"code_sha256_prefix":"74af18066688f12a","entry":"clip_latents","repo":"an7123/FedKT-CSD","repo_kind":"found_in_text","path":"dp.py","file_url":"https://github.com/an7123/FedKT-CSD/blob/HEAD/dp.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"74af18066688f12a"}},{"code_sha256_prefix":"7715ecd190c71ace","entry":"decode_all","repo":"an7123/FedKT-CSD","repo_kind":"found_in_text","path":"fed.py","file_url":"https://github.com/an7123/FedKT-CSD/blob/HEAD/fed.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"7715ecd190c71ace"}},{"code_sha256_prefix":"293f8d26a009c240","entry":"dp_statistics","repo":"an7123/FedKT-CSD","repo_kind":"found_in_text","path":"dp.py","file_url":"https://github.com/an7123/FedKT-CSD/blob/HEAD/dp.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"293f8d26a009c240"}},{"code_sha256_prefix":"0f6e104e18a001b0","entry":"encode_all","repo":"an7123/FedKT-CSD","repo_kind":"found_in_text","path":"fed.py","file_url":"https://github.com/an7123/FedKT-CSD/blob/HEAD/fed.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"0f6e104e18a001b0"}},{"code_sha256_prefix":"b5f5833c22503ee0","entry":"sample","repo":"an7123/FedKT-CSD","repo_kind":"found_in_text","path":"dp.py","file_url":"https://github.com/an7123/FedKT-CSD/blob/HEAD/dp.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"b5f5833c22503ee0"}},{"code_sha256_prefix":"6c47543fa998f62a","entry":"stats_distance","repo":"an7123/FedKT-CSD","repo_kind":"found_in_text","path":"verify_invariance.py","file_url":"https://github.com/an7123/FedKT-CSD/blob/HEAD/verify_invariance.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"6c47543fa998f62a"}},{"code_sha256_prefix":"c4cc221770c7b1c9","entry":"load_dataset","repo":"an7123/FedKT-CSD","repo_kind":"found_in_text","path":"fed.py","file_url":"https://github.com/an7123/FedKT-CSD/blob/HEAD/fed.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"c4cc221770c7b1c9"}}]},"arxiv_metadata":{"licence":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)","fields":["title","abstract","authors","date"],"primary_category":"cs.LG","source":"arxiv_2026.jsonl"},"syntology_extracted_results":null}