{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/arxiv-2603-02214","title":"Federated Inference: Toward Privacy-Preserving Collaborative and Incentivized Model Serving","arxiv_id":"2603.02214","date":"2026-02-09","proceeding":null,"authors":["Jungwon Seo","Ferhat Ozgur Catak","Chunming Rong","Jaeyeon Jang"],"abstract":"Federated Inference (FI) studies how independently trained and privately owned models can collaborate at inference time without sharing data or model parameters. While recent work has explored secure and distributed inference from disparate perspectives, a unified abstraction and system-level understanding of FI remain lacking. This paper positions FI as a distinct collaborative paradigm, complementary to federated learning, and identifies two fundamental requirements that govern its feasibility: inference-time privacy preservation and meaningful performance gains through collaboration. We formalize FI as a protected collaborative computation, analyze its core design dimensions, and examine the structural trade-offs that arise when privacy constraints, non-IID data, and limited observability are jointly imposed at inference time. Through a concrete instantiation and empirical analysis, we highlight recurring friction points in privacy-preserving inference, ensemble-based collaboration, and incentive alignment. Our findings suggest that FI exhibits system-level behaviors that cannot be directly inherited from training-time federation or classical ensemble methods. Overall, this work provides a unifying perspective on FI and outlines open challenges that must be addressed to enable practical, scalable, and privacy-preserving collaborative inference systems.","url_abs":"https://arxiv.org/abs/2603.02214","url_pdf":"https://arxiv.org/pdf/2603.02214","source":{"archive":null,"snapshot":"2025-07-28","note":"not in the Papers with Code archive (frozen at the snapshot)","row_kind":"graph","title_abstract_authors_date":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)"},"code_links":[],"tasks":[],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2603.02214","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2603.02214"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"mentioned_in_github":null,"is_official":null,"provenance":"deterministic:regex_extraction","mentioned_in_paper":null,"url":"https://github.com/thejungwon/FedSEI","reach":null}],"summary":{"unverified":16},"by_repo_kind":{"found_in_text":{"samples":16,"ran":0,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":16,"samples":[{"code_sha256_prefix":"307430501c786d82","entry":"ResNet18","repo":"thejungwon/FedSEI","repo_kind":"found_in_text","path":"experiments/ensemble/federated_ensemble.py","file_url":"https://github.com/thejungwon/FedSEI/blob/HEAD/experiments/ensemble/federated_ensemble.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"307430501c786d82"}},{"code_sha256_prefix":"234adf3a20684520","entry":"ResNet18","repo":"thejungwon/FedSEI","repo_kind":"found_in_text","path":"experiments/ensemble/federated_ensemble_reward.py","file_url":"https://github.com/thejungwon/FedSEI/blob/HEAD/experiments/ensemble/federated_ensemble_reward.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"234adf3a20684520"}},{"code_sha256_prefix":"a0bf5e360d8db7d2","entry":"benchmark_plain_inference","repo":"thejungwon/FedSEI","repo_kind":"found_in_text","path":"experiments/SMPC-single_host/benchmark_crypten_cnn.py","file_url":"https://github.com/thejungwon/FedSEI/blob/HEAD/experiments/SMPC-single_host/benchmark_crypten_cnn.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"a0bf5e360d8db7d2"}},{"code_sha256_prefix":"0810c5b90ad81ede","entry":"build_cnn","repo":"thejungwon/FedSEI","repo_kind":"found_in_text","path":"experiments/SMPC-single_host/benchmark_crypten_cnn.py","file_url":"https://github.com/thejungwon/FedSEI/blob/HEAD/experiments/SMPC-single_host/benchmark_crypten_cnn.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"0810c5b90ad81ede"}},{"code_sha256_prefix":"b64830ff09cf9089","entry":"build_dummy_input","repo":"thejungwon/FedSEI","repo_kind":"found_in_text","path":"experiments/SMPC-multi-host/benchmark_crypten_multi_host_cpu.py","file_url":"https://github.com/thejungwon/FedSEI/blob/HEAD/experiments/SMPC-multi-host/benchmark_crypten_multi_host_cpu.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"b64830ff09cf9089"}},{"code_sha256_prefix":"1ea99899f5148c95","entry":"build_dummy_input","repo":"thejungwon/FedSEI","repo_kind":"found_in_text","path":"experiments/SMPC-single_host/benchmark_crypten_mlp.py","file_url":"https://github.com/thejungwon/FedSEI/blob/HEAD/experiments/SMPC-single_host/benchmark_crypten_mlp.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"1ea99899f5148c95"}},{"code_sha256_prefix":"64b8b025ee0abdad","entry":"build_mlp","repo":"thejungwon/FedSEI","repo_kind":"found_in_text","path":"experiments/SMPC-single_host/benchmark_crypten_mlp.py","file_url":"https://github.com/thejungwon/FedSEI/blob/HEAD/experiments/SMPC-single_host/benchmark_crypten_mlp.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"64b8b025ee0abdad"}},{"code_sha256_prefix":"179e85b77c8e18a7","entry":"create_model","repo":"thejungwon/FedSEI","repo_kind":"found_in_text","path":"experiments/SMPC-multi-host/benchmark_crypten_multi_host_cpu.py","file_url":"https://github.com/thejungwon/FedSEI/blob/HEAD/experiments/SMPC-multi-host/benchmark_crypten_multi_host_cpu.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"179e85b77c8e18a7"}},{"code_sha256_prefix":"6bb2f681d33d8154","entry":"create_model","repo":"thejungwon/FedSEI","repo_kind":"found_in_text","path":"experiments/SMPC-single_host/benchmark_crypten_parties_cpu.py","file_url":"https://github.com/thejungwon/FedSEI/blob/HEAD/experiments/SMPC-single_host/benchmark_crypten_parties_cpu.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"6bb2f681d33d8154"}},{"code_sha256_prefix":"ae58a902e7d525c9","entry":"get_client_ckpt_path","repo":"thejungwon/FedSEI","repo_kind":"found_in_text","path":"experiments/ensemble/federated_ensemble.py","file_url":"https://github.com/thejungwon/FedSEI/blob/HEAD/experiments/ensemble/federated_ensemble.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"ae58a902e7d525c9"}},{"code_sha256_prefix":"cb34b1c0d6be77dd","entry":"load_compiled_artifact","repo":"thejungwon/FedSEI","repo_kind":"found_in_text","path":"PoC/client/client.py","file_url":"https://github.com/thejungwon/FedSEI/blob/HEAD/PoC/client/client.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"cb34b1c0d6be77dd"}},{"code_sha256_prefix":"7dd44eb3c569ce81","entry":"make_dummy_data","repo":"thejungwon/FedSEI","repo_kind":"found_in_text","path":"experiments/ensemble/crypten_smpc_ensemble_dummy.py","file_url":"https://github.com/thejungwon/FedSEI/blob/HEAD/experiments/ensemble/crypten_smpc_ensemble_dummy.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"7dd44eb3c569ce81"}},{"code_sha256_prefix":"e429888fd4e260ab","entry":"model_name_for_log","repo":"thejungwon/FedSEI","repo_kind":"found_in_text","path":"experiments/SMPC-single_host/benchmark_crypten_parties_cpu.py","file_url":"https://github.com/thejungwon/FedSEI/blob/HEAD/experiments/SMPC-single_host/benchmark_crypten_parties_cpu.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"e429888fd4e260ab"}},{"code_sha256_prefix":"72ea7e7838bbe6fd","entry":"resolve_device","repo":"thejungwon/FedSEI","repo_kind":"found_in_text","path":"experiments/ensemble/federated_ensemble.py","file_url":"https://github.com/thejungwon/FedSEI/blob/HEAD/experiments/ensemble/federated_ensemble.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"72ea7e7838bbe6fd"}},{"code_sha256_prefix":"152b1136652820f5","entry":"summarize_runs","repo":"thejungwon/FedSEI","repo_kind":"found_in_text","path":"experiments/SMPC-multi-host/benchmark_crypten_multi_host_cpu.py","file_url":"https://github.com/thejungwon/FedSEI/blob/HEAD/experiments/SMPC-multi-host/benchmark_crypten_multi_host_cpu.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"152b1136652820f5"}},{"code_sha256_prefix":"42e8b2db53ba20ed","entry":"tta_augment_plain","repo":"thejungwon/FedSEI","repo_kind":"found_in_text","path":"experiments/ensemble/crypten_smpc_ensemble_dummy.py","file_url":"https://github.com/thejungwon/FedSEI/blob/HEAD/experiments/ensemble/crypten_smpc_ensemble_dummy.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"42e8b2db53ba20ed"}}]},"arxiv_metadata":{"licence":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)","fields":["title","abstract","authors","date"],"primary_category":"cs.LG","source":"arxiv_2026.jsonl"},"syntology_extracted_results":null}