Browse State-of-the-Art › Collaborative Inference
Collaborative Inference
19 papers with code · 0 benchmarks · 0 datasets archive 2025-07-28
In collaborative inference, a single inference task is performed by multiple models distributed on two or more (typically resource-constrained IoT) devices
Description from the archive archive 2025-07-28.
Benchmarks archive 2025-07-28
No benchmark for this task in the archive.
Libraries
Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.
Datasets archive 2025-07-28
No dataset record in the archive lists this task.
Subtasks archive 2025-07-28
No subtask under this task in the archive's task tree.
Parent tasks archive 2025-07-28
Papers archive 2025-07-28
archive papers tagged: 68 · with a code link: 19 · where Syntology ran a sample: 6 (4 with a run with no instrument failure, 2 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (6 of 68 tagged: 4 with a run with no instrument failure, 2 where every run was a failure of Syntology's instrument)
Page 1 of 1: papers 1 to 68 of 68, in archive order: by repositories listed in the archive (most first), then newest first, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers that list no repository come after every paper that lists one.
Papers without a page here are shown as plain text. A Syntology line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the figure “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code); hover it for the repositories the samples that ran came from. The first sentence of the abstract is shown for the first 30 papers; every abstract is on its paper's page.
-
30 Jul 2024 4 repositories listedWe consider collaborative inference at the wireless edge, where each client's model is trained independently on its local dataset.
-
28 Sep 2022 3 repositories listedThe cost efficiency of model inference is critical to real-world machine learning (ML) applications, especially for delay-sensitive tasks and resource-limited devices.
-
2 Sep 2022 2 repositories listedHowever, these techniques have innate limitations: offloading is too slow for interactive inference, while APIs are not flexible enough for research that requires access to weights, attention or logits.
-
8 Oct 2021 2 repositories listed Syntology 8 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 3 where Syntology's instrument failed) · 6 unverified (of 14 harvested samples)Self-supervised learning has been shown to be very effective in learning useful representations, and yet much of the success is achieved in data types such as images, audio, and text.
-
2 Nov 2016 2 repositories listedWe propose Dual Attention Networks (DANs) which jointly leverage visual and textual attention mechanisms to capture fine-grained interplay between vision and language.
-
1 Mar 2025 1 repository listed Syntology official (archive's flag): 1 ran · 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; the one sample that ran constructed an object rather than computing a result (of 1 harvested sample)By locally encoding raw data into intermediate features, collaborative inference enables end users to leverage powerful deep learning models without exposure of sensitive raw data to cloud servers.
-
7 Feb 2025 1 repository listed Syntology official: harvested, nothing ran · 0 ran · 1 unverified (of 1 harvested sample)Learning informative representations of phylogenetic tree structures is essential for analyzing evolutionary relationships.
-
4 Feb 2025 1 repository listed Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 2 harvested samples) · 2 pointer-only (licence)This allows the router to learn to predict token-level routing scores and make routing decisions based on both the current token and the future impact of its decisions.
-
30 Dec 2024 1 repository listedFurther, we demonstrate through experiments, leveraging open-source LLMs for the implementation of distributed MoA, that certain MoA configurations produce higher-quality responses compared to others, as evaluated on…
-
GREAT: Geometry-Intention Collaborative Inference for Open-Vocabulary 3D Object Affordance Grounding29 Nov 2024 1 repository listedIn light of this, we propose GREAT (GeometRy-intEntion collAboraTive inference) for Open-Vocabulary 3D Object Affordance Grounding, a novel framework that mines the object invariant geometry attributes and performs…
-
12 Jul 2024 1 repository listed Syntology official (archive's flag): 9 ran · 9 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 3 honoured, 0 violated, 3 with no contract checked; 3 where Syntology's instrument failed) · 1 unverified (of 10 harvested samples) · 1 pointer-only (licence)In this paper, we propose a Global-Local Collaborative Scheme (GLIS) for the lidar-based OVD task, which contains a local branch to generate object-level detection result and a global branch to obtain scene-level global…
-
20 Jun 2024 1 repository listed Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)By employing an large LLM for inference and a small LLM for output, we achieve an average 37% reduction in response latency, alongside a 4.
-
23 Apr 2024 1 repository listed Syntology official (archive's flag): 7 ran · 7 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 1 honoured, 0 violated, 2 with no contract checked; 4 where Syntology's instrument failed) · 1 unverified (of 8 harvested samples)Specifically, we propose a cooperative framework, Generalist-Specialist Collaboration (GSCo), which consists of two stages, namely the construction of GFM and specialists, and collaborative inference on downstream tasks.
-
23 Feb 2024 1 repository listedTherefore, instead of employing the partitioning strategy, our framework utilizes a lightweight ViT model on the edge device, with the server deploying a complicated ViT model.
-
9 May 2023 1 repository listedWe discuss the necessity, challenges, and solution approaches for extending existing work on classical edge computing to integrate QPUs.
-
15 Jul 2022 1 repository listedTo compensate, the method introduces a plug-in interactive block to allow attention transfer from the client-side by producing a feature mask.
-
7 Jun 2022 1 repository listedThe success of deep neural networks (DNNs) is heavily dependent on computational resources.
-
24 May 2022 1 repository listedIn this paper, we study the multi-agent collaborative inference scenario, where a single edge server coordinates the inference of multiple UEs.
-
19 Feb 2021 1 repository listedThis paper presents PRICURE, a system that combines complementary strengths of secure multi-party computation (SMPC) and differential privacy (DP) to enable privacy-preserving collaborative prediction among multiple…
-
Adaptive Termination for Multi-round Parallel Reasoning: An Universal Semantic Entropy-Guided Framework9 Jul 2025 0 repositories listedRecent advances in large language models (LLMs) have accelerated progress toward artificial general intelligence, with inference-time scaling emerging as a key technique.
-
Smaller, Smarter, Closer: The Edge of Collaborative Generative AI22 May 2025 0 repositories listedThe rapid adoption of generative AI (GenAI), particularly Large Language Models (LLMs), has exposed critical limitations of cloud-centric deployments, including latency, cost, and privacy concerns.
-
A Wireless Collaborated Inference Acceleration Framework for Plant Disease Recognition5 May 2025 0 repositories listedPlant disease is a critical factor affecting agricultural production.
-
Towards Intelligent Edge Sensing for ISCC Network: Joint Multi-Tier DNN Partitioning and Beamforming Design30 Apr 2025 0 repositories listedThe combination of Integrated Sensing and Communication (ISAC) and Mobile Edge Computing (MEC) enables devices to simultaneously sense the environment and offload data to the base stations (BS) for intelligent…
-
Jupiter: Fast and Resource-Efficient Collaborative Inference of Generative LLMs on Edge Devices11 Apr 2025 0 repositories listedGenerative large language models (LLMs) have garnered significant attention due to their exceptional capabilities in various AI tasks.
-
Speculative End-Turn Detector for Efficient Speech Chatbot Assistant30 Mar 2025 0 repositories listedSpoken dialogue systems powered by large language models have demonstrated remarkable abilities in understanding human speech and generating appropriate spoken responses.
-
G-Boost: Boosting Private SLMs with General LLMs13 Mar 2025 0 repositories listedDue to the limited computational resources, most Large Language Models (LLMs) developers can only fine-tune Small Language Models (SLMs) on their own data.
-
DistrEE: Distributed Early Exit of Deep Neural Network Inference on Edge Devices6 Feb 2025 0 repositories listedDistributed DNN inference is becoming increasingly important as the demand for intelligent services at the network edge grows.
-
MoE²: Optimizing Collaborative Inference for Edge Large Language Models16 Jan 2025 0 repositories listedLarge language models (LLMs) have demonstrated remarkable capabilities across a wide range of natural language processing tasks.
-
Collaboration of Large Language Models and Small Recommendation Models for Device-Cloud Recommendation10 Jan 2025 0 repositories listedLarge Language Models (LLMs) for Recommendation (LLM4Rec) is a promising research direction that has demonstrated exceptional performance in this field.
-
Distributed Collaborative Inference System in Next-Generation Networks and Communication16 Nov 2024 0 repositories listedWith the rapid advancement of artificial intelligence, generative artificial intelligence (GAI) has taken a leading role in transforming data processing methods.
-
CE-CoLLM: Efficient and Adaptive Large Language Models Through Cloud-Edge Collaboration5 Nov 2024 0 repositories listed
-
Collaborative Inference over Wireless Channels with Feature Differential Privacy25 Oct 2024 0 repositories listed
-
SplitLLM: Collaborative Inference of LLMs for Model Placement and Throughput Optimization14 Oct 2024 0 repositories listed
-
Edge-device Collaborative Computing for Multi-view Classification24 Sep 2024 0 repositories listed
-
Hybrid SD: Edge-Cloud Collaborative Inference for Stable Diffusion Models13 Aug 2024 0 repositories listed
-
Galaxy: A Resource-Efficient Collaborative Edge AI System for In-situ Transformer Inference27 May 2024 0 repositories listed
-
Federated Learning for Collaborative Inference Systems: The Case of Early Exit Networks7 May 2024 0 repositories listed
-
Emergency Computing: An Adaptive Collaborative Inference Method Based on Hierarchical Reinforcement Learning3 Feb 2024 0 repositories listed
-
Ensembler: Protect Collaborative Inference Privacy from Model Inversion Attack via Selective Ensemble19 Jan 2024 0 repositories listed
-
Towards Efficient Object Re-Identification with A Novel Cloud-Edge Collaborative Framework4 Jan 2024 0 repositories listed
-
Synergy: Towards On-Body AI via Tiny AI Accelerator Collaboration on Wearables11 Dec 2023 0 repositories listed
-
Adaptive Early Exiting for Collaborative Inference over Noisy Wireless Channels29 Nov 2023 0 repositories listed
-
Semantics-Driven Cloud-Edge Collaborative Inference27 Sep 2023 0 repositories listed
-
DeepAdaIn-Net: Deep Adaptive Device-Edge Collaborative Inference for Augmented Reality22 Sep 2023 0 repositories listed
-
Limited Communications Distributed Optimization via Deep Unfolded Distributed ADMM21 Sep 2023 0 repositories listed
-
DeViT: Decomposing Vision Transformers for Collaborative Inference in Edge Devices10 Sep 2023 0 repositories listed
-
Roulette: A Semantic Privacy-Preserving Device-Edge Collaborative Inference Framework for Deep Learning Classification Tasks6 Sep 2023 0 repositories listed
-
PATROL: Privacy-Oriented Pruning for Collaborative Inference Against Model Inversion Attacks20 Jul 2023 0 repositories listed
-
Energy-efficient Wearable-to-Mobile Offload of ML Inference for PPG-based Heart-Rate Estimation8 Jun 2023 0 repositories listed
-
DVFO: Learning-Based DVFS for Energy-Efficient Edge-Cloud Collaborative Inference2 Jun 2023 0 repositories listed
-
PrivaScissors: Enhance the Privacy of Collaborative Inference through the Lens of Mutual Information17 May 2023 0 repositories listed
-
Deep Reinforcement Learning for Trajectory Path Planning and Distributed Inference in Resource-Constrained UAV Swarms21 Dec 2022 0 repositories listed
-
Collaborative Inference for AI-Empowered IoT Devices24 Jul 2022 0 repositories listed
-
Towards Receiver-Agnostic and Collaborative Radio Frequency Fingerprint Identification6 Jul 2022 0 repositories listed
-
Virtual staining of defocused autofluorescence images of unlabeled tissue using deep neural networks6 Jul 2022 0 repositories listed
-
Fault-Tolerant Collaborative Inference through the Edge-PRUNE Framework16 Jun 2022 0 repositories listed
-
C-NMT: A Collaborative Inference Framework for Neural Machine Translation8 Apr 2022 0 repositories listed
-
An Approach to Inference-Driven Dialogue Management within a Social Chatbot31 Oct 2021 0 repositories listed
-
Security Analysis of Capsule Network Inference using Horizontal Collaboration22 Sep 2021 0 repositories listed
-
EARLIN: Early Out-of-Distribution Detection for Resource-efficient Collaborative Inference25 Jun 2021 0 repositories listed
-
Communication-Efficient Split Learning Based on Analog Communication and Over the Air Aggregation2 Jun 2021 0 repositories listed
-
Energy-Efficient Model Compression and Splitting for Collaborative Inference Over Time-Varying Channels2 Jun 2021 0 repositories listed
-
SPINN: Synergistic Progressive Inference of Neural Networks over Device and Cloud14 Aug 2020 0 repositories listed
-
Collaborative Inference for Efficient Remote Monitoring12 Feb 2020 0 repositories listed
-
Edge AI: On-Demand Accelerating Deep Neural Network Inference via Edge Computing4 Oct 2019 0 repositories listed
-
Auto-tuning Neural Network Quantization Framework for Collaborative Inference Between the Cloud and Edge16 Dec 2018 0 repositories listed
-
Dictionary Learning over Distributed Models6 Feb 2014 0 repositories listed
-
Robust Multimodal Graph Matching: Sparse Coding Meets Graph Matching25 Nov 2013 0 repositories listed
Syntology lines on 7 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced; each line links to that paper's sample list. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections