Browse State-of-the-Art › Inference Optimization
Inference Optimization
21 papers with code · 0 benchmarks · 0 datasets archive 2025-07-28
Benchmarks archive 2025-07-28
No benchmark for this task in the archive.
Libraries
Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.
Datasets archive 2025-07-28
No dataset record in the archive lists this task.
Subtasks archive 2025-07-28
No subtask under this task in the archive's task tree.
Parent tasks archive 2025-07-28
Papers archive 2025-07-28
archive papers tagged: 56 · with a code link: 21 · where Syntology ran a sample: 5 (5 with a run with no instrument failure, 0 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (5 of 56 tagged: 5 with a run with no instrument failure, 0 where every run was a failure of Syntology's instrument)
Page 1 of 1: papers 1 to 56 of 56, in archive order: by repositories listed in the archive (most first), then newest first, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers that list no repository come after every paper that lists one.
Papers without a page here are shown as plain text. A Syntology line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the figure “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code); hover it for the repositories the samples that ran came from. The first sentence of the abstract is shown for the first 30 papers; every abstract is on its paper's page.
-
11 Jul 2022 3 repositories listedGuided by this, we first assume that we have a reference graph that is related to the sought graph (in the sense of having similar motif densities) and then, we exploit this relation by incorporating a similarity…
-
22 Sep 2016 3 repositories listed Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 2 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 4 harvested samples)We show that many existing neural network architectures can be made input-convex with a minor modification, and develop specialized optimization algorithms tailored to this setting.
-
28 Sep 2024 2 repositories listedThis paper works on Binary Neural Networks (BNNs), a promising avenue for efficient deep learning, offering significant reductions in computational overhead and memory footprint to full precision networks.
-
26 Jul 2024 2 repositories listedThis paper introduces Patched MOA (Mixture of Agents), an inference optimization technique that significantly enhances the performance of large language models (LLMs) across diverse software development tasks.
-
4 Sep 2023 2 repositories listed Syntology official (archive's flag): 9 ran · 9 ran (of which 0 constructed an object rather than computing a result; 9 with no instrument failure: 0 honoured, 0 violated, 9 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 10 harvested samples)In this paper, we generalize this approach to cellular complexes and introduce the flow representation learning problem, i. e., the problem of augmenting the observed graph by a set of cells, such that the eigenvectors…
-
10 Jun 2025 1 repository listedA significant portion of the energy consumed by Large Language Models (LLMs) arises from their inference processes; hence developing energy-efficient methods for inference is crucial.
-
15 Apr 2025 1 repository listedLarge Language Models (LLMs) are indispensable in today's applications, but their inference procedure -- generating responses by processing text in segments and using a memory-heavy Key-Value (KV) cache -- demands…
-
15 Apr 2025 1 repository listed Syntology official (archive's flag): 5 ran · 5 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 2 where Syntology's instrument failed) · 6 unverified (of 11 harvested samples) · 4 pointer-only (licence)This work presents SimpleAR, a vanilla autoregressive visual generation framework without complex architecure modifications.
-
7 Apr 2025 1 repository listedMotion expression video segmentation is designed to segment objects in accordance with the input motion expressions.
-
18 Dec 2024 1 repository listedThis survey provides both a structured overview of existing solutions and identifies key challenges and promising research directions in MoE inference optimization.
-
28 Oct 2024 1 repository listedRecent research has challenged the necessity of complex deep learning architectures for time series forecasting, demonstrating that simple linear models can often outperform sophisticated approaches.
-
17 Oct 2024 1 repository listedWe call this pruning method MLPRank.
-
4 Aug 2024 1 repository listedThrough instruction tuning on our dataset, the assistant, named LLaSA, demonstrates the potential to function as an omnipotent assistant.
-
10 Jul 2024 1 repository listed Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 1 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)Large language models (LLMs) have shown exceptional performance and vast potential across diverse tasks.
-
4 Aug 2023 1 repository listed Syntology official (archive's flag): 13 ran · 13 ran (of which 0 constructed an object rather than computing a result; 10 with no instrument failure: 1 honoured, 6 violated, 3 with no contract checked; 3 where Syntology's instrument failed) · 3 unverified (of 16 harvested samples) · 9 pointer-only (licence)Painterly image harmonization aims to insert photographic objects into paintings and obtain artistically coherent composite images.
-
15 Jan 2023 1 repository listedInstead of having every sample go through all DNN layers during prediction, EENet learns an early exit scheduler, which can intelligently terminate the inference earlier for certain predictions, which the model has high…
-
21 Dec 2021 1 repository listedHowever, these methods inherently suffer from the ill-posedness of the joint reconstruction problem.
-
1 Nov 2021 1 repository listedInferring music time structures has a broad range of applications in music production, processing and analysis.
-
26 Apr 2021 1 repository listedTo fill such a gap, we introduce a scalable inference solution: Easy and Efficient Transformer (EET), including a series of transformer inference optimization at the algorithm and implementation levels.
-
13 Nov 2018 1 repository listed Syntology official: harvested, nothing ran · 0 ran · 1 unverified (of 1 harvested sample)We introduce the variational filtering EM algorithm, a simple, general-purpose method for performing variational inference in dynamical latent variable models using information from only past and present variables, i.…
-
24 Jul 2018 1 repository listedThe failure of these models to reach fully optimized approximate posterior estimates results in an amortization gap.
-
Sub-MoE: Efficient Mixture-of-Expert LLMs Compression via Subspace Expert Merging29 Jun 2025 0 repositories listedMixture of Experts (MoE) LLMs face significant obstacles due to their massive parameter scale, which imposes memory, storage, and deployment challenges.
-
The Foundation Cracks: A Comprehensive Study on Bugs and Testing Practices in LLM Libraries14 Jun 2025 0 repositories listedLarge Language Model (LLM) libraries have emerged as the foundational infrastructure powering today's AI revolution, serving as the backbone for LLM deployment, inference optimization, fine-tuning, and production…
-
DSMentor: Enhancing Data Science Agents with Curriculum Learning and Online Knowledge Accumulation20 May 2025 0 repositories listedLarge language model (LLM) agents have shown promising performance in generating code for solving complex data science problems.
-
Faster MoE LLM Inference for Extremely Large Models6 May 2025 0 repositories listedSparse Mixture of Experts (MoE) large language models (LLMs) are gradually becoming the mainstream approach for ultra-large-scale models.
-
Energy-Efficient Transformer Inference: Optimization Strategies for Time Series Classification23 Feb 2025 0 repositories listedThe increasing computational demands of transformer models in time series classification necessitate effective optimization strategies for energy-efficient deployment.
-
Hybrid Offline-online Scheduling Method for Large Language Model Inference Optimization14 Feb 2025 0 repositories listedWith the development of large language models (LLMs), it has become increasingly important to optimize hardware usage and improve throughput.
-
DVFS-Aware DNN Inference on GPUs: Latency Modeling and Performance Analysis10 Feb 2025 0 repositories listedThe rapid development of deep neural networks (DNNs) is inherently accompanied by the problem of high computational costs.
-
Hellinger-Kantorovich Gradient Flows: Global Exponential Decay of Entropy Functionals28 Jan 2025 0 repositories listedWe investigate a family of gradient flows of positive and probability measures, focusing on the Hellinger-Kantorovich (HK) geometry, which unifies transport mechanism of Otto-Wasserstein, and the birth-death mechanism…
-
FluidML: Fast and Memory Efficient Inference Optimization14 Nov 2024 0 repositories listedMachine learning models deployed on edge devices have enabled numerous exciting new applications, such as humanoid robots, AR glasses, and autonomous vehicles.
-
EdgeRL: Reinforcement Learning-driven Deep Learning Model Inference Optimization at Edge16 Oct 2024 0 repositories listed
-
Revisiting SMoE Language Models by Evaluating Inefficiencies with Task Specific Expert Pruning2 Sep 2024 0 repositories listed
-
The Ultimate Guide to Fine-Tuning LLMs from Basics to Breakthroughs: An Exhaustive Review of Technologies, Research, Best Practices, Applied Research Challenges and Opportunities23 Aug 2024 0 repositories listed
-
An approach to optimize inference of the DIART speaker diarization pipeline5 Aug 2024 0 repositories listed
-
Inference Optimization of Foundation Models on AI Accelerators12 Jul 2024 0 repositories listed
-
Robust Zero-Shot Text-to-Speech Synthesis with Reverse Inference Optimization2 Jul 2024 0 repositories listed
-
Scaling the Vocabulary of Non-autoregressive Models for Efficient Generative Retrieval10 Jun 2024 0 repositories listed
-
Efficiency optimization of large-scale language models based on deep learning in natural language processing tasks20 May 2024 0 repositories listed
-
Advances and Open Challenges in Federated Foundation Models23 Apr 2024 0 repositories listed
-
Federated Learning While Providing Model as a Service: Joint Training and Inference Optimization20 Dec 2023 0 repositories listed
-
Integrating Pre-Trained Speech and Language Models for End-to-End Speech Recognition6 Dec 2023 0 repositories listed
-
SySMOL: Co-designing Algorithms and Hardware for Neural Networks with Heterogeneous Precisions23 Nov 2023 0 repositories listed
-
Bayesian Active Learning in the Presence of Nuisance Parameters23 Oct 2023 0 repositories listed
-
Residual-Based Error Corrector Operator to Enhance Accuracy and Reliability of Neural Operator Surrogates of Nonlinear Variational Boundary-Value Problems21 Jun 2023 0 repositories listed
-
Networked Signal and Information Processing25 Oct 2022 0 repositories listed
-
6 Jul 2022 0 repositories listed
-
Easy and Efficient Transformer: Scalable Inference Solution For Large NLP Model1 Jul 2022 0 repositories listed
-
SBbadger: Biochemical Reaction Networks with Definable Degree Distributions25 Feb 2022 0 repositories listed
-
Bifocal Neural ASR: Exploiting Keyword Spotting for Inference Optimization3 Aug 2021 0 repositories listed
-
Developing efficient transfer learning strategies for robust scene recognition in mobile robotics using pre-trained convolutional neural networks23 Jul 2021 0 repositories listed
-
Investigations on the inference optimization techniques and their impact on multiple hardware platforms for Semantic Segmentation29 Nov 2019 0 repositories listed
-
SNDCNN: Self-normalizing deep CNNs with scaled exponential linear units for speech recognition4 Oct 2019 0 repositories listed
-
A bi-partite generative model framework for analyzing and simulating large scale multiple discrete-continuous travel behaviour data18 Jan 2019 0 repositories listed
-
Deep Signal Recovery with One-Bit Quantization30 Nov 2018 0 repositories listed
-
CRVI: Convex Relaxation for Variational Inference1 Jul 2018 0 repositories listed
-
Learning to Infer1 Jan 2018 0 repositories listed
Syntology lines on 6 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced; each line links to that paper's sample list. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections