Methods › General › Ensembling › MoE › Papers, page 4
Mixture of Experts
MoE
Papers archive 2025-07-28
archive papers tagged: 366 · with a code link: 142 · where Syntology ran a sample: 64 (49 with a run with no instrument failure, 15 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (64 of 366 tagged: 49 with a run with no instrument failure, 15 where every run was a failure of Syntology's instrument)
Page 4 of 4: papers 301 to 366 of 366, newest first by the archive's date (ties by slug), in archive order.
Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code, as “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. It is per sample and not a correctness claim. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from.
-
Mixture of Experts in a Mixture of RL settings 26 Jun 2024 · 0 repositories · arXiv:2406.18420
-
SC-MoE: Switch Conformer Mixture of Experts for Unified Streaming and Non-streaming Code-Switching ASR 26 Jun 2024 · 0 repositories · arXiv:2406.18021
-
MoE-CT: A Novel Approach For Large Language Models Training With Resistance To Catastrophic Forgetting 25 Jun 2024 · 0 repositories · arXiv:2407.00875
-
LLaMA-MoE: Building Mixture-of-Experts from LLaMA with Continual Pre-training 24 Jun 2024 · 2 repositories · arXiv:2406.16554
-
Theory on Mixture-of-Experts in Continual Learning 24 Jun 2024 · 0 repositories · arXiv:2406.16437
-
AdaMoE: Token-Adaptive Routing with Null Experts for Mixture-of-Experts Language Models 19 Jun 2024 · 1 repository · arXiv:2406.13233Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 1 where Syntology's instrument failed) · 2 unverified (of 5 harvested samples) · 5 pointer-only (licence)
-
GW-MoE: Resolving Uncertainty in MoE Router with Global Workspace Theory 18 Jun 2024 · 1 repository · arXiv:2406.12375
-
Variational Distillation of Diffusion Policies into Mixture of Experts 18 Jun 2024 · 0 repositories · arXiv:2406.12538
-
Dynamic Data Mixing Maximizes Instruction Tuning for Mixture-of-Experts 17 Jun 2024 · 1 repository · arXiv:2406.11256Syntology official (archive's flag): 8 ran · 8 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified (of 8 harvested samples)
-
MoE-RBench: Towards Building Reliable Language Models with Sparse Mixture-of-Experts 17 Jun 2024 · 1 repository · arXiv:2406.11353
-
Towards Efficient Pareto Set Approximation via Mixture of Experts Based Model Fusion 14 Jun 2024 · 1 repository · arXiv:2406.09770
-
Examining Post-Training Quantization for Mixture-of-Experts: A Benchmark 12 Jun 2024 · 1 repository · arXiv:2406.08155Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 5 unverified (of 6 harvested samples)
-
MoE Jetpack: From Dense Checkpoints to Adaptive Mixture of Experts for Vision Tasks 7 Jun 2024 · 1 repository · arXiv:2406.04801Syntology official (archive's flag): 6 ran · 6 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 7 harvested samples)
-
Filtered not Mixed: Stochastic Filtering-Based Online Gating for Mixture of Large Language Models 5 Jun 2024 · 0 repositories · arXiv:2406.02969
-
Style Mixture of Experts for Expressive Text-To-Speech Synthesis 5 Jun 2024 · 0 repositories · arXiv:2406.03637
-
Demystifying the Compression of Mixture-of-Experts Through a Unified Framework 4 Jun 2024 · 1 repository · arXiv:2406.02500Syntology official (archive's flag): 5 ran · 5 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 0 where Syntology's instrument failed) · 6 unverified (of 11 harvested samples)
-
Leveraging Visual Tokens for Extended Text Contexts in Multi-Modal Learning 4 Jun 2024 · 1 repository · arXiv:2406.02547Syntology official (archive's flag): 9 ran · 9 ran (of which 0 constructed an object rather than computing a result; 9 with no instrument failure: 0 honoured, 2 violated, 7 with no contract checked; 0 where Syntology's instrument failed) · 5 unverified (of 14 harvested samples) · 14 pointer-only (licence)
-
Parrot: Multilingual Visual Instruction Tuning 4 Jun 2024 · 2 repositories · arXiv:2406.02539Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 4 unverified (of 7 harvested samples)
-
Demystifying AI Platform Design for Distributed Inference of Next-Generation LLM models 3 Jun 2024 · 1 repository · arXiv:2406.01698
-
Skywork-MoE: A Deep Dive into Training Techniques for Mixture-of-Experts Language Models 3 Jun 2024 · 1 repository · arXiv:2406.06563Syntology 3 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples) · 1 pointer-only (licence)
-
Optimizing 6G Integrated Sensing and Communications (ISAC) via Expert Networks 1 Jun 2024 · 0 repositories · arXiv:2406.00408
-
MEMoE: Enhancing Model Editing with Mixture of Experts Adaptors 29 May 2024 · 0 repositories · arXiv:2405.19086
-
MoNDE: Mixture of Near-Data Experts for Large-Scale Sparse Models 29 May 2024 · 0 repositories · arXiv:2405.18832
-
A Provably Effective Method for Pruning Experts in Fine-tuned Sparse Mixture-of-Experts 26 May 2024 · 0 repositories · arXiv:2405.16646
-
Expert-Token Resonance: Redefining MoE Routing through Affinity-Driven Active Selection 24 May 2024 · 0 repositories · arXiv:2406.00023
-
Revisiting MoE and Dense Speed-Accuracy Comparisons for LLM Training 23 May 2024 · 1 repository · arXiv:2405.15052
-
Statistical Advantages of Perturbing Cosine Router in Mixture of Experts 23 May 2024 · 0 repositories · arXiv:2405.14131
-
Unchosen Experts Can Contribute Too: Unleashing MoE Models' Power by Self-Contrast 23 May 2024 · 1 repository · arXiv:2405.14507Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples) · 2 pointer-only (licence)
-
MeteoRA: Multiple-tasks Embedded LoRA for Large Language Models 19 May 2024 · 1 repository · arXiv:2405.13053Syntology official (archive's flag): 8 ran · 8 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 3 honoured, 0 violated, 2 with no contract checked; 3 where Syntology's instrument failed) · 2 unverified (of 10 harvested samples) · 10 pointer-only (licence)
-
Uni-MoE: Scaling Unified Multimodal LLMs with Mixture of Experts 18 May 2024 · 1 repository · arXiv:2405.11273Syntology official (archive's flag): 6 ran · 6 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 3 where Syntology's instrument failed) · 2 unverified (of 8 harvested samples) · 8 pointer-only (licence)
-
Harnessing Hierarchical Label Distribution Variations in Test Agnostic Long-tail Recognition 13 May 2024 · 1 repository · arXiv:2405.07780Syntology official (archive's flag): 1 ran · 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; the one sample that ran constructed an object rather than computing a result (of 1 harvested sample) · 1 pointer-only (licence)
-
A Mixture of Experts Approach to 3D Human Motion Prediction 9 May 2024 · 1 repository · arXiv:2405.06088
-
CuMo: Scaling Multimodal LLM with Co-Upcycled Mixture-of-Experts 9 May 2024 · 1 repository · arXiv:2405.05949Syntology official (archive's flag): 11 ran · 11 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 1 violated, 5 with no contract checked; 5 where Syntology's instrument failed) · 1 unverified (of 12 harvested samples) · 1 pointer-only (licence)
-
EWMoE: An effective model for global weather forecasting with mixture-of-experts 9 May 2024 · 1 repository · arXiv:2405.06004
-
Lory: Fully Differentiable Mixture-of-Experts for Autoregressive Language Model Pre-training 6 May 2024 · 0 repositories · arXiv:2405.03133
-
WDMoE: Wireless Distributed Large Language Models with Mixture of Experts 6 May 2024 · 0 repositories · arXiv:2405.03131
-
MVMoE: Multi-Task Vehicle Routing Solver with Mixture-of-Experts 2 May 2024 · 2 repositories · arXiv:2405.01029Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 2 where Syntology's instrument failed) · 1 unverified (of 5 harvested samples)
-
Powering In-Database Dynamic Model Slicing for Structured Data Analytics 1 May 2024 · 0 repositories · arXiv:2405.00568
-
Lancet: Accelerating Mixture-of-Experts Training via Whole Graph Computation-Communication Overlapping 30 Apr 2024 · 0 repositories · arXiv:2404.19429
-
Integration of Mixture of Experts and Multimodal Generative AI in Internet of Vehicles: A Survey 25 Apr 2024 · 0 repositories · arXiv:2404.16356
-
Prediction Is All MoE Needs: Expert Load Distribution Goes from Fluctuating to Stabilizing 25 Apr 2024 · 0 repositories · arXiv:2404.16914
-
U2++ MoE: Scaling 4.7x parameters with minimal impact on RTF 25 Apr 2024 · 0 repositories · arXiv:2404.16407
-
XFT: Unlocking the Power of Code Instruction Tuning by Simply Merging Upcycled Mixture-of-Experts 23 Apr 2024 · 1 repository · arXiv:2404.15247Syntology official (archive's flag): 11 ran · 11 ran (of which 0 constructed an object rather than computing a result; 9 with no instrument failure: 0 honoured, 0 violated, 9 with no contract checked; 2 where Syntology's instrument failed) · 3 unverified (of 14 harvested samples)
-
MixLoRA: Enhancing Large Language Models Fine-Tuning with LoRA-based Mixture of Experts 22 Apr 2024 · 2 repositories · arXiv:2404.15159Syntology official (archive's flag): 6 ran · 6 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 0 where Syntology's instrument failed) · 5 unverified (of 11 harvested samples)
-
Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phone 22 Apr 2024 · 0 repositories · arXiv:2404.14219
-
Med-MoE: Mixture of Domain-Specific Experts for Lightweight Medical Vision-Language Models 16 Apr 2024 · 2 repositories · arXiv:2404.10237Syntology official (archive's flag): 7 ran · 7 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 3 where Syntology's instrument failed) · 5 unverified (of 12 harvested samples) · 2 pointer-only (licence)
-
Ctrl-Adapter: An Efficient and Versatile Framework for Adapting Diverse Controls to Any Diffusion Model 15 Apr 2024 · 0 repositories · arXiv:2404.09967
-
MoE-FFD: Mixture of Experts for Generalized and Parameter-Efficient Face Forgery Detection 12 Apr 2024 · 1 repository · arXiv:2404.08452Syntology official (archive's flag): 6 ran · 6 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 6 harvested samples) · 6 pointer-only (licence)
-
Dense Training, Sparse Inference: Rethinking Training of Mixture-of-Experts Language Models 8 Apr 2024 · 0 repositories · arXiv:2404.05567
-
Physics of Language Models: Part 3.3, Knowledge Capacity Scaling Laws 8 Apr 2024 · 0 repositories · arXiv:2404.05405
-
SEER-MoE: Sparse Expert Efficiency through Regularization for Mixture-of-Experts 7 Apr 2024 · 0 repositories · arXiv:2404.05089
-
Shortcut-connected Expert Parallelism for Accelerating Mixture-of-Experts 7 Apr 2024 · 0 repositories · arXiv:2404.05019
-
Toward Inference-optimal Mixture-of-Expert Large Language Models 3 Apr 2024 · 0 repositories · arXiv:2404.02852
-
Two Heads are Better than One: Nested PoE for Robust Defense Against Multi-Backdoors 2 Apr 2024 · 1 repository · arXiv:2404.02356Syntology official: harvested, nothing ran · 0 ran · 1 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
Prompt-prompted Adaptive Structured Pruning for Efficient LLM Generation 1 Apr 2024 · 1 repository · arXiv:2404.01365Syntology official (archive's flag): 9 ran · 9 ran (of which 0 constructed an object rather than computing a result; 7 with no instrument failure: 0 honoured, 1 violated, 6 with no contract checked; 2 where Syntology's instrument failed) · 1 unverified (of 10 harvested samples) · 10 pointer-only (licence)
-
Jamba: A Hybrid Transformer-Mamba Language Model 28 Mar 2024 · 3 repositories · arXiv:2403.19887
-
Mini-Gemini: Mining the Potential of Multi-modality Vision Language Models 27 Mar 2024 · 2 repositories · arXiv:2403.18814Syntology official (archive's flag): 8 ran · 8 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 1 honoured, 1 violated, 3 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified (of 8 harvested samples) · 1 pointer-only (licence)
-
Generalization Error Analysis for Sparse Mixture-of-Experts: A Preliminary Study 26 Mar 2024 · 0 repositories · arXiv:2403.17404
-
Multi-Task Dense Prediction via Mixture of Low-Rank Experts 26 Mar 2024 · 1 repository · arXiv:2403.17749Syntology official (archive's flag): 9 ran · 9 ran (of which 0 constructed an object rather than computing a result; 7 with no instrument failure: 0 honoured, 0 violated, 7 with no contract checked; 2 where Syntology's instrument failed) · 2 unverified (of 11 harvested samples) · 11 pointer-only (licence)
-
Tiny Models are the Computational Saver for Large Models 26 Mar 2024 · 1 repository · arXiv:2403.17726
-
Boosting Continual Learning of Vision-Language Models via Mixture-of-Experts Adapters 18 Mar 2024 · 2 repositories · arXiv:2403.11549Syntology official (archive's flag): 2 ran · 2 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 1 where Syntology's instrument failed) · 2 unverified (of 4 harvested samples) · 4 pointer-only (licence)
-
MoPE: Mixture of Prompt Experts for Parameter-Efficient and Scalable Multimodal Fusion 14 Mar 2024 · 1 repository · arXiv:2403.10568
-
Branch-Train-MiX: Mixing Expert LLMs into a Mixture-of-Experts LLM 12 Mar 2024 · 1 repository · arXiv:2403.07816
-
Equipping Computational Pathology Systems with Artifact Processing Pipelines: A Showcase for Computation and Performance Trade-offs 12 Mar 2024 · 1 repository · arXiv:2403.07743
-
Harder Tasks Need More Experts: Dynamic Routing in MoE Models 12 Mar 2024 · 1 repository · arXiv:2403.07652Syntology official (archive's flag): 2 ran · 4 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 4 where Syntology's instrument failed) · 0 unverified (of 4 harvested samples) · 4 pointer-only (licence)
-
ST-MoE: Designing Stable and Transferable Sparse Expert Models 17 Feb 2022 · 3 repositories · arXiv:2202.08906Syntology community repositories only · 5 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 3 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 5 harvested samples) · 5 pointer-only (licence)