| SciWalker: Synthesizing Scientific Coding Problems with Operator Graphs and Execution Feedback arXiv:2609.30054 |
24 Sep 2026 |
repository linked, no samples harvested |
rejected by the independent check |
| Register Tokens for Bounded-State Reasoning in Diffusion Language Models arXiv:2609.16372 |
14 Sep 2026 |
repository linked, no samples harvested |
refused by a rule: the model gave no value to check against the cell |
| Clustering-Based Balanced Sampling and Allocation with Data Parallelism for... arXiv:2609.12584 |
11 Sep 2026 |
10 harvested: 8 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 3 where Syntology's instrument failed) · 2 unverified |
refused by rules: the number the model quoted is not the number printed in the cell it pointed at; the table's column header does not name the leaderboard's metric; several configurations of the method, and no metric direction to pick one |
| Codebook Agent: Amortized Topology Design for LLM Multi-Agent Systems arXiv:2609.02264 |
2 Sep 2026 |
18 harvested: 16 ran (of which 0 constructed an object rather than computing a result; 7 with no instrument failure: 3 honoured, 2 violated, 2 with no contract checked; 9 where Syntology's instrument failed) · 2 unverified |
refused by a rule: the number the model quoted is not the number printed in the cell it pointed at |
| Archer: Adaptive Reuse of Cached Hidden States for Efficient Rollback in Diffusion... arXiv:2608.08086 |
8 Aug 2026 |
8 harvested: 7 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 6 where Syntology's instrument failed) · 1 unverified |
rejected by the independent check |
| Retrofitting Linear Attention into Diffusion Language Models arXiv:2608.06628 |
6 Aug 2026 |
1 harvested: 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; the one sample that ran constructed an object rather than computing a result |
refused by a rule: the table's column header does not name the leaderboard's metric |
| Omega-S: A Functional Resilience Index for LLM Fine-Tuning arXiv:2608.03887 |
4 Aug 2026 |
1 harvested: 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; the one sample that ran constructed an object rather than computing a result |
refused by a rule: the value is not on the scale of the leaderboard column's archive values |
| From Interface to Inference: Eliciting Any-Order Inference from Any-Order Models arXiv:2607.26504 |
29 Jul 2026 |
15 harvested: 7 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 4 where Syntology's instrument failed) · 8 unverified |
rejected by the independent check |
| REGEN: Replay-recycling for Expert-to-Generalist distillation with Offline... arXiv:2607.19450 |
21 Jul 2026 |
3 harvested: 3 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified |
refused by a rule: the number the model quoted is not the number printed in the cell it pointed at |
| AsyncLane: Decoupling Refinement from Advancement in Diffusion Language Model Decoding arXiv:2606.08411 |
7 Jun 2026 |
repository linked, no samples harvested |
refused by rules: the quoted value appears more than once in the row; one configuration gave two values for one column |
| TARPO: Token-Wise Latent-Explicit Reasoning via Action-Routing Policy Optimization arXiv:2606.05859 |
4 Jun 2026 |
18 harvested: 10 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 1 violated, 1 with no contract checked; 8 where Syntology's instrument failed) · 8 unverified |
rejected by the independent check |
| SemBlock: Semantic Boundary Dynamic Blocks for Diffusion LLMs arXiv:2606.04964 |
3 Jun 2026 |
2 harvested: 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified |
refused by rules: the table's column header does not name the leaderboard's metric; several configurations of the method, and no metric direction to pick one |
| MOC: Multi-Order Communication in LLM-based Multi-Agent Systems arXiv:2606.02359 |
1 Jun 2026 |
8 harvested: 8 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 1 honoured, 0 violated, 5 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified |
refused by a rule: the table's column header does not name the leaderboard's metric |
| ExpWeaver: LLM Agents Learn from Experience via Latent RAG arXiv:2606.01041 |
31 May 2026 |
repository linked, no samples harvested |
refused by a rule: the table's column header does not name the leaderboard's metric |
| D³: Dynamic Directional Graph-Constrained Data Scheduling for LLM Training arXiv:2605.31164 |
29 May 2026 |
repository linked, no samples harvested |
refused by a rule: the row label the model quoted is not the row's label |
| NaRA: Noise-Aware LoRA for Parameter-Efficient Fine-Tuning of Diffusion LLMs arXiv:2605.29716 |
28 May 2026 |
5 harvested: 4 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 4 where Syntology's instrument failed) · 1 unverified |
rejected by the independent check |
| GDSD: Reinforcement Learning as Guided Denoiser Self-Distillation for Diffusion Language Models arXiv:2605.29398 |
28 May 2026 |
13 harvested: 11 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 2 honoured, 1 violated, 1 with no contract checked; 7 where Syntology's instrument failed) · 2 unverified |
refused by a rule: the row is an ablation variant, not the method itself |
| Poison with Style: A Practical Poisoning Attack on Code Large Language Models arXiv:2605.27631 |
26 May 2026 |
11 harvested: 8 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 1 honoured, 1 violated, 1 with no contract checked; 5 where Syntology's instrument failed) · 3 unverified |
refused by a rule: several configurations of the method, and no metric direction to pick one |
| ReMoE: Boosting Expert Reuse through Router Fine-Tuning in Memory-Constrained MoE LLM Inference arXiv:2605.27081 |
26 May 2026 |
repository linked, no samples harvested |
refused by a rule: the table's column header does not name the leaderboard's metric |
| GAC: Noise-Aware Adaptive Mixing for Hybrid SFT-RL Post-Training arXiv:2605.26184 |
25 May 2026 |
repository linked, no samples harvested |
refused by a rule: the number the model quoted is not the number printed in the cell it pointed at |
| Beyond Inference-Time Search: Reinforcement Learning Synthesizes Reusable Solvers arXiv:2605.18374 |
18 May 2026 |
32 harvested: 32 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 2 honoured, 2 violated, 2 with no contract checked; 26 where Syntology's instrument failed) · 0 unverified |
refused by a rule: the model gave no value to check against the cell |
| RADAR: Redundancy-Aware Diffusion for Multi-Agent Communication Structure Generation arXiv:2605.09907 |
11 May 2026 |
10 harvested: 5 ran (of which 1 constructed an object rather than computing a result; 3 with no instrument failure: 1 honoured, 1 violated, 1 with no contract checked; 2 where Syntology's instrument failed) · 5 unverified |
refused by a rule: the number the model quoted is not the number printed in the cell it pointed at |
| DARE: Difficulty-Adaptive Reinforcement Learning with Co-Evolved Difficulty Estimation arXiv:2605.09188 |
9 May 2026 |
held, no recorded run |
rejected by the independent check |
| Don't Retrain, Align: Adapting Autoregressive LMs to Diffusion LMs via Representation Alignment arXiv:2605.06885 |
7 May 2026 |
7 harvested: 4 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 3 where Syntology's instrument failed) · 3 unverified |
refused by a rule: several configurations of the method, and no metric direction to pick one |
| Correct Is Not Enough: Training Reasoning Planners with Executor-Grounded Rewards arXiv:2605.03862 |
5 May 2026 |
3 harvested: 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 2 unverified |
refused by a rule: several configurations of the method, and no metric direction to pick one |
| Model Compression with Exact Budget Constraints via Riemannian Manifolds arXiv:2605.00649 |
1 May 2026 |
1 harvested: 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified |
refused by rules: the value is not on the scale of the leaderboard column's archive values; several configurations of the method, and no metric direction to pick one |
| GraphPlanner: Graph Memory-Augmented Agentic Routing for Multi-Agent LLMs arXiv:2604.23626 |
26 Apr 2026 |
16 harvested: 11 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 1 violated, 0 with no contract checked; 10 where Syntology's instrument failed) · 5 unverified |
refused by a rule: the table's column header does not name the leaderboard's metric |
| NI Sampling: Accelerating Discrete Diffusion Sampling by Token Order Optimization arXiv:2604.18471 |
20 Apr 2026 |
repository linked, no samples harvested |
rejected by the independent check |
| Pioneer Agent: Continual Improvement of Small Language Models in Production arXiv:2604.09791 |
10 Apr 2026 |
repository linked, no samples harvested |
refused by a rule: the row label the model quoted is not the row's label |
| Expert-Choice Routing Enables Adaptive Computation in Diffusion Language Models arXiv:2604.01622 |
2 Apr 2026 |
5 harvested: 5 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 1 honoured, 1 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified |
refused by a rule: several configurations of the method, and no metric direction to pick one |
| daVinci-Env: Open SWE Environment Synthesis at Scale arXiv:2603.13023 |
13 Mar 2026 |
2 harvested: 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified |
refused by a rule: the table's column header does not name the leaderboard's metric |
| MetaState: Persistent Working Memory Enhances Reasoning in Discrete Diffusion Language Models arXiv:2603.01331 |
2 Mar 2026 |
8 harvested: 8 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 1 honoured, 1 violated, 1 with no contract checked; 5 where Syntology's instrument failed) · 0 unverified |
refused by a rule: the row is an ablation variant, not the method itself |
| CoMoL: Efficient Mixture of LoRA Experts via Dynamic Core Space Merging arXiv:2603.00573 |
28 Feb 2026 |
held, no recorded run |
refused by a rule: the table does not name the leaderboard's dataset |
| UpSkill: Mutual Information Skill Learning for Structured Response Diversity in LLMs arXiv:2602.22296 |
25 Feb 2026 |
22 harvested: 21 ran (of which 0 constructed an object rather than computing a result; 11 with no instrument failure: 5 honoured, 1 violated, 5 with no contract checked; 10 where Syntology's instrument failed) · 1 unverified |
refused by a rule: one configuration gave two values for one column |
| ThinkRouter: Efficient Reasoning via Routing Thinking between Latent and Discrete Spaces arXiv:2602.11683 |
12 Feb 2026 |
16 harvested: 13 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 1 honoured, 0 violated, 5 with no contract checked; 7 where Syntology's instrument failed) · 3 unverified |
refused by a rule: one configuration gave two values for one column |
| Proxy Compression for Language Modeling arXiv:2602.04289 |
4 Feb 2026 |
repository linked, no samples harvested |
refused by a rule: several configurations of the method, and no metric direction to pick one |
| Multi-task Code LLMs: Data Mix or Model Merge? arXiv:2601.21115 |
28 Jan 2026 |
1 harvested: 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified |
refused by a rule: the value is not on the scale of the leaderboard column's archive values |
| Context-Augmented Code Generation Using Programming Knowledge Graphs arXiv:2601.20810 |
28 Jan 2026 |
4 harvested: 4 ran (of which 2 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 1 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified |
refused by a rule: several configurations of the method, and no metric direction to pick one |
| OFA-MAS: One-for-All Multi-Agent System Topology Design based on Mixture-of-Experts... arXiv:2601.12996 |
19 Jan 2026 |
4 harvested: 4 ran (of which 4 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; every one of the 4 samples that ran constructed an object rather than computing a result |
refused by a rule: the number the model quoted is not the number printed in the cell it pointed at |
| TopoDIM: One-shot Topology Generation of Diverse Interaction Modes for Multi-Agent Systems arXiv:2601.10120 |
15 Jan 2026 |
3 harvested: 3 ran (of which 2 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 1 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified |
refused by a rule: the number the model quoted is not the number printed in the cell it pointed at |
| ShortCoder: Knowledge-Augmented Syntax Optimization for Token-Efficient Code Generation arXiv:2601.09703 |
14 Jan 2026 |
3 harvested: 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified |
refused by a rule: the value is not on the scale of the leaderboard column's archive values |
| Conditional Memory via Scalable Lookup: A New Axis of Sparsity for Large Language Models arXiv:2601.07372 |
12 Jan 2026 |
8 harvested: 6 ran (of which 4 constructed an object rather than computing a result; 6 with no instrument failure: 1 honoured, 0 violated, 5 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified |
refused by a rule: the table's column header does not name the leaderboard's metric |
| Stable On-Policy Distillation through Adaptive Target Reformulation arXiv:2601.07155 |
12 Jan 2026 |
1 harvested: 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified |
rejected by the independent check |
| All-Quadrant Bounded Clipping GRPO: Closing the Unbounded Blind Spot for Stable and... arXiv:2601.03895 |
7 Jan 2026 |
12 harvested: 11 ran (of which 0 constructed an object rather than computing a result; 8 with no instrument failure: 4 honoured, 2 violated, 2 with no contract checked; 3 where Syntology's instrument failed) · 1 unverified |
rejected by the independent check |
| LoRA-Drop: Temporal LoRA Decoding for Efficient LLM Inference arXiv:2601.02569 |
5 Jan 2026 |
8 harvested: 6 ran (of which 5 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 1 where Syntology's instrument failed) · 2 unverified |
refused by a rule: the row label the model quoted is not the row's label |
| CD4LM: Consistency Distillation and aDaptive Decoding for Diffusion Language Models arXiv:2601.02236 |
5 Jan 2026 |
10 harvested: 7 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 2 honoured, 0 violated, 2 with no contract checked; 3 where Syntology's instrument failed) · 3 unverified |
refused by a rule: the model pointed at a header row |
| Fast and Accurate Causal Parallel Decoding using Jacobi Forcing arXiv:2512.14681 |
16 Dec 2025 |
7 harvested: 6 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 5 where Syntology's instrument failed) · 1 unverified |
refused by a rule: the table's column header does not name the leaderboard's metric |
| PuzzleMoE: Efficient Compression of Large Mixture-of-Experts Models via Sparse Expert... arXiv:2511.04805 |
6 Nov 2025 |
8 harvested: 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 6 unverified |
refused by a rule: several configurations of the method, and no metric direction to pick one |
| Utility-Diversity Aware Online Batch Selection for LLM Supervised Fine-tuning arXiv:2510.16882 |
19 Oct 2025 |
repository linked, no samples harvested |
refused by a rule: the number the model quoted is not the number printed in the cell it pointed at |
| AMiD: Knowledge Distillation for LLMs with α-mixture Assistant Distribution arXiv:2510.15982 |
13 Oct 2025 |
1 harvested: 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified |
refused by a rule: several configurations of the method, and no metric direction to pick one |
| APLOT: Robust Reward Modeling via Adaptive Preference Learning with Optimal Transport arXiv:2510.10963 |
13 Oct 2025 |
9 harvested: 6 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 1 violated, 3 with no contract checked; 2 where Syntology's instrument failed) · 3 unverified |
refused by a rule: the row label the model quoted is not the row's label |
| FlyLoRA: Boosting Task Decoupling and Parameter Efficiency via Implicit Rank-Wise... arXiv:2510.08396 |
9 Oct 2025 |
1 harvested: 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; the one sample that ran constructed an object rather than computing a result |
refused by a rule: the model gave no value to check against the cell |
| MobileLLM-R1: Exploring the Limits of Sub-Billion Language Model Reasoners with Open... arXiv:2509.24945 |
29 Sep 2025 |
repository linked, no samples harvested |
refused by a rule: several configurations of the method, and no metric direction to pick one |
| Optimizing Token Choice for Code Watermarking: An RL Approach arXiv:2508.11925 |
16 Aug 2025 |
5 harvested: 3 ran (of which 2 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 1 where Syntology's instrument failed) · 2 unverified |
rejected by the independent check |