Browse State-of-the-Art › Benchmarking › Papers, page 31

Benchmarking

Papers archive 2025-07-28

archive papers tagged: 5,548 · with a code link: 2,658 · where Syntology ran a sample: 749 (624 with a run with no instrument failure, 125 where every run was a failure of Syntology's instrument) Syntology

Show: all tagged papersonly where code ran (749 of 5,548 tagged: 624 with a run with no instrument failure, 125 where every run was a failure of Syntology's instrument)

Page 31 of 56: papers 3,001 to 3,100 of 5,548, in archive order: by repositories listed in the archive (most first), then newest first, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers that list no repository come after every paper that lists one.

Papers without a page here are shown as plain text. A Syntology line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the figure “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code); hover it for the repositories the samples that ran came from. Abstracts are on each paper's page.

• Benchmarking Biopharmaceuticals Retrieval-Augmented Generation Evaluation
  15 Apr 2025 0 repositories listed Syntology 9 ran (of which 0 constructed an object rather than computing a result; 9 with no instrument failure: 0 honoured, 0 violated, 9 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 10 harvested samples)
• Benchmarking Next-Generation Reasoning-Focused Large Language Models in Ophthalmology: A Head-to-Head Evaluation on 5,888 Items
  15 Apr 2025 0 repositories listed
• Benchmarking Vision Language Models on German Factual Data
  15 Apr 2025 0 repositories listed
• CLASH: Evaluating Language Models on Judging High-Stakes Dilemmas from Multiple Perspectives
  15 Apr 2025 0 repositories listed
• E2E Parking Dataset: An Open Benchmark for End-to-End Autonomous Parking
  15 Apr 2025 0 repositories listed
• GaSLight: Gaussian Splats for Spatially-Varying Lighting in HDR
  15 Apr 2025 0 repositories listed
• Benchmarking 3D Human Pose Estimation Models Under Occlusions
  14 Apr 2025 0 repositories listed
• Benchmarking Practices in LLM-driven Offensive Security: Testbeds, Metrics, and Experiment Design
  14 Apr 2025 0 repositories listed
• Beyond Chains of Thought: Benchmarking Latent-Space Reasoning Abilities in Large Language Models
  14 Apr 2025 0 repositories listed
• BoTTA: Benchmarking on-device Test Time Adaptation
  14 Apr 2025 0 repositories listed
• CameraBench: Benchmarking Visual Reasoning in MLLMs via Photography
  14 Apr 2025 0 repositories listed
• COUNTS: Benchmarking Object Detectors and Multimodal Large Language Models under Distribution Shifts
  14 Apr 2025 0 repositories listed
• Foundation Models for Remote Sensing: An Analysis of MLLMs for Object Localization
  14 Apr 2025 0 repositories listed
• LMFormer: Lane based Motion Prediction Transformer
  14 Apr 2025 0 repositories listed
• NoTeS-Bank: Benchmarking Neural Transcription and Search for Scientific Notes Understanding
  12 Apr 2025 0 repositories listed
• SortBench: Benchmarking LLMs based on their ability to sort lists
  11 Apr 2025 0 repositories listed
• TP-RAG: Benchmarking Retrieval-Augmented Large Language Model Agents for Spatiotemporal-Aware Travel Planning
  11 Apr 2025 0 repositories listed
• Benchmarking Image Embeddings for E-Commerce: Evaluating Off-the Shelf Foundation Models, Fine-Tuning Strategies and Practical Trade-offs
  10 Apr 2025 0 repositories listed
• Benchmarking Multi-Organ Segmentation Tools for Multi-Parametric T1-weighted Abdominal MRI
  10 Apr 2025 0 repositories listed
• SydneyScapes: Image Segmentation for Australian Environments
  10 Apr 2025 0 repositories listed
• A Roadmap for Improving Data Reliability and Sharing in Crosslinking Mass Spectrometry
  9 Apr 2025 0 repositories listed
• Benchmarking Convolutional Neural Network and Graph Neural Network based Surrogate Models on a Real-World Car External Aerodynamics Dataset
  9 Apr 2025 0 repositories listed
• Can Carbon-Aware Electric Load Shifting Reduce Emissions? An Equilibrium-Based Analysis
  9 Apr 2025 0 repositories listed
• RayFronts: Open-Set Semantic Ray Frontiers for Online Scene Understanding and Exploration
  9 Apr 2025 0 repositories listed
• TabKAN: Advancing Tabular Data Analysis using Kolmogorov-Arnold Network
  9 Apr 2025 0 repositories listed
• A Solid-State Nanopore Signal Generator for Training Machine Learning Models
  7 Apr 2025 0 repositories listed
• Cross-functional transferability in universal machine learning interatomic potentials
  7 Apr 2025 0 repositories listed
• Generative Adversarial Networks with Limited Data: A Survey and Benchmarking
  7 Apr 2025 0 repositories listed
• Leveraging State Space Models in Long Range Genomics
  7 Apr 2025 0 repositories listed
• Prism: Dynamic and Flexible Benchmarking of LLMs Code Generation with Monte Carlo Tree Search
  7 Apr 2025 0 repositories listed
• Riemannian Geometry for the classification of brain states with intracortical brain-computer interfaces
  7 Apr 2025 0 repositories listed
• Towards Visual Text Grounding of Multimodal Large Language Model
  7 Apr 2025 0 repositories listed
• Can AI Master Construction Management (CM)? Benchmarking State-of-the-Art Large Language Models on CM Certification Exams
  4 Apr 2025 0 repositories listed
• MME-Unify: A Comprehensive Benchmark for Unified Multimodal Understanding and Generation Models
  4 Apr 2025 0 repositories listed
• Point Cloud Objective Quality: Benchmarking Features and Quality Evaluation
  4 Apr 2025 0 repositories listed
• Sustainable LLM Inference for Edge AI: Evaluating Quantized LLMs for Energy Efficiency, Output Accuracy, and Inference Latency
  4 Apr 2025 0 repositories listed
• Towards a Unified Framework for Determining Conformational Ensembles of Disordered Proteins
  4 Apr 2025 0 repositories listed
• Benchmark of Segmentation Techniques for Pelvic Fracture in CT and X-ray: Summary of the PENGWIN 2024 Challenge
  3 Apr 2025 0 repositories listed
• Accelerating IoV Intrusion Detection: Benchmarking GPU-Accelerated vs CPU-Based ML Libraries
  2 Apr 2025 0 repositories listed
• Benchmarking the Spatial Robustness of DNNs via Natural and Adversarial Localized Corruptions
  2 Apr 2025 0 repositories listed
• Better Bill GPT: Comparing Large Language Models against Legal Invoice Reviewers
  2 Apr 2025 0 repositories listed
• FIORD: A Fisheye Indoor-Outdoor Dataset with LIDAR Ground Truth for 3D Scene Reconstruction and Benchmarking
  2 Apr 2025 0 repositories listed
• Global Rice Multi-Class Segmentation Dataset (RiceSEG): A Comprehensive and Diverse High-Resolution RGB-Annotated Images for the Development and Benchmarking of Rice Segmentation Algorithms
  2 Apr 2025 0 repositories listed
• Horizon Scans can be accelerated using novel information retrieval and artificial intelligence tools
  2 Apr 2025 0 repositories listed
• Proof of Humanity: A Multi-Layer Network Framework for Certifying Human-Originated Content in an AI-Dominated Internet
  2 Apr 2025 0 repositories listed
• When Reasoning Meets Compression: Benchmarking Compressed Large Reasoning Models on Complex Reasoning Tasks
  2 Apr 2025 0 repositories listed
• Automated Factual Benchmarking for In-Car Conversational Systems using Large Language Models
  1 Apr 2025 0 repositories listed
• Benchmarking Federated Machine Unlearning methods for Tabular Data
  1 Apr 2025 0 repositories listed
• On Benchmarking Code LLMs for Android Malware Analysis
  1 Apr 2025 0 repositories listed
• Zero-shot Benchmarking: A Framework for Flexible and Scalable Automatic Evaluation of Language Models
  1 Apr 2025 0 repositories listed
• Towards Benchmarking and Assessing the Safety and Robustness of Autonomous Driving on Safety-critical Scenarios
  31 Mar 2025 0 repositories listed
• Uni-Render: A Unified Accelerator for Real-Time Rendering Across Diverse Neural Renderers
  31 Mar 2025 0 repositories listed
• Benchmarking Systematic Relational Reasoning with Large Language and Reasoning Models
  30 Mar 2025 0 repositories listed
• Simple Feedfoward Neural Networks are Almost All You Need for Time Series Forecasting
  30 Mar 2025 0 repositories listed
• CodeARC: Benchmarking Reasoning Capabilities of LLM Agents for Inductive Program Synthesis
  29 Mar 2025 0 repositories listed
• MHTS: Multi-Hop Tree Structure Framework for Generating Difficulty-Controllable QA Datasets for RAG Evaluation
  29 Mar 2025 0 repositories listed
• RL2Grid: Benchmarking Reinforcement Learning in Power Grid Operations
  29 Mar 2025 0 repositories listed
• An Advanced Ensemble Deep Learning Framework for Stock Price Prediction Using VAE, Transformer, and LSTM Model
  28 Mar 2025 0 repositories listed
• Assessing Foundation Models for Sea Ice Type Segmentation in Sentinel-1 SAR Imagery
  28 Mar 2025 0 repositories listed
• Benchmarking Ultra-Low-Power μNPUs
  28 Mar 2025 0 repositories listed
• Generalization Bias in Large Language Model Summarization of Scientific Research
  28 Mar 2025 0 repositories listed
• LIM: Large Interpolator Model for Dynamic Reconstruction
  28 Mar 2025 0 repositories listed
• SimBank: from Simulation to Solution in Prescriptive Process Monitoring
  28 Mar 2025 0 repositories listed
• Benchmarking Deep Learning-Based Methods for Irradiance Nowcasting with Sky Images
  27 Mar 2025 0 repositories listed
• Evaluating Text-to-Image Synthesis with a Conditional Fréchet Distance
  27 Mar 2025 0 repositories listed
• GateLens: A Reasoning-Enhanced LLM Agent for Automotive Software Release Analytics
  27 Mar 2025 0 repositories listed
• ResearchBench: Benchmarking LLMs in Scientific Discovery via Inspiration-Based Task Decomposition
  27 Mar 2025 0 repositories listed
• Benchmarking Machine Learning Methods for Distributed Acoustic Sensing
  26 Mar 2025 0 repositories listed
• CSPO: Cross-Market Synergistic Stock Price Movement Forecasting with Pseudo-volatility Optimization
  26 Mar 2025 0 repositories listed
• RxRx3-core: Benchmarking drug-target interactions in High-Content Microscopy
  26 Mar 2025 0 repositories listed
• Contextual Metric Meta-Evaluation by Measuring Local Metric Accuracy
  25 Mar 2025 0 repositories listed
• Reservoir Computing with a Single Oscillating Gas Bubble: Emphasizing the Chaotic Regime
  25 Mar 2025 0 repositories listed
• Writing as a testbed for open ended agents
  25 Mar 2025 0 repositories listed
• Benchmarking Burst Super-Resolution for Polarization Images: Noise Dataset and Analysis
  24 Mar 2025 0 repositories listed
• Benchmarking Post-Hoc Unknown-Category Detection in Food Recognition
  24 Mar 2025 0 repositories listed
• Enhancing Multi-Label Emotion Analysis and Corresponding Intensities for Ethiopian Languages
  24 Mar 2025 0 repositories listed
• EvAnimate: Event-conditioned Image-to-Video Generation for Human Animation
  24 Mar 2025 0 repositories listed
• A Study on Neuro-Symbolic Artificial Intelligence: Healthcare Perspectives
  23 Mar 2025 0 repositories listed
• Regularization of ML models for Earth systems by using longer model timesteps
  23 Mar 2025 0 repositories listed
• Unmasking Deceptive Visuals: Benchmarking Multimodal Large Language Models on Misleading Chart Question Answering
  23 Mar 2025 0 repositories listed
• Benchmark Dataset for Pore-Scale CO2-Water Interaction
  22 Mar 2025 0 repositories listed
• CardioTabNet: A Novel Hybrid Transformer Model for Heart Disease Prediction using Tabular Medical Data
  22 Mar 2025 0 repositories listed
• CausalRivers -- Scaling up benchmarking of causal discovery for real-world time-series
  21 Mar 2025 0 repositories listed
• A Statistical Analysis for Per-Instance Evaluation of Stochastic Optimizers: How Many Repeats Are Enough?
  20 Mar 2025 0 repositories listed
• DNR Bench: Benchmarking Over-Reasoning in Reasoning LLMs
  20 Mar 2025 0 repositories listed
• ECKGBench: Benchmarking Large Language Models in E-commerce Leveraging Knowledge Graph
  20 Mar 2025 0 repositories listed
• Empirical Analysis of Privacy-Fairness-Accuracy Trade-offs in Federated Learning: A Step Towards Responsible AI
  20 Mar 2025 0 repositories listed
• Benchmarking Large Language Models for Handwritten Text Recognition
  19 Mar 2025 0 repositories listed
• Benchmarking Open-Source Large Language Models on Healthcare Text Classification Tasks
  19 Mar 2025 0 repositories listed
• FAVOR-Bench: A Comprehensive Benchmark for Fine-Grained Video Motion Understanding
  19 Mar 2025 0 repositories listed
• ImputeGAP: A Comprehensive Library for Time Series Imputation
  19 Mar 2025 0 repositories listed
• Kolmogorov-Arnold Network for Transistor Compact Modeling
  19 Mar 2025 0 repositories listed
• SUM Parts: Benchmarking Part-Level Semantic Segmentation of Urban Meshes
  19 Mar 2025 0 repositories listed
• ConSCompF: Consistency-focused Similarity Comparison Framework for Generative Large Language Models
  18 Mar 2025 0 repositories listed
• COPA: Comparing the Incomparable to Explore the Pareto Front
  18 Mar 2025 0 repositories listed
• Efficient but Vulnerable: Benchmarking and Defending LLM Batch Prompting Attack
  18 Mar 2025 0 repositories listed
• HA-VLN: A Benchmark for Human-Aware Navigation in Discrete-Continuous Environments with Dynamic Multi-Human Interactions, Real-World Validation, and an Open Leaderboard
  18 Mar 2025 0 repositories listed
• Organ-aware Multi-scale Medical Image Segmentation Using Text Prompt Engineering
  18 Mar 2025 0 repositories listed
• Stable Virtual Camera: Generative View Synthesis with Diffusion Models
  18 Mar 2025 0 repositories listed
• VeriContaminated: Assessing LLM-Driven Verilog Coding for Data Contamination
  17 Mar 2025 0 repositories listed

Syntology lines on 1 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced; each line links to that paper's sample list. Syntology's record for this page has not changed since 2026-09-28, the first build that kept a record date for it; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.