Browse State-of-the-Art › Small Language Model
Small Language Model
41 papers with code · 0 benchmarks · 0 datasets archive 2025-07-28
Benchmarks archive 2025-07-28
No benchmark for this task in the archive.
Libraries
Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.
Datasets archive 2025-07-28
No dataset record in the archive lists this task.
Subtasks archive 2025-07-28
No subtask under this task in the archive's task tree.
Papers archive 2025-07-28
archive papers tagged: 109 · with a code link: 41 · where Syntology ran a sample: 11 (9 with a run with no instrument failure, 2 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (11 of 109 tagged: 9 with a run with no instrument failure, 2 where every run was a failure of Syntology's instrument)
Page 1 of 2: papers 1 to 100 of 109, in archive order: by repositories listed in the archive (most first), then newest first, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers that list no repository come after every paper that lists one.
Papers without a page here are shown as plain text. A Syntology line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the figure “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code); hover it for the repositories the samples that ran came from. The first sentence of the abstract is shown for the first 30 papers; every abstract is on its paper's page.
-
27 Jan 2025 2 repositories listedWe introduce Atla Selene Mini, a state-of-the-art small language model-as-a-judge (SLMJ).
-
4 Jan 2024 2 repositories listed Syntology official (archive's flag): 8 ran · 8 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 2 honoured, 2 violated, 0 with no contract checked; 4 where Syntology's instrument failed) · 1 unverified (of 9 harvested samples) · 2 pointer-only (licence)We present TinyLlama, a compact 1.
-
17 Jun 2025 1 repository listedTo address this, a secondary model, known as a relevant grader, can be served to verify its relevance.
-
4 Jun 2025 1 repository listedRecently, Large Language Models (LLMs) have demonstrated significant potential for data annotation, markedly reducing the labor costs associated with downstream applications.
-
28 May 2025 1 repository listedVision encoders trained on the surrogate can then be directly transferred to the larger model, a process we call zero-shot grafting -- when plugged directly into the full-size target LLM, the grafted pair surpasses the…
-
21 May 2025 1 repository listedThis study explores the enhancement of medical knowledge in a small language model by leveraging accessible online data, including a crawled corpus from medical magazines and a dataset of real doctor-patient QA pairs.
-
21 Apr 2025 1 repository listedTo address this, we propose CRAVE, a Conflicting Reasoning Approach for explainable claim VErification, that verify the complex claims based on the conflicting rationales reasoned by large language models (LLMs).
-
7 Apr 2025 1 repository listed Syntology official: harvested, nothing ran · 0 ran · 1 unverified (of 1 harvested sample)Retrieval-Augmented Generation (RAG) systems often struggle to handle multi-hop question-answering tasks accurately due to irrelevant context retrieval and limited complex reasoning capabilities.
-
27 Mar 2025 1 repository listedTo tackle these challenges, we propose Mobile-VideoGPT, an efficient multimodal framework designed to operate with fewer than a billion parameters.
-
20 Mar 2025 1 repository listedThis paper presents a survey on distributed solutions for various LMs, including large language models (LLMs), vision language models (VLMs), multimodal LLMs (MLLMs), and small language models (SLMs).
-
11 Feb 2025 1 repository listedHowever, the task of extracting longer entity spans (e. g., awards) from extended texts (e. g., homepages) is barely explored.
-
19 Jan 2025 1 repository listedSpecifically, to efficiently query the LLM, we propose an adaptive selection strategy based on the uncertainty estimation of the SLM, where the LLM is invoked only when the SLM is uncertain.
-
16 Dec 2024 1 repository listed Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 3 unverified (of 5 harvested samples)We address the challenge of utilizing large language models (LLMs) for complex embodied tasks, in the environment where decision-making systems operate timely on capacity-limited, off-the-shelf devices.
-
24 Nov 2024 1 repository listedMinimal duplication positively impacted model accuracy (+0.
-
21 Nov 2024 1 repository listedThis progress is largely attributed to the development of generalizable source code representations that effectively capture the syntactic and semantic characteristics of code.
-
18 Nov 2024 1 repository listedInteractions with online Large Language Models raise privacy issues where providers can gather sensitive information about users and their companies from the prompts.
-
7 Nov 2024 1 repository listedThe interest in developing small language models (SLM) for on-device deployment is fast growing.
-
4 Nov 2024 1 repository listedThe telecommunications industry's rapid evolution demands intelligent systems capable of managing complex networks and adapting to emerging technologies.
-
29 Oct 2024 1 repository listed Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 1 unverified (of 4 harvested samples) · 4 pointer-only (licence)Large language models (LLMs) have shown impressive capabilities across various tasks, but their performance on domain-specific tasks remains limited.
-
10 Oct 2024 1 repository listed Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 1 honoured, 1 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples) · 2 pointer-only (licence)A mechanistic understanding of how MLPs do computation in deep neural networks remains elusive.
-
17 Sep 2024 1 repository listedIn this paper, we evaluate the creative fiction writing abilities of a fine-tuned small language model (SLM), BART-large, and compare its performance to human writers and two large language models (LLMs): GPT-3.
-
6 Sep 2024 1 repository listedFurthermore, our approach exhibits major cost benefits: the average prediction quality of AnyMatch is within 4.
-
1 Sep 2024 1 repository listed Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 1 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)Recent large language models (LLMs) have enabled the development of advanced agentic systems that can integrate various tools and APIs to fulfill user queries through function calling.
-
30 Aug 2024 1 repository listedOur findings reveal that while BERT-based models generally outperform both the LLMs and SLM, the performance of the large generative models is still noteworthy.
-
24 Aug 2024 1 repository listed Syntology official (archive's flag): 10 ran · 10 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 1 honoured, 0 violated, 5 with no contract checked; 4 where Syntology's instrument failed) · 4 unverified (of 14 harvested samples)The widespread adoption of cloud-based proprietary large language models (LLMs) has introduced significant challenges, including operational dependencies, privacy concerns, and the necessity of continuous internet…
-
22 Aug 2024 1 repository listedLarge language models (LLMs) are highly capable but face latency challenges in real-time applications, such as conducting online hallucination detection.
-
21 Aug 2024 1 repository listedRecent studies show that large language models (LLMs) struggle with technical standards in telecommunications.
-
28 Jul 2024 1 repository listed Syntology official: harvested, nothing ran · 0 ran · 1 unverified (of 1 harvested sample) · 1 pointer-only (licence)However, existing methods are designed for specific models with fixed prompts, limiting their adaptability to the fast-evolving models and diverse practical scenarios.
-
21 Jun 2024 1 repository listedThe goal of text style transfer is to transform the style of texts while preserving their original meaning, often with only a few examples of the target style.
-
6 Jun 2024 1 repository listedRecent advancements in text-to-speech (TTS) powered by language models have showcased remarkable capabilities in achieving naturalness and zero-shot voice cloning.
-
23 May 2024 1 repository listed
-
8 May 2024 1 repository listed
-
1 May 2024 1 repository listed Syntology official: no sample here; runs from other or unrecorded repositories · 18 ran (of which 0 constructed an object rather than computing a result; 18 with no instrument failure: 0 honoured, 0 violated, 18 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified (of 21 harvested samples) · 21 pointer-only (licence)
-
21 Feb 2024 1 repository listed Syntology official (archive's flag): 6 ran · 6 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 1 honoured, 1 violated, 2 with no contract checked; 2 where Syntology's instrument failed) · 4 unverified (of 10 harvested samples) · 10 pointer-only (licence)
-
17 Feb 2024 1 repository listed
-
24 Jan 2024 1 repository listed Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 1 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 2 unverified (of 6 harvested samples) · 1 pointer-only (licence)
-
4 Jan 2024 1 repository listed Syntology official (archive's flag): 6 ran · 6 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 2 honoured, 1 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 3 unverified (of 9 harvested samples) · 9 pointer-only (licence)
-
27 Oct 2023 1 repository listed Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified (of 5 harvested samples)
-
21 May 2023 1 repository listed
-
21 Jul 2022 1 repository listed
-
3 Dec 2021 1 repository listed
-
Scaling Up RL: Unlocking Diverse Reasoning in LLMs via Prolonged Training16 Jul 2025 0 repositories listed
-
Domain-Adaptive Small Language Models for Structured Tax Code Prediction15 Jul 2025 0 repositories listed
-
Towards Privacy-Preserving and Personalized Smart Homes via Tailored Small Language Models10 Jul 2025 0 repositories listed
-
Biomed-Enriched: A Biomedical Dataset Enriched with LLMs for Pretraining and Extracting Rare and Hidden Content25 Jun 2025 0 repositories listed
-
Counterfactual Influence as a Distributional Quantity25 Jun 2025 0 repositories listed
-
Distilling On-device Language Models for Robot Planning with Minimal Human Intervention20 Jun 2025 0 repositories listed
-
HypER: Literature-grounded Hypothesis Generation and Distillation with Provenance15 Jun 2025 0 repositories listed
-
Towards a Small Language Model Lifecycle Framework9 Jun 2025 0 repositories listed
-
WhisQ: Cross-Modal Representation Learning for Text-to-Music MOS Prediction6 Jun 2025 0 repositories listed
-
Adaptive Task Vectors for Large Language Models3 Jun 2025 0 repositories listed
-
A Lightweight Multi-Expert Generative Language Model System for Engineering Information and Knowledge Extraction27 May 2025 0 repositories listed
-
Skip-Thinking: Chunk-wise Chain-of-Thought Distillation Enable Smaller Language Models to Reason Better and Faster24 May 2025 0 repositories listed
-
Communication-Efficient Hybrid Language Model via Uncertainty-Aware Opportunistic and Compressed Transmission17 May 2025 0 repositories listed
-
TinyRS-R1: Compact Multimodal Language Model for Remote Sensing17 May 2025 0 repositories listed
-
MilChat: Introducing Chain of Thought Reasoning and GRPO to a Multimodal Small Language Model for Remote Sensing12 May 2025 0 repositories listed
-
Sadeed: Advancing Arabic Diacritization Through Small Language Model30 Apr 2025 0 repositories listed
-
Simplifying Data Integration: SLM-Driven Systems for Unified Semantic Queries Across Heterogeneous Databases8 Apr 2025 0 repositories listed
-
Biomedical Question Answering via Multi-Level Summarization on a Local Knowledge Graph2 Apr 2025 0 repositories listed
-
Distil-xLSTM: Learning Attention Mechanisms through Recurrent Structures24 Mar 2025 0 repositories listed
-
Audio Flamingo 2: An Audio-Language Model with Long-Audio Understanding and Expert Reasoning Abilities6 Mar 2025 0 repositories listed
-
ReaderLM-v2: Small Language Model for HTML to Markdown and JSON3 Mar 2025 0 repositories listed
-
Bridging the Gap: Enabling Natural Language Queries for NoSQL Databases through Text-to-NoSQL Translation16 Feb 2025 0 repositories listed
-
Towards Achieving Concept Completeness for Textual Concept Bottleneck Models16 Feb 2025 0 repositories listed
-
3D-Grounded Vision-Language Framework for Robotic Task Planning: Automated Prompt Synthesis and Supervised Reasoning13 Feb 2025 0 repositories listed
-
Adapt-Pruner: Adaptive Structural Pruning for Efficient Small Language Model Training5 Feb 2025 0 repositories listed
-
SmolLM2: When Smol Goes Big -- Data-Centric Training of a Small Language Model4 Feb 2025 0 repositories listed
-
From Superficial Patterns to Semantic Understanding: Fine-Tuning Language Models on Contrast Sets5 Jan 2025 0 repositories listed
-
Technical Report: Small Language Model for Japanese Clinical and Medicine21 Dec 2024 0 repositories listed
-
Uncertainty-Aware Hybrid Inference with On-Device Small and Remote Large Language Models17 Dec 2024 0 repositories listed
-
Small Language Model as Data Prospector for Large Language Model13 Dec 2024 0 repositories listed
-
JPPO: Joint Power and Prompt Optimization for Accelerated Large Language Model Services27 Nov 2024 0 repositories listed
-
RadPhi-3: Small Language Models for Radiology19 Nov 2024 0 repositories listed
-
SlimLM: An Efficient Small Language Model for On-Device Document Assistance15 Nov 2024 0 repositories listed
-
SecEncoder: Logs are All You Need in Security12 Nov 2024 0 repositories listed
-
Towards Multi-Modal Mastery: A 4.5B Parameter Truly Multi-Modal Small Language Model8 Nov 2024 0 repositories listed
-
Wave Network: An Ultra-Small Language Model4 Nov 2024 0 repositories listed
-
Humanizing the Machine: Proxy Attacks to Mislead LLM Detectors25 Oct 2024 0 repositories listed
-
A Little Help Goes a Long Way: Efficient LLM Training by Leveraging Small LMs24 Oct 2024 0 repositories listed
-
Methods of improving LLM training stability22 Oct 2024 0 repositories listed
-
Bridging Large Language Models and Graph Structure Learning Models for Robust Representation Learning15 Oct 2024 0 repositories listed
-
15 Oct 2024 0 repositories listed
-
Generating long-horizon stock "buy" signals with a neural language model9 Oct 2024 0 repositories listed
-
Personal Intelligence System UniLM: Hybrid On-Device Small Language Model and Server-Based Large Language Model for Malay Nusantara9 Oct 2024 0 repositories listed
-
DecorateLM: Data Engineering through Corpus Rating, Tagging, and Editing with Language Models8 Oct 2024 0 repositories listed
-
Cross-lingual Transfer for Automatic Question Generation by Learning Interrogative Structures in Target Languages4 Oct 2024 0 repositories listed
-
Cross-Domain Content Generation with Domain-Specific Small Language Models19 Sep 2024 0 repositories listed
-
Small Language Models are Equation Reasoners19 Sep 2024 0 repositories listed
-
InkubaLM: A small language model for low-resource African languages30 Aug 2024 0 repositories listed
-
Exploring Domain Robust Lightweight Reward Models based on Router Mechanism24 Jul 2024 0 repositories listed
-
Graph-Structured Speculative Decoding23 Jul 2024 0 repositories listed
-
RDBE: Reasoning Distillation-Based Evaluation Enhances Automatic Essay Scoring3 Jul 2024 0 repositories listed
-
PDSS: A Privacy-Preserving Framework for Step-by-Step Distillation of Large Language Models18 Jun 2024 0 repositories listed
-
HARE: HumAn pRiors, a key to small language model Efficiency17 Jun 2024 0 repositories listed
-
Plug and Play with Prompts: A Prompt Tuning Approach for Controlling Text Generation8 Apr 2024 0 repositories listed
-
Towards Pareto Optimal Throughput in Small Language Model Serving4 Apr 2024 0 repositories listed
-
Think Big, Generate Quick: LLM-to-SLM for Fast Autoregressive Decoding26 Feb 2024 0 repositories listed
-
Recursive Speculative Decoding: Accelerating LLM Inference via Sampling Without Replacement21 Feb 2024 0 repositories listed
-
Purifying Large Language Models by Ensembling a Small Language Model19 Feb 2024 0 repositories listed
-
23 Jan 2024 0 repositories listed
Syntology lines on 13 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced; each line links to that paper's sample list. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections