Small Language Model

Benchmarks archive 2025-07-28

No benchmark for this task in the archive.

Libraries

Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.

Datasets archive 2025-07-28

No dataset record in the archive lists this task.

Subtasks archive 2025-07-28

No subtask under this task in the archive's task tree.

Most implemented papers archive 2025-07-28

30 shown of 41 papers with code (109 tagged with this task in all), ordered by repositories listed in the archive, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers without a page here are shown as plain text.

• Atla Selene Mini: A General Purpose Evaluation Model
  27 Jan 2025 2 repositories listed
  We introduce Atla Selene Mini, a state-of-the-art small language model-as-a-judge (SLMJ).
• TinyLlama: An Open-Source Small Language Model
  4 Jan 2024 2 repositories listed Syntology ran 8 of 9 samples · 1 unverified
  We present TinyLlama, a compact 1.
• Lightweight Relevance Grader in RAG
  17 Jun 2025 1 repository listed
  To address this, a secondary model, known as a relevant grader, can be served to verify its relevance.
• Prompt Candidates, then Distill: A Teacher-Student Framework for LLM-driven Data Annotation
  4 Jun 2025 1 repository listed
  Recently, Large Language Models (LLMs) have demonstrated significant potential for data annotation, markedly reducing the labor costs associated with downstream applications.
• Zero-Shot Vision Encoder Grafting via LLM Surrogates
  28 May 2025 1 repository listed
  Vision encoders trained on the surrogate can then be directly transferred to the larger model, a process we call zero-shot grafting -- when plugged directly into the full-size target LLM, the grafted pair surpasses the…
• Leveraging Online Data to Enhance Medical Knowledge in a Small Persian Language Model
  21 May 2025 1 repository listed
  This study explores the enhancement of medical knowledge in a small language model by leveraging accessible online data, including a crawled corpus from medical magazines and a dataset of real doctor-patient QA pairs.
• CRAVE: A Conflicting Reasoning Approach for Explainable Claim Verification Using LLMs
  21 Apr 2025 1 repository listed
  To address this, we propose CRAVE, a Conflicting Reasoning Approach for explainable claim VErification, that verify the complex claims based on the conflicting rationales reasoned by large language models (LLMs).
• Collab-RAG: Boosting Retrieval-Augmented Generation for Complex Question Answering via White-Box and Black-Box LLM Collaboration
  7 Apr 2025 1 repository listed Syntology ran 0 of 1 samples · 1 unverified
  Retrieval-Augmented Generation (RAG) systems often struggle to handle multi-hop question-answering tasks accurately due to irrelevant context retrieval and limited complex reasoning capabilities.
• Mobile-VideoGPT: Fast and Accurate Video Understanding Language Model
  27 Mar 2025 1 repository listed
  To tackle these challenges, we propose Mobile-VideoGPT, an efficient multimodal framework designed to operate with fewer than a billion parameters.
• Distributed LLMs and Multimodal Large Language Models: A Survey on Advances, Challenges, and Future Directions
  20 Mar 2025 1 repository listed
  This paper presents a survey on distributed solutions for various LMs, including large language models (LLMs), vision language models (VLMs), multimodal LLMs (MLLMs), and small language models (SLMs).
• Small Language Model Makes an Effective Long Text Extractor
  11 Feb 2025 1 repository listed
  However, the task of extracting longer entity spans (e.
• AdaptiveLog: An Adaptive Log Analysis Framework with the Collaboration of Large and Small Language Model
  19 Jan 2025 1 repository listed
  Specifically, to efficiently query the LLM, we propose an adaptive selection strategy based on the uncertainty estimation of the SLM, where the LLM is invoked only when the SLM is uncertain.
• Embodied CoT Distillation From LLM To Off-the-shelf Agents
  16 Dec 2024 1 repository listed Syntology ran 0 of 5 samples · 5 unverified
  We address the challenge of utilizing large language models (LLMs) for complex embodied tasks, in the environment where decision-making systems operate timely on capacity-limited, off-the-shelf devices.
• Is Training Data Quality or Quantity More Impactful to Small Language Model Performance?
  24 Nov 2024 1 repository listed
  Minimal duplication positively impacted model accuracy (+0.
• CodeSAM: Source Code Representation Learning by Infusing Self-Attention with Multi-Code-View Graphs
  21 Nov 2024 1 repository listed
  This progress is largely attributed to the development of generalizable source code representations that effectively capture the syntactic and semantic characteristics of code.
• Preempting Text Sanitization Utility in Resource-Constrained Privacy-Preserving LLM Interactions
  18 Nov 2024 1 repository listed
  Interactions with online Large Language Models raise privacy issues where providers can gather sensitive information about users and their companies from the prompts.
• PhoneLM:an Efficient and Capable Small Language Model Family through Principled Pre-training
  7 Nov 2024 1 repository listed
  The interest in developing small language models (SLM) for on-device deployment is fast growing.
• TeleOracle: Fine-Tuned Retrieval-Augmented Generation with Long-Context Support for Network
  4 Nov 2024 1 repository listed
  The telecommunications industry's rapid evolution demands intelligent systems capable of managing complex networks and adapting to emerging technologies.
• Improving In-Context Learning with Small Language Model Ensembles
  29 Oct 2024 1 repository listed Syntology ran 3 of 4 samples · 1 unverified · 4 pointer-only (licence)
  Large language models (LLMs) have shown impressive capabilities across various tasks, but their performance on domain-specific tasks remains limited.
• Bilinear MLPs enable weight-based mechanistic interpretability
  10 Oct 2024 1 repository listed Syntology ran 2 of 2 samples · 0 unverified · 2 pointer-only (licence)
  A mechanistic understanding of how MLPs do computation in deep neural networks remains elusive.
• Small Language Models can Outperform Humans in Short Creative Writing: A Study Comparing SLMs with Humans and LLMs
  17 Sep 2024 1 repository listed
  In this paper, we evaluate the creative fiction writing abilities of a fine-tuned small language model (SLM), BART-large, and compare its performance to human writers and two large language models (LLMs): GPT-3.
• AnyMatch -- Efficient Zero-Shot Entity Matching with a Small Language Model
  6 Sep 2024 1 repository listed
  Furthermore, our approach exhibits major cost benefits: the average prediction quality of AnyMatch is within 4.
• TinyAgent: Function Calling at the Edge
  1 Sep 2024 1 repository listed Syntology ran 1 of 1 samples · 0 unverified
  Recent large language models (LLMs) have enabled the development of advanced agentic systems that can integrate various tools and APIs to fulfill user queries through function calling.
• Assessing Generative Language Models in Classification Tasks: Performance and Self-Evaluation Capabilities in the Environmental and Climate Change Domain
  30 Aug 2024 1 repository listed
  Our findings reveal that while BERT-based models generally outperform both the LLMs and SLM, the performance of the large generative models is still noteworthy.
• LlamaDuo: LLMOps Pipeline for Seamless Migration from Service LLMs to Small-Scale Local LLMs
  24 Aug 2024 1 repository listed Syntology ran 10 of 14 samples · 4 unverified
  The widespread adoption of cloud-based proprietary large language models (LLMs) has introduced significant challenges, including operational dependencies, privacy concerns, and the necessity of continuous internet…
• SLM Meets LLM: Balancing Latency, Interpretability and Consistency in Hallucination Detection
  22 Aug 2024 1 repository listed
  Large language models (LLMs) are highly capable but face latency challenges in real-time applications, such as conducting online hallucination detection.
• Leveraging Fine-Tuned Retrieval-Augmented Generation with Long-Context Support: For 3GPP Standards
  21 Aug 2024 1 repository listed
  Recent studies show that large language models (LLMs) struggle with technical standards in telecommunications.
• VersusDebias: Universal Zero-Shot Debiasing for Text-to-Image Models via SLM-Based Prompt Engineering and Generative Adversary
  28 Jul 2024 1 repository listed Syntology ran 0 of 1 samples · 1 unverified · 1 pointer-only (licence)
  However, existing methods are designed for specific models with fixed prompts, limiting their adaptability to the fast-evolving models and diverse practical scenarios.
• TinyStyler: Efficient Few-Shot Text Style Transfer with Authorship Embeddings
  21 Jun 2024 1 repository listed
  The goal of text style transfer is to transform the style of texts while preserving their original meaning, often with only a few examples of the target style.
• Small-E: Small Language Model with Linear Attention for Efficient Speech Synthesis
  6 Jun 2024 1 repository listed
  Recent advancements in text-to-speech (TTS) powered by language models have showcased remarkable capabilities in achieving naturalness and zero-shot voice cloning.

Syntology lines on 8 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced. Read from the graph 2026-09-24.