Methods › General › Distillation › SFT
Shrink and Fine-Tune
SFT
Introduced by Sam Shleifer et al. in Pre-trained Summarization Distillation
archive 2025-07-28 Description, source and code snippet are the archive's method entry.
Shrink and Fine-Tune, or SFT, is a type of distillation that avoids explicit distillation by copying parameters to a student student model and then fine-tuning. Specifically it extracts a student model from the maximally spaced layers of a fine-tuned teacher. Each layer l ∈L′ is copied fully from L. For example, when creating a BART student with 3 decoder layers from the 12 encoder layer 12 decoder layer teacher, we copy the teacher’s full Encᴸ and decoder layers 0, 6, and 11 to the student. When deciding which layers to copy, we break ties arbitrarily; copying layers 0, 5, and 11 might work just as well. When copy only 1 decoder layer, we copy layer 0. This was found this to work better than copying layer 11. The impact of initialization on performance is measured experimentally in Section 6.1. After initialization, the student model continues to fine-tune on the summarization dataset, with the objective of minimizing ℒ_(Data).
In Syntology the paper matched by title, the paper Syntology's graph keys as openreview_m4eD6HDGGX, held, no code (no_code; paper_only). The lookup matched a paper by its title, the paper Syntology's graph keys as openreview_m4eD6HDGGX, not a method entry. The archive credits no paper with an arXiv id for this method, so whether this answer (about the paper Syntology's graph keys as openreview_m4eD6HDGGX) is about this method is not checked; it does not say whether this method has code.
From the lookup's note on this name: The same name also belongs to “Self-Filtering (SFT)”, a method in the paper “Self-Filtering: A Noise-Aware Sample Selection for Label Noise with Confidence Penalization” (arXiv:2208.11351, 64 citations), which the lookup finds cited far more than the paper this answer is about (citations not recorded), so this answer may be about a different sense of the name. For arXiv:2208.11351: its page on this site · ask the lookup about it.
Syntology's have check for this name (free, it answers coverage only), read 2026-10-05; ask it again live. A level is the served verification level of that one answer; nothing here is summed across methods.
Papers archive 2025-07-28
archive papers tagged: 415 · with a code link: 204 · where Syntology ran a sample: 103 (82 with a run with no instrument failure, 21 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (103 of 415 tagged: 82 with a run with no instrument failure, 21 where every run was a failure of Syntology's instrument)
Page 1 of 5: papers 1 to 100 of 415, newest first by the archive's date (ties by slug), in archive order.
Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code, as “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. It is per sample and not a correctness claim. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from.
-
A Practical Two-Stage Recipe for Mathematical LLMs: Maximizing Accuracy with SFT and Efficiency with Reinforcement Learning 11 Jul 2025 · 1 repository · arXiv:2507.08267Syntology official (archive's flag): 6 ran · 6 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 5 where Syntology's instrument failed) · 0 unverified (of 6 harvested samples) · 6 pointer-only (licence)
-
InvestAlign: Overcoming Data Scarcity in Aligning Large Language Models with Investor Decision-Making Processes under Herd Behavior 9 Jul 2025 · 1 repository · arXiv:2507.06528
-
AutoTriton: Automatic Triton Programming with Reinforcement Learning in LLMs 8 Jul 2025 · 1 repository · arXiv:2507.05687
-
CogniSQL-R1-Zero: Lightweight Reinforced Reasoning for Efficient SQL Generation 8 Jul 2025 · 0 repositories · arXiv:2507.06013
-
Reinforcement Fine-Tuning Naturally Mitigates Forgetting in Continual Post-Training 7 Jul 2025 · 0 repositories · arXiv:2507.05386Syntology 6 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 4 where Syntology's instrument failed) · 4 unverified (of 10 harvested samples) · 10 pointer-only (licence)
-
SPIRAL: Self-Play on Zero-Sum Games Incentivizes Reasoning via Multi-Agent Multi-Turn Reinforcement Learning 30 Jun 2025 · 1 repository · arXiv:2506.24119Syntology official (archive's flag): 9 ran · 9 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 6 where Syntology's instrument failed) · 0 unverified (of 9 harvested samples)
-
Complexity-aware fine-tuning 26 Jun 2025 · 1 repository · arXiv:2506.21220
-
LongWriter-Zero: Mastering Ultra-Long Text Generation via Reinforcement Learning 23 Jun 2025 · 1 repository · arXiv:2506.18841Syntology 12 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 2 honoured, 0 violated, 2 with no contract checked; 8 where Syntology's instrument failed) · 2 unverified (of 14 harvested samples) · 1 pointer-only (licence)
-
Smart-LLaMA-DPO: Reinforced Large Language Model for Explainable Smart Contract Vulnerability Detection 23 Jun 2025 · 0 repositories · arXiv:2506.18245
-
RLRC: Reinforcement Learning-based Recovery for Compressed Vision-Language-Action Models 21 Jun 2025 · 0 repositories · arXiv:2506.17639
-
Differentiation-Based Extraction of Proprietary Data from Fine-Tuned LLMs 20 Jun 2025 · 0 repositories · arXiv:2506.17353
-
Refine-POI: Reinforcement Fine-Tuned Large Language Models for Next Point-of-Interest Recommendation 19 Jun 2025 · 0 repositories · arXiv:2506.21599
-
Massive Supervised Fine-tuning Experiments Reveal How Data, Layer, and Training Factors Shape LLM Alignment Quality 17 Jun 2025 · 0 repositories · arXiv:2506.14681
-
AceReason-Nemotron 1.1: Advancing Math and Code Reasoning through SFT and RL Synergy 16 Jun 2025 · 0 repositories · arXiv:2506.13284
-
Ego-R1: Chain-of-Tool-Thought for Ultra-Long Egocentric Video Reasoning 16 Jun 2025 · 0 repositories · arXiv:2506.13654
-
Metis-RISE: RL Incentivizes and SFT Enhances Multimodal Reasoning Model Learning 16 Jun 2025 · 1 repository · arXiv:2506.13056
-
QFFT, Question-Free Fine-Tuning for Adaptive Reasoning 15 Jun 2025 · 1 repository · arXiv:2506.12860Syntology official (archive's flag): 14 ran · 14 ran (of which 0 constructed an object rather than computing a result; 11 with no instrument failure: 1 honoured, 2 violated, 8 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified (of 14 harvested samples) · 7 pointer-only (licence)
-
VGR: Visual Grounded Reasoning 13 Jun 2025 · 0 repositories · arXiv:2506.11991
-
Vision Matters: Simple Visual Perturbations Can Boost Multimodal Math Reasoning 11 Jun 2025 · 1 repository · arXiv:2506.09736
-
Eliciting Fine-Tuned Transformer Capabilities via Inference-Time Techniques 9 Jun 2025 · 1 repository · arXiv:2506.08060
-
Learning What Reinforcement Learning Can't: Interleaved Online Fine-Tuning for Hardest Questions 9 Jun 2025 · 1 repository · arXiv:2506.07527
-
Nearness of Neighbors Attention for Regression in Supervised Finetuning 9 Jun 2025 · 1 repository · arXiv:2506.08139
-
Learning to Clarify by Reinforcement Learning Through Reward-Weighted Fine-Tuning 8 Jun 2025 · 0 repositories · arXiv:2506.06964
-
SDE-SQL: Enhancing Text-to-SQL Generation in Large Language Models via Self-Driven Exploration with SQL Probes 8 Jun 2025 · 0 repositories · arXiv:2506.07245
-
Writing-RL: Advancing Long-form Writing via Adaptive Curriculum Reinforcement Learning 6 Jun 2025 · 1 repository · arXiv:2506.05760
-
MINT-CoT: Enabling Interleaved Visual Tokens in Mathematical Chain-of-Thought Reasoning 5 Jun 2025 · 1 repository · arXiv:2506.05331
-
On the Mechanism of Reasoning Pattern Selection in Reinforcement Learning for Language Models 5 Jun 2025 · 0 repositories · arXiv:2506.04695
-
Crowd-SFT: Crowdsourcing for LLM Alignment 4 Jun 2025 · 0 repositories · arXiv:2506.04063
-
RoboRefer: Towards Spatial Referring with Reasoning in Vision-Language Models for Robotics 4 Jun 2025 · 0 repositories · arXiv:2506.04308
-
Corrigibility as a Singular Target: A Vision for Inherently Reliable Foundation Models 3 Jun 2025 · 0 repositories · arXiv:2506.03056
-
Reasoning-Table: Exploring Reinforcement Learning for Table Reasoning 2 Jun 2025 · 1 repository · arXiv:2506.01710
-
Reasoning Like an Economist: Post-Training on Economic Problems Induces Strategic Generalization in LLMs 31 May 2025 · 1 repository · arXiv:2506.00577
-
Exploring Multimodal Challenges in Toxic Chinese Detection: Taxonomy, Benchmark, and Findings 30 May 2025 · 1 repository · arXiv:2505.24341
-
From Macro to Micro: Probing Dataset Diversity in Language Model Fine-Tuning 30 May 2025 · 0 repositories · arXiv:2505.24768
-
Harnessing Negative Signals: Reinforcement Distillation from Teacher Data for LLM Reasoning 30 May 2025 · 1 repository · arXiv:2505.24850
-
How Much Backtracking is Enough? Exploring the Interplay of SFT and RL in Enhancing LLM Reasoning 30 May 2025 · 0 repositories · arXiv:2505.24273
-
Reason-SVG: Hybrid Reward RL for Aha-Moments in Vector Graphics Generation 30 May 2025 · 0 repositories · arXiv:2505.24499
-
Afterburner: Reinforcement Learning Facilitates Self-Improving Code Efficiency Optimization 29 May 2025 · 0 repositories · arXiv:2505.23387
-
Jigsaw-R1: A Study of Rule-based Visual Reinforcement Learning with Jigsaw Puzzles 29 May 2025 · 1 repository · arXiv:2505.23590
-
Robot-R1: Reinforcement Learning for Enhanced Embodied Reasoning in Robotics 29 May 2025 · 0 repositories · arXiv:2506.00070
-
cadrille: Multi-modal CAD Reconstruction with Online Reinforcement Learning 28 May 2025 · 1 repository · arXiv:2505.22914Syntology 2 ran (of which 2 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified; every one of the 2 samples that ran constructed an object rather than computing a result (of 3 harvested samples)
-
Enhancing Paraphrase Type Generation: The Impact of DPO and RLHF Evaluated with Human-Ranked Data 28 May 2025 · 1 repository · arXiv:2506.02018
-
EvolveSearch: An Iterative Self-Evolving Search Agent 28 May 2025 · 0 repositories · arXiv:2505.22501
-
WorkForceAgent-R1: Incentivizing Reasoning Capability in LLM-based Web Agents via Reinforcement Learning 28 May 2025 · 0 repositories · arXiv:2505.22942
-
R1-Code-Interpreter: Training LLMs to Reason with Code via Supervised and Reinforcement Learning 27 May 2025 · 1 repository · arXiv:2505.21668
-
MASKSEARCH: A Universal Pre-Training Framework to Enhance Agentic Search Capability 26 May 2025 · 1 repository · arXiv:2505.20285
-
Unveiling the Compositional Ability Gap in Vision-Language Reasoning Model 26 May 2025 · 1 repository · arXiv:2505.19406
-
What Can RL Bring to VLA Generalization? An Empirical Study 26 May 2025 · 0 repositories · arXiv:2505.19789
-
Alchemist: Turning Public Text-to-Image Data into Generative Gold 25 May 2025 · 0 repositories · arXiv:2505.19297
-
Controlling Language Confusion in Multilingual LLMs 25 May 2025 · 0 repositories · arXiv:2505.19116
-
The Pragmatic Mind of Machines: Tracing the Emergence of Pragmatic Competence in Large Language Models 24 May 2025 · 0 repositories · arXiv:2505.18497
-
AstroMLab 4: Benchmark-Topping Performance in Astronomy Q&A with a 70B-Parameter Domain-Specialized Reasoning Model 23 May 2025 · 0 repositories · arXiv:2505.17592
-
T2I-Eval-R1: Reinforcement Learning-Driven Reasoning for Interpretable Text-to-Image Evaluation 23 May 2025 · 0 repositories · arXiv:2505.17897
-
Towards Revealing the Effectiveness of Small-Scale Fine-tuning in R1-style Reinforcement Learning 23 May 2025 · 1 repository · arXiv:2505.17988
-
DecoupledESC: Enhancing Emotional Support Generation via Strategy-Response Decoupled Preference Optimization 22 May 2025 · 0 repositories · arXiv:2505.16995
-
Interactive Post-Training for Vision-Language-Action Models 22 May 2025 · 0 repositories · arXiv:2505.17016
-
Longer Context, Deeper Thinking: Uncovering the Role of Long-Context Ability in Reasoning 22 May 2025 · 0 repositories · arXiv:2505.17315
-
MPL: Multiple Programming Languages with Large Language Models for Information Extraction 22 May 2025 · 1 repository · arXiv:2505.16107
-
R1-Searcher++: Incentivizing the Dynamic Knowledge Acquisition of LLMs via Reinforcement Learning 22 May 2025 · 3 repositories · arXiv:2505.17005Syntology community repositories only · 9 ran (of which 0 constructed an object rather than computing a result; 8 with no instrument failure: 1 honoured, 0 violated, 7 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 10 harvested samples)
-
ReflectEvo: Improving Meta Introspection of Small LLMs by Learning Self-Reflection 22 May 2025 · 0 repositories · arXiv:2505.16475
-
SimpleDeepSearcher: Deep Information Seeking via Web-Powered Reasoning Trajectory Synthesis 22 May 2025 · 3 repositories · arXiv:2505.16834Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples)
-
UFT: Unifying Supervised and Reinforcement Fine-Tuning 22 May 2025 · 1 repository · arXiv:2505.16984Syntology official (archive's flag): 5 ran · 5 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 1 honoured, 1 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 4 unverified (of 9 harvested samples)
-
Chain-of-Focus: Adaptive Visual Search and Zooming for Multimodal Reasoning via RL 21 May 2025 · 0 repositories · arXiv:2505.15436
-
DeFTX: Denoised Sparse Fine-Tuning for Zero-Shot Cross-Lingual Transfer 21 May 2025 · 0 repositories · arXiv:2505.15090
-
From Problem-Solving to Teaching Problem-Solving: Aligning LLMs with Pedagogy using Reinforcement Learning 21 May 2025 · 1 repository · arXiv:2505.15607
-
KaFT: Knowledge-aware Fine-tuning for Boosting LLMs' Domain-specific Question-Answering Performance 21 May 2025 · 0 repositories · arXiv:2505.15480
-
STAR-R1: Spacial TrAnsformation Reasoning by Reinforcing Multimodal LLMs 21 May 2025 · 0 repositories · arXiv:2505.15804
-
Cross-Lingual Optimization for Language Transfer in Large Language Models 20 May 2025 · 0 repositories · arXiv:2505.14297
-
DeepEyes: Incentivizing "Thinking with Images" via Reinforcement Learning 20 May 2025 · 1 repository · arXiv:2505.14362Syntology official (archive's flag): 12 ran · 12 ran (of which 0 constructed an object rather than computing a result; 8 with no instrument failure: 1 honoured, 0 violated, 7 with no contract checked; 4 where Syntology's instrument failed) · 5 unverified (of 17 harvested samples) · 4 pointer-only (licence)
-
FisherSFT: Data-Efficient Supervised Fine-Tuning of Language Models Using Information Gain 20 May 2025 · 0 repositories · arXiv:2505.14826
-
InfiGFusion: Graph-on-Logits Distillation via Efficient Gromov-Wasserstein for Model Fusion 20 May 2025 · 1 repository · arXiv:2505.13893
-
Interpretable Traces, Unexpected Outcomes: Investigating the Disconnect in Trace-Based Knowledge Distillation 20 May 2025 · 0 repositories · arXiv:2505.13792
-
JOLT-SQL: Joint Loss Tuning of Text-to-SQL with Confusion-aware Noisy Schema Sampling 20 May 2025 · 1 repository · arXiv:2505.14305Syntology official: no sample here; runs from other or unrecorded repositories · 16 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 4 violated, 2 with no contract checked; 10 where Syntology's instrument failed) · 2 unverified (of 18 harvested samples) · 1 pointer-only (licence)
-
IDEAL: Data Equilibrium Adaptation for Multi-Capability Language Model Alignment 19 May 2025 · 0 repositories · arXiv:2505.12762
-
Step-wise Adaptive Integration of Supervised Fine-tuning and Reinforcement Learning for Task-Specific LLMs 19 May 2025 · 0 repositories · arXiv:2505.13026
-
UIShift: Enhancing VLM-based GUI Agents through Self-supervised Reinforcement Learning 18 May 2025 · 0 repositories · arXiv:2505.12493
-
VideoRFT: Incentivizing Video Reasoning Capability in MLLMs via Reinforced Fine-Tuning 18 May 2025 · 1 repository · arXiv:2505.12434Syntology official (archive's flag): 6 ran · 6 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 4 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 8 harvested samples) · 2 pointer-only (licence)
-
Enhancing Complex Instruction Following for Large Language Models with Mixture-of-Contexts Fine-tuning 17 May 2025 · 0 repositories · arXiv:2505.11922
-
GuardReasoner-VL: Safeguarding VLMs via Reinforced Reasoning 16 May 2025 · 1 repository · arXiv:2505.11049Syntology official (archive's flag): 9 ran · 9 ran (of which 0 constructed an object rather than computing a result; 7 with no instrument failure: 0 honoured, 0 violated, 7 with no contract checked; 2 where Syntology's instrument failed) · 3 unverified (of 12 harvested samples) · 1 pointer-only (licence)
-
Critique-Guided Distillation: Improving Supervised Fine-tuning via Better Distillation 16 May 2025 · 0 repositories · arXiv:2505.11628
-
Reasoning on a Budget: Miniaturizing DeepSeek R1 with SFT-GRPO Alignment for Instruction-Tuned LLMs 16 May 2025 · 1 repository
-
CAFE: Retrieval Head-based Coarse-to-Fine Information Seeking to Enhance Multi-Document QA Capability 15 May 2025 · 0 repositories · arXiv:2505.10063
-
Reinforcing the Diffusion Chain of Lateral Thought with Diffusion Language Models 15 May 2025 · 0 repositories · arXiv:2505.10446
-
Learning to Reason and Navigate: Parameter Efficient Action Planning with Large Language Models 12 May 2025 · 0 repositories · arXiv:2505.07500
-
Making Small Language Models Efficient Reasoners: Intervention, Supervision, Reinforcement 12 May 2025 · 0 repositories · arXiv:2505.07961
-
Assessing Robustness to Spurious Correlations in Post-Training Language Models 9 May 2025 · 0 repositories · arXiv:2505.05704
-
Multimodal Integrated Knowledge Transfer to Large Language Models through Preference Optimization with Biomedical Applications 9 May 2025 · 1 repository · arXiv:2505.05736
-
SOAEsV2-7B/72B: Full-Pipeline Optimization for State-Owned Enterprise LLMs via Continual Pre-Training, Domain-Progressive SFT and Distillation-Enhanced Speculative Decoding 7 May 2025 · 0 repositories · arXiv:2505.04723
-
Long-Short Chain-of-Thought Mixture Supervised Fine-Tuning Eliciting Efficient Reasoning in Large Language Models 6 May 2025 · 1 repository · arXiv:2505.03469
-
VLM Q-Learning: Aligning Vision-Language Models for Interactive Decision-Making 6 May 2025 · 0 repositories · arXiv:2505.03181
-
100 Days After DeepSeek-R1: A Survey on Replication Studies and More Directions for Reasoning Language Models 1 May 2025 · 0 repositories · arXiv:2505.00551
-
Knowledge Distillation of Domain-adapted LLMs for Question-Answering in Telecom 28 Apr 2025 · 0 repositories · arXiv:2504.20000
-
Nemotron-Research-Tool-N1: Exploring Tool-Using Language Models with Reinforced Reasoning 25 Apr 2025 · 0 repositories · arXiv:2505.00024
-
SARI: Structured Audio Reasoning via Curriculum-Guided Reinforcement Learning 22 Apr 2025 · 0 repositories · arXiv:2504.15900
-
DONOD: Robust and Generalizable Instruction Fine-Tuning for LLMs via Model-Intrinsic Dataset Pruning 21 Apr 2025 · 0 repositories · arXiv:2504.14810
-
Think2SQL: Reinforce LLM Reasoning Capabilities for Text2SQL 21 Apr 2025 · 0 repositories · arXiv:2504.15077
-
LeetCodeDataset: A Temporal Dataset for Robust Evaluation and Efficient Training of Code LLMs 20 Apr 2025 · 1 repository · arXiv:2504.14655
-
Relation-R1: Cognitive Chain-of-Thought Guided Reinforcement Learning for Unified Relational Comprehension 20 Apr 2025 · 0 repositories · arXiv:2504.14642
-
Compile Scene Graphs with Reinforcement Learning 18 Apr 2025 · 1 repository · arXiv:2504.13617Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)
-
MIG: Automatic Data Selection for Instruction Tuning by Maximizing Information Gain in Semantic Space 18 Apr 2025 · 0 repositories · arXiv:2504.13835
Tasks archive 2025-07-28
20 shown of 206 tasks the archive attaches to papers tagged with this method, by distinct papers. A task without a page in the catalog is plain text.
Usage over time archive 2025-07-28
Components: the archive holds no method-to-method composition, so PwC's Components table cannot be rebuilt; the Papers list carries no Results column for the same reason (the archive does not join its leaderboard rows to method tags).
Categories archive 2025-07-28
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections