Methods › General › Knowledge Distillation › Knowledge Distillation › Papers, page 3
Knowledge Distillation
Papers archive 2025-07-28
archive papers tagged: 3,071 · with a code link: 1,258 · where Syntology ran a sample: 320 (276 with a run with no instrument failure, 44 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (320 of 3,071 tagged: 276 with a run with no instrument failure, 44 where every run was a failure of Syntology's instrument)
Page 3 of 31: papers 201 to 300 of 3,071, newest first by the archive's date (ties by slug), in archive order.
Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code, as “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. It is per sample and not a correctness claim. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from.
-
DILEMMA: Joint LLM Quantization and Distributed LLM Inference Over Edge Computing Systems 3 Mar 2025 · 0 repositories · arXiv:2503.01704
-
Mamba base PKD for efficient knowledge compression 3 Mar 2025 · 0 repositories · arXiv:2503.01727
-
Lightweight Contrastive Distilled Hashing for Online Cross-modal Retrieval 27 Feb 2025 · 0 repositories · arXiv:2502.19751
-
SEKI: Self-Evolution and Knowledge Inspiration based Neural Architecture Search via Large Language Models 27 Feb 2025 · 0 repositories · arXiv:2502.20422
-
XCOMPS: A Multilingual Benchmark of Conceptual Minimal Pairs 27 Feb 2025 · 0 repositories · arXiv:2502.19737
-
Winning Big with Small Models: Knowledge Distillation vs. Self-Training for Reducing Hallucination in QA Agents 26 Feb 2025 · 0 repositories · arXiv:2502.19545
-
Advantage-Guided Distillation for Preference Alignment in Small Language Models 25 Feb 2025 · 1 repository · arXiv:2502.17927Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples) · 3 pointer-only (licence)
-
AfroXLMR-Comet: Multilingual Knowledge Distillation with Attention Matching for Low-Resource languages 25 Feb 2025 · 0 repositories · arXiv:2502.18020
-
A Transformer-in-Transformer Network Utilizing Knowledge Distillation for Image Recognition 24 Feb 2025 · 0 repositories · arXiv:2502.16762
-
CLIMB-3D: Continual Learning for Imbalanced 3D Instance Segmentation 24 Feb 2025 · 1 repository · arXiv:2502.17429
-
CoT2Align: Cross-Chain of Thought Distillation via Optimal Transport Alignment for Language Models with Different Tokenizers 24 Feb 2025 · 0 repositories · arXiv:2502.16806
-
Implicit Word Reordering with Knowledge Distillation for Cross-Lingual Dependency Parsing 24 Feb 2025 · 0 repositories · arXiv:2502.17308
-
Improving the Transferability of Adversarial Examples by Inverse Knowledge Distillation 24 Feb 2025 · 0 repositories · arXiv:2502.17003
-
Knowledge Distillation with Training Wheels 24 Feb 2025 · 0 repositories · arXiv:2502.17717
-
PQDAST: Depth-Aware Arbitrary Style Transfer for Games via Perceptual Quality-Guided Distillation 24 Feb 2025 · 0 repositories · arXiv:2502.16996
-
EDocNet: Efficient Datasheet Layout Analysis Based on Focus and Global Knowledge Distillation 23 Feb 2025 · 0 repositories · arXiv:2502.16541
-
A Knowledge Distillation-Based Approach to Enhance Transparency of Classifier Models 21 Feb 2025 · 1 repository · arXiv:2502.15959
-
Scaling Sparse and Dense Retrieval in Decoder-Only LLMs 21 Feb 2025 · 2 repositories · arXiv:2502.15526
-
Designing Parameter and Compute Efficient Diffusion Transformers using Distillation 20 Feb 2025 · 0 repositories · arXiv:2502.14226
-
Efficient AI in Practice: Training and Deployment of Efficient LLMs for Industry Applications 20 Feb 2025 · 0 repositories · arXiv:2502.14305Syntology 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 5 harvested samples)
-
Modifying Final Splits of Classification Tree for Fine-tuning Subpopulation Target in Policy Making 20 Feb 2025 · 0 repositories · arXiv:2502.15072
-
Self-supervised Monocular Depth Estimation Robust to Reflective Surface Leveraged by Triplet Mining 20 Feb 2025 · 0 repositories · arXiv:2502.14573
-
TimeDistill: Efficient Long-Term Time Series Forecasting with MLP via Cross-Architecture Distillation 20 Feb 2025 · 0 repositories · arXiv:2502.15016
-
Vision Foundation Models in Medical Image Analysis: Advances and Challenges 20 Feb 2025 · 0 repositories · arXiv:2502.14584
-
Dynamic Activation with Knowledge Distillation for Energy-Efficient Spiking NN Ensembles 19 Feb 2025 · 0 repositories · arXiv:2502.14023
-
JL1-CD: A New Benchmark for Remote Sensing Change Detection and a Robust Multi-Teacher Knowledge Distillation Framework 19 Feb 2025 · 1 repository · arXiv:2502.13407
-
MambaLiteSR: Image Super-Resolution with Low-Rank Mamba using Knowledge Distillation 19 Feb 2025 · 0 repositories · arXiv:2502.14090
-
Towards Vector Optimization on Low-Dimensional Vector Symbolic Architecture 19 Feb 2025 · 1 repository · arXiv:2502.14075
-
Enhancing Semi-supervised Learning with Zero-shot Pseudolabels 18 Feb 2025 · 0 repositories · arXiv:2502.12584
-
Every Expert Matters: Towards Effective Knowledge Distillation for Mixture-of-Experts Language Models 18 Feb 2025 · 0 repositories · arXiv:2502.12947
-
NaturalReasoning: Reasoning in the Wild with 2.8M Challenging Questions 18 Feb 2025 · 0 repositories · arXiv:2502.13124
-
Can LLM Watermarks Robustly Prevent Unauthorized Knowledge Distillation? 17 Feb 2025 · 1 repository · arXiv:2502.11598Syntology official: harvested, nothing ran · 0 ran · 3 unverified (of 3 harvested samples) · 3 pointer-only (licence)
-
Leave No One Behind: Enhancing Diversity While Maintaining Accuracy in Social Recommendation 17 Feb 2025 · 1 repository · arXiv:2502.11374
-
Warmup-Distill: Bridge the Distribution Mismatch between Teacher and Student before Knowledge Distillation 17 Feb 2025 · 1 repository · arXiv:2502.11766
-
DA-Mamba: Domain Adaptive Hybrid Mamba-Transformer Based One-Stage Object Detection 16 Feb 2025 · 2 repositories · arXiv:2502.11178
-
Leveraging Conditional Mutual Information to Improve Large Language Model Fine-Tuning For Classification 16 Feb 2025 · 0 repositories · arXiv:2502.11258
-
Smoothing Out Hallucinations: Mitigating LLM Hallucination with Smoothed Knowledge Distillation 16 Feb 2025 · 0 repositories · arXiv:2502.11306
-
CLoCKDistill: Consistent Location-and-Context-aware Knowledge Distillation for DETRs 15 Feb 2025 · 0 repositories · arXiv:2502.10683
-
LLM-driven Knowledge Distillation for Dynamic Text-Attributed Graphs 15 Feb 2025 · 0 repositories · arXiv:2502.10914
-
AIDE: Agentically Improve Visual Language Model with Domain Experts 13 Feb 2025 · 0 repositories · arXiv:2502.09051
-
LLM Pretraining with Continuous Concepts 12 Feb 2025 · 0 repositories · arXiv:2502.08524
-
Life-Code: Central Dogma Modeling with Multi-Omics Sequence Unification 11 Feb 2025 · 0 repositories · arXiv:2502.07299
-
DROP: Poison Dilution via Knowledge Distillation for Federated Learning 10 Feb 2025 · 1 repository · arXiv:2502.07011
-
Progressive Collaborative and Semantic Knowledge Fusion for Generative Recommendation 10 Feb 2025 · 0 repositories · arXiv:2502.06269
-
Rationalization Models for Text-to-SQL 10 Feb 2025 · 0 repositories · arXiv:2502.06759
-
Audio-Visual Representation Learning via Knowledge Distillation from Speech Foundation Models 9 Feb 2025 · 1 repository · arXiv:2502.05766
-
Synergistic Effects of Knowledge Distillation and Structured Pruning for Self-Supervised Speech Models 9 Feb 2025 · 0 repositories · arXiv:2502.05837
-
Demystifying Catastrophic Forgetting in Two-Stage Incremental Object Detector 8 Feb 2025 · 0 repositories · arXiv:2502.05540
-
Event Stream-based Visual Object Tracking: HDETrack V2 and A High-Definition Benchmark 8 Feb 2025 · 1 repository · arXiv:2502.05574
-
BOLT: Bootstrap Long Chain-of-Thought in Language Models without Distillation 6 Feb 2025 · 0 repositories · arXiv:2502.03860
-
Multilingual Non-Autoregressive Machine Translation without Knowledge Distillation 6 Feb 2025 · 1 repository · arXiv:2502.04537
-
Towards Unified Music Emotion Recognition across Dimensional and Categorical Models 6 Feb 2025 · 1 repository · arXiv:2502.03979Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 5 harvested samples)
-
Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons 5 Feb 2025 · 0 repositories · arXiv:2502.02988
-
MIND: Modality-Informed Knowledge Distillation Framework for Multimodal Clinical Prediction Tasks 3 Feb 2025 · 0 repositories · arXiv:2502.01158
-
A method for estimating forest carbon storage distribution density via artificial intelligence generated content model 2 Feb 2025 · 0 repositories · arXiv:2502.00783
-
FedHPD: Heterogeneous Federated Reinforcement Learning via Policy Distillation 2 Feb 2025 · 1 repository · arXiv:2502.00870
-
Role of Mixup in Topological Persistence Based Knowledge Distillation for Wearable Sensor Data 2 Feb 2025 · 0 repositories · arXiv:2502.00779
-
VLM-Assisted Continual learning for Visual Question Answering in Self-Driving 2 Feb 2025 · 0 repositories · arXiv:2502.00843
-
Robust Knowledge Distillation in Federated Learning: Counteracting Backdoor Attacks 1 Feb 2025 · 1 repository · arXiv:2502.00587
-
Mini-ResEmoteNet: Leveraging Knowledge Distillation for Human-Centered Design 30 Jan 2025 · 0 repositories · arXiv:2501.18538
-
Distilling Knowledge for Designing Computational Imaging Systems 29 Jan 2025 · 1 repository · arXiv:2501.17898
-
RL-based Query Rewriting with Distilled LLM for online E-Commerce Systems 29 Jan 2025 · 0 repositories · arXiv:2501.18056
-
A Contrastive Teacher-Student Framework for Novelty Detection under Style Shifts 28 Jan 2025 · 0 repositories · arXiv:2501.17289
-
Efficient Knowledge Distillation of SAM for Medical Image Segmentation 28 Jan 2025 · 0 repositories · arXiv:2501.16740
-
FedEFM: Federated Endovascular Foundation Model with Unseen Data 28 Jan 2025 · 0 repositories · arXiv:2501.16992
-
TAID: Temporally Adaptive Interpolated Distillation for Efficient Knowledge Transfer in Language Models 28 Jan 2025 · 0 repositories · arXiv:2501.16937
-
Target-driven Self-Distillation for Partial Observed Trajectories Forecasting 28 Jan 2025 · 0 repositories · arXiv:2501.16767
-
PISCO: Pretty Simple Compression for Retrieval-Augmented Generation 27 Jan 2025 · 0 repositories · arXiv:2501.16075
-
Return of the Encoder: Maximizing Parameter Efficiency for SLMs 27 Jan 2025 · 1 repository · arXiv:2501.16273
-
Scaling Large Vision-Language Models for Enhanced Multimodal Comprehension In Biomedical Image Analysis 26 Jan 2025 · 0 repositories · arXiv:2501.15370
-
Graph-Based Cross-Domain Knowledge Distillation for Cross-Dataset Text-to-Image Person Retrieval 25 Jan 2025 · 0 repositories · arXiv:2501.15052
-
Pre-trained Model Guided Mixture Knowledge Distillation for Adversarial Federated Learning 25 Jan 2025 · 0 repositories · arXiv:2501.15257
-
Remining Hard Negatives for Generative Pseudo Labeled Domain Adaptation 24 Jan 2025 · 0 repositories · arXiv:2501.14434
-
Multi-aspect Knowledge Distillation with Large Language Model 23 Jan 2025 · 1 repository · arXiv:2501.13341
-
Unlearning Clients, Features and Samples in Vertical Federated Learning 23 Jan 2025 · 0 repositories · arXiv:2501.13683
-
Extracting General-use Transformers for Low-resource Languages via Knowledge Distillation 22 Jan 2025 · 0 repositories · arXiv:2501.12660
-
LiT: Delving into a Simplified Linear Diffusion Transformer for Image Generation 22 Jan 2025 · 0 repositories · arXiv:2501.12976
-
Toward Model-centric Heterogeneous Federated Graph Learning: A Knowledge-driven Approach 22 Jan 2025 · 0 repositories · arXiv:2501.12624
-
DNA 1.0 Technical Report 18 Jan 2025 · 0 repositories · arXiv:2501.10648
-
Class Incremental Fault Diagnosis under Limited Fault Data via Supervised Contrastive Knowledge Distillation 16 Jan 2025 · 1 repository · arXiv:2501.09525
-
Enhancing Generalization in Chain of Thought Reasoning for Smaller Models 16 Jan 2025 · 0 repositories · arXiv:2501.09804
-
Knowledge Distillation for Image Restoration : Simultaneous Learning from Degraded and Clean Images 16 Jan 2025 · 0 repositories · arXiv:2501.09268
-
Soft Knowledge Distillation with Multi-Dimensional Cross-Net Attention for Image Restoration Models Compression 16 Jan 2025 · 0 repositories · arXiv:2501.09321
-
Efficient Traffic Prediction Through Spatio-Temporal Distillation 15 Jan 2025 · 1 repository · arXiv:2501.10459Syntology official: harvested, nothing ran · 0 ran · 1 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
Induced Model Matching: Restricted Models Help Train Full-Featured Models 15 Jan 2025 · 3 repositories
-
Towards Fast, Specialized Machine Learning Force Fields: Distilling Foundation Models via Energy Hessians 15 Jan 2025 · 1 repository · arXiv:2501.09009
-
VECT-GAN: A variationally encoded generative model for overcoming data scarcity in pharmaceutical science 15 Jan 2025 · 1 repository · arXiv:2501.08995
-
Balance Divergence for Knowledge Distillation 14 Jan 2025 · 0 repositories · arXiv:2501.07804
-
Self-Attentive Spatio-Temporal Calibration for Precise Intermediate Layer Matching in ANN-to-SNN Distillation 14 Jan 2025 · 1 repository · arXiv:2501.08049
-
Dual Scale-aware Adaptive Masked Knowledge Distillation for Object Detection 13 Jan 2025 · 0 repositories · arXiv:2501.07101
-
Knowledge Distillation and Enhanced Subdomain Adaptation Using Graph Convolutional Network for Resource-Constrained Bearing Fault Diagnosis 13 Jan 2025 · 0 repositories · arXiv:2501.07173
-
Research on the Online Update Method for Retrieval-Augmented Generation (RAG) Model with Incremental Learning 13 Jan 2025 · 0 repositories · arXiv:2501.07063
-
Rethinking Knowledge in Distillation: An In-context Sample Retrieval Perspective 13 Jan 2025 · 0 repositories · arXiv:2501.07040
-
Application of Vision-Language Model to Pedestrians Behavior and Scene Understanding in Autonomous Driving 12 Jan 2025 · 0 repositories · arXiv:2501.06680
-
From My View to Yours: Ego-Augmented Learning in Large Vision Language Models for Understanding Exocentric Daily Living Activities 10 Jan 2025 · 1 repository · arXiv:2501.05711
-
Overcoming Language Priors for Visual Question Answering Based on Knowledge Distillation 10 Jan 2025 · 0 repositories · arXiv:2501.05690
-
LLMQuoter: Enhancing RAG Capabilities Through Efficient Quote Extraction From Large Contexts 9 Jan 2025 · 1 repository · arXiv:2501.05554
-
Federated Fine-Tuning of LLMs: Framework Comparison and Research Directions 8 Jan 2025 · 0 repositories · arXiv:2501.04436
-
A Diversity-Enhanced Knowledge Distillation Model for Practical Math Word Problem Solving 7 Jan 2025 · 1 repository · arXiv:2501.03670
-
ConcealGS: Concealing Invisible Copyright Information in 3D Gaussian Splatting 7 Jan 2025 · 1 repository · arXiv:2501.03605