Methods › General › Knowledge Distillation › Knowledge Distillation › Papers, page 2
Knowledge Distillation
Papers archive 2025-07-28
archive papers tagged: 3,071 · with a code link: 1,258 · where Syntology ran a sample: 320 (276 with a run with no instrument failure, 44 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (320 of 3,071 tagged: 276 with a run with no instrument failure, 44 where every run was a failure of Syntology's instrument)
Page 2 of 31: papers 101 to 200 of 3,071, newest first by the archive's date (ties by slug), in archive order.
Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code, as “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. It is per sample and not a correctness claim. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from.
-
SepALM: Audio Language Models Are Error Correctors for Robust Speech Separation 6 May 2025 · 0 repositories · arXiv:2505.03273
-
AKD : Adversarial Knowledge Distillation For Large Language Models Alignment on Coding tasks 5 May 2025 · 0 repositories · arXiv:2505.06267
-
End-to-end fully-binarized network design: from Generic Learned Thermometer to Block Pruning 5 May 2025 · 0 repositories · arXiv:2505.13462
-
FedSDAF: Leveraging Source Domain Awareness for Enhanced Federated Domain Generalization 5 May 2025 · 1 repository · arXiv:2505.02515
-
Optimizing LLMs for Resource-Constrained Environments: A Survey of Model Compression Techniques 5 May 2025 · 0 repositories · arXiv:2505.02309
-
Efficient Multivariate Time Series Forecasting via Calibrated Language Models with Privileged Knowledge Distillation 4 May 2025 · 3 repositories · arXiv:2505.02138Syntology community repositories only · 7 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 1 honoured, 0 violated, 3 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified (of 7 harvested samples) · 2 pointer-only (licence)
-
High-Fidelity Pseudo-label Generation by Large Language Models for Training Robust Radiology Report Classifiers 3 May 2025 · 0 repositories · arXiv:2505.01693
-
Toward Data-centric Directed Graph Learning: An Entropy-driven Approach 2 May 2025 · 0 repositories · arXiv:2505.00983
-
CAE-DFKD: Bridging the Transferability Gap in Data-Free Knowledge Distillation 30 Apr 2025 · 0 repositories · arXiv:2504.21478
-
Enhancing New-item Fairness in Dynamic Recommender Systems 30 Apr 2025 · 1 repository · arXiv:2504.21362
-
How to Backdoor the Knowledge Distillation 30 Apr 2025 · 0 repositories · arXiv:2504.21323
-
DS_FusionNet: Dynamic Dual-Stream Fusion with Bidirectional Knowledge Distillation for Plant Disease Recognition 29 Apr 2025 · 1 repository · arXiv:2504.20948
-
Federated One-Shot Learning with Data Privacy and Objective-Hiding 29 Apr 2025 · 0 repositories · arXiv:2504.21182
-
Head-Tail-Aware KL Divergence in Knowledge Distillation for Spiking Neural Networks 29 Apr 2025 · 0 repositories · arXiv:2504.20445
-
SAM-Guided Robust Representation Learning for One-Shot 3D Medical Image Segmentation 29 Apr 2025 · 0 repositories · arXiv:2504.20501
-
The Estimation of Continual Causal Effect for Dataset Shifting Streams 29 Apr 2025 · 0 repositories · arXiv:2504.20471
-
Breaking the Modality Barrier: Universal Embedding Learning with Multimodal LLMs 24 Apr 2025 · 0 repositories · arXiv:2504.17432
-
Does Knowledge Distillation Matter for Large Language Model based Bundle Generation? 24 Apr 2025 · 0 repositories · arXiv:2504.17220
-
Unified Attacks to Large Language Model Watermarks: Spoofing and Scrubbing in Unauthorized Knowledge Distillation 24 Apr 2025 · 0 repositories · arXiv:2504.17480
-
Knowledge Distillation and Dataset Distillation of Large Language Models: Emerging Trends, Challenges, and Future Directions 20 Apr 2025 · 0 repositories · arXiv:2504.14772
-
Turbo2K: Towards Ultra-Efficient and High-Quality 2K Video Synthesis 20 Apr 2025 · 0 repositories · arXiv:2504.14470
-
Empirical Evaluation of Knowledge Distillation from Transformers to Subquadratic Language Models 19 Apr 2025 · 0 repositories · arXiv:2504.14366
-
Teach Me How to Denoise: A Universal Framework for Denoising Multi-modal Recommender Systems via Guided Calibration 19 Apr 2025 · 1 repository · arXiv:2504.14214
-
Feature Alignment and Representation Transfer in Knowledge Distillation for Large Language Models 18 Apr 2025 · 0 repositories · arXiv:2504.13825
-
From Large to Super-Tiny: End-to-End Optimization for Cost-Efficient LLMs 18 Apr 2025 · 0 repositories · arXiv:2504.13471
-
Scaling Laws for Data-Efficient Visual Transfer Learning 17 Apr 2025 · 0 repositories · arXiv:2504.13219
-
A Dual-Space Framework for General Knowledge Distillation of Large Language Models 15 Apr 2025 · 1 repository · arXiv:2504.11426
-
Distillation-Supervised Convolutional Low-Rank Adaptation for Efficient Image Super-Resolution 15 Apr 2025 · 1 repository · arXiv:2504.11271
-
Digital Staining with Knowledge Distillation: A Unified Framework for Unpaired and Paired-But-Misaligned Data 14 Apr 2025 · 1 repository · arXiv:2504.09899
-
Optimizing Multi-Gateway LoRaWAN via Cloud-Edge Collaboration and Knowledge Distillation 13 Apr 2025 · 0 repositories · arXiv:2504.13194
-
Learning Occlusion-Robust Vision Transformers for Real-Time UAV Tracking 12 Apr 2025 · 1 repository · arXiv:2504.09228Syntology official (archive's flag): 1 ran · 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; the one sample that ran constructed an object rather than computing a result (of 1 harvested sample)
-
Knowledge Distillation for Multimodal Egocentric Action Recognition Robust to Missing Modalities 11 Apr 2025 · 0 repositories · arXiv:2504.08578
-
Knowledge Distillation for Underwater Feature Extraction and Matching via GAN-synthesized Images 11 Apr 2025 · 0 repositories · arXiv:2504.08253
-
Proxy-Anchor and EVT-Driven Continual Learning Method for Generalized Category Discovery 11 Apr 2025 · 1 repository · arXiv:2504.08550
-
Distilling Knowledge from Heterogeneous Architectures for Semantic Segmentation 10 Apr 2025 · 0 repositories · arXiv:2504.07691
-
ThermoStereoRT: Thermal Stereo Matching in Real Time via Knowledge Distillation and Attention-based Refinement 10 Apr 2025 · 0 repositories · arXiv:2504.07418
-
Towards Unconstrained 2D Pose Estimation of the Human Spine 10 Apr 2025 · 0 repositories · arXiv:2504.08110
-
Teaching pathology foundation models to accurately predict gene expression with parameter efficient knowledge transfer 9 Apr 2025 · 0 repositories · arXiv:2504.07061
-
GOTHAM: Graph Class Incremental Learning Framework under Weak Supervision 7 Apr 2025 · 1 repository · arXiv:2504.04954
-
Resource-Efficient Beam Prediction in mmWave Communications with Multimodal Realistic Simulation Framework 7 Apr 2025 · 0 repositories · arXiv:2504.05187
-
A Novel Algorithm for Personalized Federated Learning: Knowledge Distillation with Weighted Combination Loss 6 Apr 2025 · 0 repositories · arXiv:2504.04642
-
Corrected with the Latest Version: Make Robust Asynchronous Federated Learning Possible 5 Apr 2025 · 0 repositories · arXiv:2504.04081
-
Distillation and Refinement of Reasoning in Small Language Models for Document Re-ranking 4 Apr 2025 · 1 repository · arXiv:2504.03947
-
Agglomerating Large Vision Encoders via Distillation for VFSS Segmentation 3 Apr 2025 · 0 repositories · arXiv:2504.02351
-
Marine Saliency Segmenter: Object-Focused Conditional Diffusion with Region-Level Semantic Knowledge Distillation 3 Apr 2025 · 0 repositories · arXiv:2504.02391
-
UNDO: Understanding Distillation as Optimization 3 Apr 2025 · 0 repositories · arXiv:2504.02521
-
A Novel Approach To Implementing Knowledge Distillation In Tsetlin Machines 2 Apr 2025 · 0 repositories · arXiv:2504.01798
-
FlowDistill: Scalable Traffic Flow Prediction via Distillation from LLMs 2 Apr 2025 · 1 repository · arXiv:2504.02094
-
KD²M: An unifying framework for feature knowledge distillation 2 Apr 2025 · 0 repositories · arXiv:2504.01757
-
Style over Substance: Distilled Language Models Reason Via Stylistic Replication 2 Apr 2025 · 0 repositories · arXiv:2504.01738
-
Adversarial Curriculum Graph-Free Knowledge Distillation for Graph Neural Networks 1 Apr 2025 · 0 repositories · arXiv:2504.00540
-
Global Intervention and Distillation for Federated Out-of-Distribution Generalization 1 Apr 2025 · 0 repositories · arXiv:2504.00850
-
OccludeNeRF: Geometric-aware 3D Scene Inpainting with Collaborative Score Distillation in NeRF 1 Apr 2025 · 0 repositories · arXiv:2504.02007
-
A Plasticity-Aware Method for Continual Self-Supervised Learning in Remote Sensing 31 Mar 2025 · 0 repositories · arXiv:2503.24088
-
Crossmodal Knowledge Distillation with WordNet-Relaxed Text Embeddings for Robust Image Classification 31 Mar 2025 · 0 repositories · arXiv:2503.24017
-
Is LLM the Silver Bullet to Low-Resource Languages Machine Translation? 31 Mar 2025 · 0 repositories · arXiv:2503.24102
-
Unimodal-driven Distillation in Multimodal Emotion Recognition with Dynamic Fusion 31 Mar 2025 · 0 repositories · arXiv:2503.23721
-
Efficient Verified Machine Unlearning For Distillation 28 Mar 2025 · 0 repositories · arXiv:2503.22539
-
Intrinsic Image Decomposition for Robust Self-supervised Monocular Depth Estimation on Reflective Surfaces 28 Mar 2025 · 0 repositories · arXiv:2503.22209
-
Multi-modal Knowledge Distillation-based Human Trajectory Forecasting 28 Mar 2025 · 1 repository · arXiv:2503.22201
-
Alleviating LLM-based Generative Retrieval Hallucination in Alipay Search 27 Mar 2025 · 0 repositories · arXiv:2503.21098
-
Delving Deep into Semantic Relation Distillation 27 Mar 2025 · 0 repositories · arXiv:2503.21269
-
Modality-Independent Brain Lesion Segmentation with Privacy-aware Continual Learning 26 Mar 2025 · 1 repository · arXiv:2503.20326
-
Small Object Detection: A Comprehensive Survey on Challenges, Techniques and Real-World Applications 26 Mar 2025 · 0 repositories · arXiv:2503.20516
-
Scaling Down Text Encoders of Text-to-Image Diffusion Models 25 Mar 2025 · 1 repository · arXiv:2503.19897
-
Plug-and-Play Interpretable Responsible Text-to-Image Generation via Dual-Space Multi-facet Concept Control 24 Mar 2025 · 0 repositories · arXiv:2503.18324
-
CustomKD: Customizing Large Vision Foundation for Edge Model Improvement via Knowledge Distillation 23 Mar 2025 · 0 repositories · arXiv:2503.18244
-
OmniScience: A Domain-Specialized LLM for Scientific Reasoning and Discovery 22 Mar 2025 · 0 repositories · arXiv:2503.17604
-
Efficient Intent-Based Filtering for Multi-Party Conversations Using Knowledge Distillation from LLMs 21 Mar 2025 · 0 repositories · arXiv:2503.17336
-
InhibiDistilbert: Knowledge Distillation for a ReLU and Addition-based Transformer 20 Mar 2025 · 0 repositories · arXiv:2503.15983
-
DCA: Dividing and Conquering Amnesia in Incremental Object Detection 19 Mar 2025 · 1 repository · arXiv:2503.15295
-
Distilling 3D distinctive local descriptors for 6D pose estimation 19 Mar 2025 · 0 repositories · arXiv:2503.15106
-
High Temporal Consistency through Semantic Similarity Propagation in Semi-Supervised Video Semantic Segmentation for Autonomous Flight 19 Mar 2025 · 1 repository · arXiv:2503.15676Syntology official (archive's flag): 25 ran · 25 ran (of which 15 constructed an object rather than computing a result; 20 with no instrument failure: 0 honoured, 0 violated, 20 with no contract checked; 5 where Syntology's instrument failed) · 14 unverified (of 39 harvested samples) · 39 pointer-only (licence)
-
KoGNER: A Novel Framework for Knowledge Graph Distillation on Biomedical Named Entity Recognition 19 Mar 2025 · 0 repositories · arXiv:2503.15737
-
Technical Report for the 5th CLVision Challenge at CVPR: Addressing the Class-Incremental with Repetition using Unlabeled Data -- 4th Place Solution 19 Mar 2025 · 1 repository · arXiv:2503.15697
-
Ensemble Knowledge Distillation for Machine Learning Interatomic Potentials 18 Mar 2025 · 0 repositories · arXiv:2503.14293
-
SCJD: Sparse Correlation and Joint Distillation for Efficient 3D Human Pose Estimation 18 Mar 2025 · 0 repositories · arXiv:2503.14097
-
Uncertainty-Aware Knowledge Distillation for Compact and Efficient 6DoF Pose Estimation 17 Mar 2025 · 0 repositories · arXiv:2503.13053
-
A Comprehensive Survey on Knowledge Distillation 15 Mar 2025 · 1 repository · arXiv:2503.12067
-
Enabling Weak Client Participation via On-device Knowledge Distillation in Heterogenous Federated Learning 14 Mar 2025 · 0 repositories · arXiv:2503.11151
-
CleverDistiller: Simple and Spatially Consistent Cross-modal Distillation 12 Mar 2025 · 0 repositories · arXiv:2503.09878
-
Unified Locomotion Transformer with Simultaneous Sim-to-Real Transfer for Quadrupeds 12 Mar 2025 · 0 repositories · arXiv:2503.08997
-
Vi-LAD: Vision-Language Attention Distillation for Socially-Aware Robot Navigation in Dynamic Environments 12 Mar 2025 · 0 repositories · arXiv:2503.09820
-
LightGen: Efficient Image Generation through Knowledge Distillation and Direct Preference Optimization 11 Mar 2025 · 1 repository · arXiv:2503.08619Syntology official (archive's flag): 9 ran · 9 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 3 honoured, 0 violated, 2 with no contract checked; 4 where Syntology's instrument failed) · 1 unverified (of 10 harvested samples) · 3 pointer-only (licence)
-
ADROIT: A Self-Supervised Framework for Learning Robust Representations for Active Learning 10 Mar 2025 · 0 repositories · arXiv:2503.07506
-
CoT-Drive: Efficient Motion Forecasting for Autonomous Driving with LLMs and Chain-of-Thought Prompting 10 Mar 2025 · 0 repositories · arXiv:2503.07234
-
Distilling Knowledge into Quantum Vision Transformers for Biomedical Image Classification 10 Mar 2025 · 0 repositories · arXiv:2503.07294
-
Task-Specific Knowledge Distillation from the Vision Foundation Model for Enhanced Medical Image Segmentation 10 Mar 2025 · 0 repositories · arXiv:2503.06976
-
Training Domain Draft Models for Speculative Decoding: Best Practices and Insights 10 Mar 2025 · 0 repositories · arXiv:2503.07807
-
Asymmetric Decision-Making in Online Knowledge Distillation:Unifying Consensus and Divergence 9 Mar 2025 · 0 repositories · arXiv:2503.06685
-
Causality Enhanced Origin-Destination Flow Prediction in Data-Scarce Cities 9 Mar 2025 · 0 repositories · arXiv:2503.06398
-
HFedCKD: Toward Robust Heterogeneous Federated Learning via Data-free Knowledge Distillation and Two-way Contrast 9 Mar 2025 · 0 repositories · arXiv:2503.06511
-
ACAM-KD: Adaptive and Cooperative Attention Masking for Knowledge Distillation 8 Mar 2025 · 0 repositories · arXiv:2503.06307
-
Improving SAM for Camouflaged Object Detection via Dual Stream Adapters 8 Mar 2025 · 0 repositories · arXiv:2503.06042
-
Semantic Shift Estimation via Dual-Projection and Classifier Reconstruction for Exemplar-Free Class-Incremental Learning 7 Mar 2025 · 1 repository · arXiv:2503.05423Syntology official (archive's flag): 1 ran · 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; the one sample that ran constructed an object rather than computing a result (of 1 harvested sample) · 1 pointer-only (licence)
-
Spatial Distillation based Distribution Alignment (SDDA) for Cross-Headset EEG Classification 7 Mar 2025 · 1 repository · arXiv:2503.05349
-
No Forgetting Learning: Memory-free Continual Learning 6 Mar 2025 · 0 repositories · arXiv:2503.04638
-
Temporal Separation with Entropy Regularization for Knowledge Distillation in Spiking Neural Networks 5 Mar 2025 · 0 repositories · arXiv:2503.03144Syntology 3 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 2 where Syntology's instrument failed) · 1 unverified (of 4 harvested samples)
-
Self-Supervised Z-Slice Augmentation for 3D Bio-Imaging via Knowledge Distillation 5 Mar 2025 · 1 repository · arXiv:2503.04843
-
Rapid Bone Scintigraphy Enhancement via Semantic Prior Distillation from Segment Anything Model 4 Mar 2025 · 0 repositories · arXiv:2503.02321