Methods › General › Knowledge Distillation › Knowledge Distillation › Papers, page 10
Knowledge Distillation
Papers archive 2025-07-28
archive papers tagged: 3,071 · with a code link: 1,258 · where Syntology ran a sample: 320 (276 with a run with no instrument failure, 44 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (320 of 3,071 tagged: 276 with a run with no instrument failure, 44 where every run was a failure of Syntology's instrument)
Page 10 of 31: papers 901 to 1,000 of 3,071, newest first by the archive's date (ties by slug), in archive order.
Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code, as “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. It is per sample and not a correctness claim. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from.
-
An Efficient End-to-End Approach to Noise Invariant Speech Features via Multi-Task Learning 13 Mar 2024 · 1 repository · arXiv:2403.08654
-
CoroNetGAN: Controlled Pruning of GANs via Hypernetworks 13 Mar 2024 · 0 repositories · arXiv:2403.08261
-
Distilling Named Entity Recognition Models for Endangered Species from Large Language Models 13 Mar 2024 · 0 repositories · arXiv:2403.15430
-
LIX: Implicitly Infusing Spatial Geometric Prior Knowledge into Visual Semantic Segmentation for Autonomous Driving 13 Mar 2024 · 0 repositories · arXiv:2403.08215
-
Training Self-localization Models for Unseen Unfamiliar Places via Teacher-to-Student Data-Free Knowledge Transfer 13 Mar 2024 · 0 repositories · arXiv:2403.10552
-
Continual All-in-One Adverse Weather Removal with Knowledge Replay on a Unified Network Structure 12 Mar 2024 · 1 repository · arXiv:2403.07292
-
Distilling the Knowledge in Data Pruning 12 Mar 2024 · 0 repositories · arXiv:2403.07854
-
eDifFIQA: Towards Efficient Face Image Quality Assessment Based On Denoising Diffusion Probabilistic Models 12 Mar 2024 · 1 repository
-
Low-Energy On-Device Personalization for MCUs 12 Mar 2024 · 1 repository · arXiv:2403.08040
-
Answering Diverse Questions via Text Attached with Key Audio-Visual Clues 11 Mar 2024 · 1 repository · arXiv:2403.06679
-
AuG-KD: Anchor-Based Mixup Generation for Out-of-Domain Knowledge Distillation 11 Mar 2024 · 1 repository · arXiv:2403.07030Syntology official (archive's flag): 6 ran · 6 ran (of which 2 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 7 harvested samples)
-
Enhancing Adversarial Training with Prior Knowledge Distillation for Robust Image Compression 11 Mar 2024 · 0 repositories · arXiv:2403.06700
-
Evolving Knowledge Distillation with Large Language Models and Active Learning 11 Mar 2024 · 0 repositories · arXiv:2403.06414
-
MEND: Meta dEmonstratioN Distillation for Efficient and Effective In-Context Learning 11 Mar 2024 · 1 repository · arXiv:2403.06914Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 2 honoured, 2 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 4 harvested samples) · 4 pointer-only (licence)
-
One Category One Prompt: Dataset Distillation using Diffusion Models 11 Mar 2024 · 0 repositories · arXiv:2403.07142
-
Bit-mask Robust Contrastive Knowledge Distillation for Unsupervised Semantic Hashing 10 Mar 2024 · 1 repository · arXiv:2403.06071
-
Cooperative Classification and Rationalization for Graph Generalization 10 Mar 2024 · 1 repository · arXiv:2403.06239Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified (of 7 harvested samples) · 7 pointer-only (licence)
-
Frequency Attention for Knowledge Distillation 9 Mar 2024 · 1 repository · arXiv:2403.05894
-
Weakly Supervised Change Detection via Knowledge Distillation and Multiscale Sigmoid Inference 9 Mar 2024 · 1 repository · arXiv:2403.05796
-
RadarDistill: Boosting Radar-based Object Detection Performance via Knowledge Distillation from LiDAR Features 8 Mar 2024 · 1 repository · arXiv:2403.05061
-
Scene Graph Aided Radiology Report Generation 8 Mar 2024 · 0 repositories · arXiv:2403.05687
-
A Study of Dropout-Induced Modality Bias on Robustness to Missing Video Frames for Audio-Visual Speech Recognition 7 Mar 2024 · 1 repository · arXiv:2403.04245
-
Can Small Language Models be Good Reasoners for Sequential Recommendation? 7 Mar 2024 · 0 repositories · arXiv:2403.04260
-
MKF-ADS: Multi-Knowledge Fusion Based Self-supervised Anomaly Detection System for Control Area Network 7 Mar 2024 · 0 repositories · arXiv:2403.04293
-
Privacy-preserving Fine-tuning of Large Language Models through Flatness 7 Mar 2024 · 0 repositories · arXiv:2403.04124
-
Self-Adapting Large Visual-Language Models to Edge Devices across Visual Modalities 7 Mar 2024 · 1 repository · arXiv:2403.04908Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 4 harvested samples) · 4 pointer-only (licence)
-
A Teacher-Free Graph Knowledge Distillation Framework with Dual Self-Distillation 6 Mar 2024 · 1 repository · arXiv:2403.03483
-
PromptKD: Unsupervised Prompt Distillation for Vision-Language Models 5 Mar 2024 · 1 repository · arXiv:2403.02781
-
Distilled ChatGPT Topic & Sentiment Modeling with Applications in Finance 4 Mar 2024 · 0 repositories · arXiv:2403.02185
-
JEP-KD: Joint-Embedding Predictive Architecture Based Knowledge Distillation for Visual Speech Recognition 4 Mar 2024 · 0 repositories · arXiv:2403.18843
-
PowerSkel: A Device-Free Framework Using CSI Signal for Human Skeleton Estimation in Power Station 4 Mar 2024 · 1 repository · arXiv:2403.01913
-
Align-to-Distill: Trainable Attention Alignment for Knowledge Distillation in Neural Machine Translation 3 Mar 2024 · 1 repository · arXiv:2403.01479Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 2 harvested samples) · 2 pointer-only (licence)
-
Hyperspectral Image Analysis in Single-Modal and Multimodal setting using Deep Learning Techniques 3 Mar 2024 · 0 repositories · arXiv:2403.01546
-
Logit Standardization in Knowledge Distillation 3 Mar 2024 · 1 repository · arXiv:2403.01427Syntology official (archive's flag): 1 ran · 2 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples) · 2 pointer-only (licence)
-
Distilling Text Style Transfer With Self-Explanation From LLMs 2 Mar 2024 · 0 repositories · arXiv:2403.01106
-
On the Road to Portability: Compressing End-to-End Motion Planner for Autonomous Driving 2 Mar 2024 · 1 repository · arXiv:2403.01238Syntology official (archive's flag): 8 ran · 8 ran (of which 5 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 2 where Syntology's instrument failed) · 6 unverified (of 14 harvested samples)
-
Data-efficient Event Camera Pre-training via Disentangled Masked Modeling 1 Mar 2024 · 0 repositories · arXiv:2403.00416
-
Differentially Private Knowledge Distillation via Synthetic Text Generation 1 Mar 2024 · 1 repository · arXiv:2403.00932
-
A Cognitive-Based Trajectory Prediction Approach for Autonomous Driving 29 Feb 2024 · 1 repository · arXiv:2402.19251
-
A Lightweight Low-Light Image Enhancement Network via Channel Prior and Gamma Correction 28 Feb 2024 · 0 repositories · arXiv:2402.18147
-
Gradient Reweighting: Towards Imbalanced Class-Incremental Learning 28 Feb 2024 · 0 repositories · arXiv:2402.18528
-
3MVRD: Multimodal Multi-task Multi-teacher Visually-Rich Form Document Understanding 28 Feb 2024 · 1 repository · arXiv:2402.17983
-
Sunshine to Rainstorm: Cross-Weather Knowledge Distillation for Robust 3D Object Detection 28 Feb 2024 · 1 repository · arXiv:2402.18493
-
MCF-VC: Mitigate Catastrophic Forgetting in Class-Incremental Learning for Multimodal Video Captioning 27 Feb 2024 · 0 repositories · arXiv:2402.17680
-
PromptMM: Multi-Modal Knowledge Distillation for Recommendation with Prompt-Tuning 27 Feb 2024 · 1 repository · arXiv:2402.17188Syntology official (archive's flag): 10 ran · 10 ran (of which 0 constructed an object rather than computing a result; 9 with no instrument failure: 1 honoured, 1 violated, 7 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 11 harvested samples) · 11 pointer-only (licence)
-
SDDGR: Stable Diffusion-based Deep Generative Replay for Class Incremental Object Detection 27 Feb 2024 · 0 repositories · arXiv:2402.17323
-
Sinkhorn Distance Minimization for Knowledge Distillation 27 Feb 2024 · 1 repository · arXiv:2402.17110
-
Structural Teacher-Student Normality Learning for Multi-Class Anomaly Detection and Localization 27 Feb 2024 · 0 repositories · arXiv:2402.17091
-
DTCM: Deep Transformer Capsule Mutual Distillation for Multivariate Time Series Classification 26 Feb 2024 · 0 repositories
-
LLM-based Privacy Data Augmentation Guided by Knowledge Distillation with a Distribution Tutor for Medical Text Classification 26 Feb 2024 · 0 repositories · arXiv:2402.16515
-
LLM Inference Unveiled: Survey and Roofline Model Insights 26 Feb 2024 · 2 repositories · arXiv:2402.16363Syntology official (archive's flag): 10 ran · 10 ran (of which 0 constructed an object rather than computing a result; 10 with no instrument failure: 0 honoured, 0 violated, 10 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 10 harvested samples)
-
m2mKD: Module-to-Module Knowledge Distillation for Modular Transformers 26 Feb 2024 · 1 repository · arXiv:2402.16918
-
SKILL: Similarity-aware Knowledge distILLation for Speech Self-Supervised Learning 26 Feb 2024 · 0 repositories · arXiv:2402.16830
-
Enhancing Systematic Decompositional Natural Language Inference Using Informal Logic 22 Feb 2024 · 0 repositories · arXiv:2402.14798
-
Practical Insights into Knowledge Distillation for Pre-Trained Models 22 Feb 2024 · 0 repositories · arXiv:2402.14922
-
TIE-KD: Teacher-Independent and Explainable Knowledge Distillation for Monocular Depth Estimation 22 Feb 2024 · 1 repository · arXiv:2402.14340
-
PaCKD: Pattern-Clustered Knowledge Distillation for Compressing Memory Access Prediction Models 21 Feb 2024 · 1 repository · arXiv:2402.13441
-
In-Distribution Consistency Regularization Improves the Generalization of Quantization-Aware Training 21 Feb 2024 · 0 repositories · arXiv:2402.13497
-
Unsupervised Text Style Transfer via LLMs and Attention Masking with Multi-way Interactions 21 Feb 2024 · 0 repositories · arXiv:2402.13647
-
Wisdom of Committee: Distilling from Foundation Model to Specialized Application Model 21 Feb 2024 · 0 repositories · arXiv:2402.14035
-
A Survey on Knowledge Distillation of Large Language Models 20 Feb 2024 · 1 repository · arXiv:2402.13116
-
Improve Cross-Architecture Generalization on Dataset Distillation 20 Feb 2024 · 1 repository · arXiv:2402.13007Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 4 harvested samples) · 4 pointer-only (licence)
-
PromptKD: Distilling Student-Friendly Knowledge for Generative Language Models via Prompt Tuning 20 Feb 2024 · 1 repository · arXiv:2402.12842Syntology official (archive's flag): 8 ran · 8 ran (of which 0 constructed an object rather than computing a result; 8 with no instrument failure: 0 honoured, 0 violated, 8 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 10 harvested samples)
-
On the Byzantine-Resilience of Distillation-Based Federated Learning 19 Feb 2024 · 1 repository · arXiv:2402.12265
-
Towards Cross-Tokenizer Distillation: the Universal Logit Distillation Loss for LLMs 19 Feb 2024 · 3 repositories · arXiv:2402.12030Syntology official (archive's flag): 6 ran · 14 ran (of which 0 constructed an object rather than computing a result; 14 with no instrument failure: 0 honoured, 0 violated, 14 with no contract checked; 0 where Syntology's instrument failed) · 5 unverified (of 19 harvested samples) · 8 pointer-only (licence)
-
Teacher as a Lenient Expert: Teacher-Agnostic Data-Free Knowledge Distillation 18 Feb 2024 · 1 repository · arXiv:2402.12406
-
GraphKD: Exploring Knowledge Distillation Towards Document Object Detection with Structured Graph Creation 17 Feb 2024 · 1 repository · arXiv:2402.11401
-
Knowledge Distillation Based on Transformed Teacher Matching 17 Feb 2024 · 1 repository · arXiv:2402.11148Syntology official (archive's flag): 5 ran · 5 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 3 where Syntology's instrument failed) · 2 unverified (of 7 harvested samples) · 1 pointer-only (licence)
-
On Good Practices for Task-Specific Distillation of Large Pretrained Visual Models 17 Feb 2024 · 0 repositories · arXiv:2402.11305
-
BitDistiller: Unleashing the Potential of Sub-4-Bit LLMs via Self-Distillation 16 Feb 2024 · 2 repositories · arXiv:2402.10631Syntology official (archive's flag): 8 ran · 8 ran (of which 0 constructed an object rather than computing a result; 7 with no instrument failure: 0 honoured, 1 violated, 6 with no contract checked; 1 where Syntology's instrument failed) · 7 unverified (of 15 harvested samples) · 3 pointer-only (licence)
-
FedD2S: Personalized Data-Free Federated Knowledge Distillation 16 Feb 2024 · 0 repositories · arXiv:2402.10846
-
Incremental Sequence Labeling: A Tale of Two Shifts 16 Feb 2024 · 2 repositories · arXiv:2402.10447
-
NutePrune: Efficient Progressive Pruning with Numerous Teachers for Large Language Models 15 Feb 2024 · 1 repository · arXiv:2402.09773Syntology official (archive's flag): 9 ran · 9 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 4 where Syntology's instrument failed) · 7 unverified (of 16 harvested samples) · 16 pointer-only (licence)
-
Walsh-domain Neural Network for Power Amplifier Behavioral Modelling and Digital Predistortion 15 Feb 2024 · 0 repositories · arXiv:2402.09964
-
FedSiKD: Clients Similarity and Knowledge Distillation: Addressing Non-i.i.d. and Constraints in Federated Learning 14 Feb 2024 · 1 repository · arXiv:2402.09095
-
Integrating ChatGPT into Secure Hospital Networks: A Case Study on Improving Radiology Report Analysis 14 Feb 2024 · 0 repositories · arXiv:2402.09358
-
Training Heterogeneous Client Models using Knowledge Distillation in Serverless Federated Learning 11 Feb 2024 · 1 repository · arXiv:2402.07295
-
Two-Stage Multi-task Self-Supervised Learning for Medical Image Segmentation 11 Feb 2024 · 0 repositories · arXiv:2402.07119
-
Domain Adaptable Fine-Tune Distillation Framework For Advancing Farm Surveillance 10 Feb 2024 · 1 repository · arXiv:2402.07059
-
Embedding Compression for Teacher-to-Student Knowledge Transfer 9 Feb 2024 · 0 repositories · arXiv:2402.06761
-
Multi-source-free Domain Adaptation via Uncertainty-aware Adaptive Distillation 9 Feb 2024 · 1 repository · arXiv:2402.06213
-
Large Language Model Meets Graph Neural Network in Knowledge Distillation 8 Feb 2024 · 0 repositories · arXiv:2402.05894
-
EfficientViT-SAM: Accelerated Segment Anything Model Without Accuracy Loss 7 Feb 2024 · 1 repository · arXiv:2402.05008
-
Knowledge Distillation for Road Detection based on cross-model Semi-Supervised Learning 7 Feb 2024 · 0 repositories · arXiv:2402.05305
-
Beyond Answers: Transferring Reasoning Capabilities to Smaller LLMs Using Multi-Teacher Knowledge Distillation 7 Feb 2024 · 1 repository · arXiv:2402.04616Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)
-
Vision Superalignment: Weak-to-Strong Generalization for Vision Foundation Models 6 Feb 2024 · 1 repository · arXiv:2402.03749Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 2 where Syntology's instrument failed) · 2 unverified (of 6 harvested samples) · 6 pointer-only (licence)
-
Dual Knowledge Distillation for Efficient Sound Event Detection 5 Feb 2024 · 0 repositories · arXiv:2402.02781
-
Large Language Model Distilling Medication Recommendation Model 5 Feb 2024 · 1 repository · arXiv:2402.02803
-
Bi-CryptoNets: Leveraging Different-Level Privacy for Encrypted Inference 2 Feb 2024 · 0 repositories · arXiv:2402.01296
-
Class incremental learning with probability dampening and cascaded gated classifier 2 Feb 2024 · 2 repositories · arXiv:2402.01262
-
Cooperative Knowledge Distillation: A Learner Agnostic Approach 2 Feb 2024 · 1 repository · arXiv:2402.05942
-
Faster Inference of Integer SWIN Transformer by Removing the GELU Activation 2 Feb 2024 · 0 repositories · arXiv:2402.01169
-
Spiking CenterNet: A Distillation-boosted Spiking Neural Network for Object Detection 2 Feb 2024 · 0 repositories · arXiv:2402.01287
-
Addressing Bias Through Ensemble Learning and Regularized Fine-Tuning 1 Feb 2024 · 0 repositories · arXiv:2402.00910
-
Augmenting Offline Reinforcement Learning with State-only Interactions 1 Feb 2024 · 0 repositories · arXiv:2402.00807
-
Dual-Student Knowledge Distillation Networks for Unsupervised Anomaly Detection 1 Feb 2024 · 0 repositories · arXiv:2402.00448
-
EPSD: Early Pruning with Self-Distillation for Efficient Model Compression 31 Jan 2024 · 0 repositories · arXiv:2402.00084
-
Scavenging Hyena: Distilling Transformers into Long Convolution Models 31 Jan 2024 · 0 repositories · arXiv:2401.17574
-
LLaMP: Large Language Model Made Powerful for High-fidelity Materials Knowledge Retrieval and Distillation 30 Jan 2024 · 1 repository · arXiv:2401.17244Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
Distilling Privileged Multimodal Information for Expression Recognition using Optimal Transport 27 Jan 2024 · 0 repositories · arXiv:2401.15489