Methods › General › Knowledge Distillation › Knowledge Distillation › Papers, page 15
Knowledge Distillation
Papers archive 2025-07-28
archive papers tagged: 3,071 · with a code link: 1,258 · where Syntology ran a sample: 320 (276 with a run with no instrument failure, 44 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (320 of 3,071 tagged: 276 with a run with no instrument failure, 44 where every run was a failure of Syntology's instrument)
Page 15 of 31: papers 1,401 to 1,500 of 3,071, newest first by the archive's date (ties by slug), in archive order.
Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code, as “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. It is per sample and not a correctness claim. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from.
-
Teacher Agent: A Knowledge Distillation-Free Framework for Rehearsal-based Video Incremental Learning 1 Jun 2023 · 1 repository · arXiv:2306.00393
-
Accurate and Structured Pruning for Efficient Automatic Speech Recognition 31 May 2023 · 0 repositories · arXiv:2305.19549
-
PlaSma: Making Small Language Models Better Procedural Knowledge Models for (Counterfactual) Planning 31 May 2023 · 1 repository · arXiv:2305.19472Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)
-
Are Large Kernels Better Teachers than Transformers for ConvNets? 30 May 2023 · 1 repository · arXiv:2305.19412Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
KEYword based Sampling (KEYS) for Large Language Models 30 May 2023 · 0 repositories · arXiv:2305.18679
-
Research on Multilingual News Clustering Based on Cross-Language Word Embeddings 30 May 2023 · 0 repositories · arXiv:2305.18880
-
Semi-supervised Pathological Image Segmentation via Cross Distillation of Multiple Attentions 30 May 2023 · 1 repository · arXiv:2305.18830
-
GripRank: Bridging the Gap between Retrieval and Generation via the Generative Knowledge Improved Passage Ranking 29 May 2023 · 0 repositories · arXiv:2305.18144
-
Bridging the Sim-to-Real Gap from the Information Bottleneck Perspective 29 May 2023 · 1 repository · arXiv:2305.18464
-
ConaCLIP: Exploring Distillation of Fully-Connected Knowledge Interaction Graph for Lightweight Text-Image Retrieval 28 May 2023 · 0 repositories · arXiv:2305.17652
-
DPHuBERT: Joint Distillation and Pruning of Self-Supervised Speech Models 28 May 2023 · 1 repository · arXiv:2305.17651Syntology official: harvested, nothing ran · 0 ran · 3 unverified (of 3 harvested samples)
-
Learning to Learn from APIs: Black-Box Data-Free Meta-Learning 28 May 2023 · 1 repository · arXiv:2305.18413
-
FoPro-KD: Fourier Prompted Effective Knowledge Distillation for Long-Tailed Medical Image Recognition 27 May 2023 · 1 repository · arXiv:2305.17421
-
Knowledge Distillation Performs Partial Variance Reduction 27 May 2023 · 1 repository · arXiv:2305.17581Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples)
-
One-Step Knowledge Distillation and Fine-Tuning in Using Large Pre-Trained Self-Supervised Learning Models for Speaker Verification 27 May 2023 · 1 repository · arXiv:2305.17394
-
Towards Better Entity Linking with Multi-View Enhanced Distillation 27 May 2023 · 1 repository · arXiv:2305.17371
-
Vision Transformers for Small Histological Datasets Learned through Knowledge Distillation 27 May 2023 · 1 repository · arXiv:2305.17370
-
ABC-KD: Attention-Based-Compression Knowledge Distillation for Deep Learning-Based Noise Suppression 26 May 2023 · 0 repositories · arXiv:2305.16665
-
Improving Knowledge Distillation via Regularizing Feature Norm and Direction 26 May 2023 · 1 repository · arXiv:2305.17007Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples) · 3 pointer-only (licence)
-
Camera-Incremental Object Re-Identification with Identity Knowledge Evolution 25 May 2023 · 1 repository · arXiv:2305.15909
-
Collective Knowledge Graph Completion with Mutual Knowledge Distillation 25 May 2023 · 0 repositories · arXiv:2305.15895
-
Cross-Lingual Knowledge Distillation for Answer Sentence Selection in Low-Resource Languages 25 May 2023 · 0 repositories · arXiv:2305.16302
-
Fairness Continual Learning Approach to Semantic Scene Understanding in Open-World Environments 25 May 2023 · 0 repositories · arXiv:2305.15700
-
Knowledge Diffusion for Distillation 25 May 2023 · 1 repository · arXiv:2305.15712
-
Knowledge Distillation for Neural Transducer-based Target-Speaker ASR: Exploiting Parallel Mixture/Single-Talker Speech Data 25 May 2023 · 0 repositories · arXiv:2305.15971
-
BK-SDM: A Lightweight, Fast, and Cheap Version of Stable Diffusion 25 May 2023 · 3 repositories · arXiv:2305.15798Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples) · 3 pointer-only (licence)
-
On the Impact of Knowledge Distillation for Model Interpretability 25 May 2023 · 0 repositories · arXiv:2305.15734
-
OVO: Open-Vocabulary Occupancy 25 May 2023 · 1 repository · arXiv:2305.16133Syntology official (archive's flag): 9 ran · 9 ran (of which 0 constructed an object rather than computing a result; 9 with no instrument failure: 0 honoured, 0 violated, 9 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 11 harvested samples) · 2 pointer-only (licence)
-
Triplet Knowledge Distillation 25 May 2023 · 0 repositories · arXiv:2305.15975
-
VanillaKD: Revisit the Power of Vanilla Knowledge Distillation from Small Scale to Large Scale 25 May 2023 · 1 repository · arXiv:2305.15781
-
AdvFunMatch: When Consistent Teaching Meets Adversarial Robustness 24 May 2023 · 0 repositories · arXiv:2305.14700
-
CoLaDa: A Collaborative Label Denoising Framework for Cross-lingual Named Entity Recognition 24 May 2023 · 1 repository · arXiv:2305.14913
-
How to Distill your BERT: An Empirical Study on the Impact of Weight Initialisation and Distillation Objectives 24 May 2023 · 1 repository · arXiv:2305.15032Syntology official (archive's flag): 6 ran · 6 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 1 where Syntology's instrument failed) · 5 unverified (of 11 harvested samples)
-
Incorporating Ultrasound Tongue Images for Audio-Visual Speech Enhancement through Knowledge Distillation 24 May 2023 · 0 repositories · arXiv:2305.14933
-
Deakin RF-Sensing: Experiments on Correlated Knowledge Distillation for Monitoring Human Postures with Radios 24 May 2023 · 0 repositories · arXiv:2305.14829
-
Decoupled Kullback-Leibler Divergence Loss 23 May 2023 · 4 repositories · arXiv:2305.13948Syntology official (archive's flag): 4 ran · 11 ran (of which 1 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 6 where Syntology's instrument failed) · 0 unverified (of 11 harvested samples) · 4 pointer-only (licence)
-
NORM: Knowledge Distillation via N-to-One Representation Matching 23 May 2023 · 1 repository · arXiv:2305.13803Syntology official (archive's flag): 1 ran · 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 7 unverified; the one sample that ran constructed an object rather than computing a result (of 8 harvested samples)
-
Sequence-Level Knowledge Distillation for Class-Incremental End-to-End Spoken Language Understanding 23 May 2023 · 0 repositories · arXiv:2305.13899
-
D²TV: Dual Knowledge Distillation and Target-oriented Vision Modeling for Many-to-Many Multimodal Summarization 22 May 2023 · 1 repository · arXiv:2305.12767
-
EnSiam: Self-Supervised Learning With Ensemble Representations 22 May 2023 · 0 repositories · arXiv:2305.13391
-
Distilling Robustness into Natural Language Inference Models with Domain-Targeted Augmentation 22 May 2023 · 0 repositories · arXiv:2305.13067
-
Is Synthetic Data From Diffusion Models Ready for Knowledge Distillation? 22 May 2023 · 1 repository · arXiv:2305.12954Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
Lion: Adversarial Distillation of Proprietary Large Language Models 22 May 2023 · 1 repository · arXiv:2305.12870Syntology official (archive's flag): 6 ran · 6 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 1 where Syntology's instrument failed) · 5 unverified (of 11 harvested samples) · 1 pointer-only (licence)
-
Revisiting Data Augmentation in Model Compression: An Empirical and Comprehensive Study 22 May 2023 · 0 repositories · arXiv:2305.13232
-
DualVC: Dual-mode Voice Conversion using Intra-model Knowledge Distillation and Hybrid Predictive Coding 21 May 2023 · 0 repositories · arXiv:2305.12425
-
Understanding the Effect of Data Augmentation on Knowledge Distillation 21 May 2023 · 0 repositories · arXiv:2305.12565
-
Accurate Knowledge Distillation with n-best Reranking 20 May 2023 · 0 repositories · arXiv:2305.12057
-
Lifting the Curse of Capacity Gap in Distilling Language Models 20 May 2023 · 1 repository · arXiv:2305.12129Syntology official (archive's flag): 7 ran · 7 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 1 where Syntology's instrument failed) · 6 unverified (of 13 harvested samples)
-
Sentence Embedder Guided Utterance Encoder (SEGUE) for Spoken Language Understanding 20 May 2023 · 1 repository · arXiv:2305.12301
-
Boost Vision Transformer with GPU-Friendly Sparsity and Quantization 18 May 2023 · 0 repositories · arXiv:2305.10727
-
Catch-Up Distillation: You Only Need to Train Once for Accelerating Sampling 18 May 2023 · 1 repository · arXiv:2305.10769Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples) · 2 pointer-only (licence)
-
Student-friendly Knowledge Distillation 18 May 2023 · 0 repositories · arXiv:2305.10893
-
DQ-Whisper: Joint Distillation and Quantization for Efficient Multilingual Speech Recognition 18 May 2023 · 0 repositories · arXiv:2305.10788
-
AD-KD: Attribution-Driven Knowledge Distillation for Language Model Compression 17 May 2023 · 1 repository · arXiv:2305.10010Syntology official (archive's flag): 3 ran · 3 ran (of which 1 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 4 harvested samples) · 4 pointer-only (licence)
-
Tailoring Instructions to Student's Learning Levels Boosts Knowledge Distillation 16 May 2023 · 1 repository · arXiv:2305.09651Syntology official (archive's flag): 2 ran · 2 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples)
-
Bridging the Domain Gap: Self-Supervised 3D Scene Understanding with Foundation Models 15 May 2023 · 1 repository · arXiv:2305.08776
-
Distilling Knowledge for Short-to-Long Term Trajectory Prediction 15 May 2023 · 0 repositories · arXiv:2305.08553
-
Soft Prompt Decoding for Multilingual Dense Retrieval 15 May 2023 · 0 repositories · arXiv:2305.09025
-
Improving Defensive Distillation using Teacher Assistant 14 May 2023 · 0 repositories · arXiv:2305.08076
-
On enhancing the robustness of Vision Transformers: Defensive Diffusion 14 May 2023 · 1 repository · arXiv:2305.08031
-
Black-box Source-free Domain Adaptation via Two-stage Knowledge Distillation 13 May 2023 · 0 repositories · arXiv:2305.07881
-
GSB: Group Superposition Binarization for Vision Transformer with Limited Training Samples 13 May 2023 · 1 repository · arXiv:2305.07931
-
A Lightweight Domain Adversarial Neural Network Based on Knowledge Distillation for EEG-based Cross-subject Emotion Recognition 12 May 2023 · 0 repositories · arXiv:2305.07446
-
Knowledge distillation with Segment Anything (SAM) model for Planetary Geological Mapping 12 May 2023 · 0 repositories · arXiv:2305.07586
-
Improving Continual Relation Extraction by Distinguishing Analogous Semantics 11 May 2023 · 1 repository · arXiv:2305.06620Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
Long-Tailed Question Answering in an Open World 11 May 2023 · 1 repository · arXiv:2305.06557
-
Serial Contrastive Knowledge Distillation for Continual Few-shot Relation Extraction 11 May 2023 · 1 repository · arXiv:2305.06616
-
Explainable Knowledge Distillation for On-device Chest X-Ray Classification 10 May 2023 · 0 repositories · arXiv:2305.06244
-
DynamicKD: An Effective Knowledge Distillation via Dynamic Entropy Correction-Based Distillation for Gap Optimizing 9 May 2023 · 0 repositories · arXiv:2305.05233
-
FedNoRo: Towards Noise-Robust Federated Learning by Addressing Class Imbalance and Label Noise Heterogeneity 9 May 2023 · 3 repositories · arXiv:2305.05230Syntology official (archive's flag): 2 ran · 2 ran (of which 2 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified; every one of the 2 samples that ran constructed an object rather than computing a result (of 4 harvested samples) · 4 pointer-only (licence)
-
Multi-Teacher Knowledge Distillation For Text Image Machine Translation 9 May 2023 · 1 repository · arXiv:2305.05226
-
SRIL: Selective Regularization for Class-Incremental Learning 9 May 2023 · 0 repositories · arXiv:2305.05175
-
SUR-adapter: Enhancing Text-to-Image Pre-trained Diffusion Models with Large Language Models 9 May 2023 · 1 repository · arXiv:2305.05189Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)
-
Do Not Blindly Imitate the Teacher: Using Perturbed Loss for Knowledge Distillation 8 May 2023 · 0 repositories · arXiv:2305.05010
-
NeuroComparatives: Neuro-Symbolic Distillation of Comparative Knowledge 8 May 2023 · 1 repository · arXiv:2305.04978
-
Web Content Filtering through knowledge distillation of Large Language Models 8 May 2023 · 0 repositories · arXiv:2305.05027
-
Structural and Statistical Texture Knowledge Distillation for Semantic Segmentation 6 May 2023 · 0 repositories · arXiv:2305.03944
-
Distilled Mid-Fusion Transformer Networks for Multi-Modal Human Activity Recognition 5 May 2023 · 0 repositories · arXiv:2305.03810
-
Avatar Knowledge Distillation: Self-ensemble Teacher Paradigm with Uncertainty 4 May 2023 · 1 repository · arXiv:2305.02722
-
Smaller3d: Smaller Models for 3D Semantic Segmentation Using Minkowski Engine and Knowledge Distillation Methods 4 May 2023 · 1 repository · arXiv:2305.03188
-
A Systematic Study of Knowledge Distillation for Natural Language Generation with Pseudo-Target Training 3 May 2023 · 1 repository · arXiv:2305.02031Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 4 harvested samples)
-
SCOTT: Self-Consistent Chain-of-Thought Distillation 3 May 2023 · 1 repository · arXiv:2305.01879Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
DeepAqua: Self-Supervised Semantic Segmentation of Wetland Surface Water Extent with SAR Images using Knowledge Distillation 2 May 2023 · 1 repository · arXiv:2305.01698
-
Distill or Annotate? Cost-Efficient Fine-Tuning of Compact Models 2 May 2023 · 0 repositories · arXiv:2305.01645
-
Structure Aware Incremental Learning with Personalized Imitation Weights for Recommender Systems 2 May 2023 · 0 repositories · arXiv:2305.01204
-
Scaffolding a Student to Instill Knowledge 1 May 2023 · 1 repository
-
Ensemble Modeling with Contrastive Knowledge Distillation for Sequential Recommendation 28 Apr 2023 · 1 repository · arXiv:2304.14668
-
Multi-to-Single Knowledge Distillation for Point Cloud Semantic Segmentation 28 Apr 2023 · 1 repository · arXiv:2304.14800
-
Learning Human-Human Interactions in Images from Weak Textual Supervision 27 Apr 2023 · 0 repositories · arXiv:2304.14104
-
A Symmetric Dual Encoding Dense Retrieval Framework for Knowledge-Intensive Visual Question Answering 26 Apr 2023 · 1 repository · arXiv:2304.13649
-
Class Attention Transfer Based Knowledge Distillation 25 Apr 2023 · 1 repository · arXiv:2304.12777Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified (of 4 harvested samples) · 4 pointer-only (licence)
-
A Forward and Backward Compatible Framework for Few-shot Class-incremental Pill Recognition 24 Apr 2023 · 1 repository · arXiv:2304.11959
-
Improving Knowledge Distillation via Transferring Learning Ability 24 Apr 2023 · 1 repository · arXiv:2304.11923
-
Interruption-Aware Cooperative Perception for V2X Communication-Aided Autonomous Driving 24 Apr 2023 · 0 repositories · arXiv:2304.11821
-
Knowledge Distillation from 3D to Bird's-Eye-View for LiDAR Semantic Segmentation 22 Apr 2023 · 1 repository · arXiv:2304.11393
-
Decouple Non-parametric Knowledge Distillation For End-to-end Speech Translation 20 Apr 2023 · 0 repositories · arXiv:2304.10295
-
An Empirical Study of Leveraging Knowledge Distillation for Compressing Multilingual Neural Machine Translation Models 19 Apr 2023 · 1 repository · arXiv:2304.09388
-
Attention Weighted Local Descriptors 19 Apr 2023 · 1 repository
-
Biologically inspired structure learning with reverse knowledge distillation for spiking neural networks 19 Apr 2023 · 0 repositories · arXiv:2304.09500
-
Knowledge Distillation Under Ideal Joint Classifier Assumption 19 Apr 2023 · 0 repositories · arXiv:2304.11004