Browse State-of-the-Art › Knowledge Distillation › Papers, page 30

Knowledge Distillation

Papers archive 2025-07-28

archive papers tagged: 4,240 · with a code link: 1,740 · where Syntology ran a sample: 451 (380 with a run with no instrument failure, 71 where every run was a failure of Syntology's instrument) Syntology

Show: all tagged papersonly where code ran (451 of 4,240 tagged: 380 with a run with no instrument failure, 71 where every run was a failure of Syntology's instrument)

Page 30 of 43: papers 2,901 to 3,000 of 4,240, in archive order: by repositories listed in the archive (most first), then newest first, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers that list no repository come after every paper that lists one.

Papers without a page here are shown as plain text. A Syntology line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the figure “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code); hover it for the repositories the samples that ran came from. Abstracts are on each paper's page.

• Knowledge Distillation for Neural Transducer-based Target-Speaker ASR: Exploiting Parallel Mixture/Single-Talker Speech Data
  25 May 2023 0 repositories listed
• On the Impact of Knowledge Distillation for Model Interpretability
  25 May 2023 0 repositories listed
• Triplet Knowledge Distillation
  25 May 2023 0 repositories listed
• AdvFunMatch: When Consistent Teaching Meets Adversarial Robustness
  24 May 2023 0 repositories listed
• HARD: Hard Augmentations for Robust Distillation
  24 May 2023 0 repositories listed
• Incorporating Ultrasound Tongue Images for Audio-Visual Speech Enhancement through Knowledge Distillation
  24 May 2023 0 repositories listed
• Just CHOP: Embarrassingly Simple LLM Compression
  24 May 2023 0 repositories listed
• Deakin RF-Sensing: Experiments on Correlated Knowledge Distillation for Monitoring Human Postures with Radios
  24 May 2023 0 repositories listed
• One-stop Training of Multiple Capacity Models
  23 May 2023 0 repositories listed
• Sequence-Level Knowledge Distillation for Class-Incremental End-to-End Spoken Language Understanding
  23 May 2023 0 repositories listed
• Transferring Learning Trajectories of Neural Networks
  23 May 2023 0 repositories listed
• EnSiam: Self-Supervised Learning With Ensemble Representations
  22 May 2023 0 repositories listed
• Distilling Robustness into Natural Language Inference Models with Domain-Targeted Augmentation
  22 May 2023 0 repositories listed
• Revisiting Data Augmentation in Model Compression: An Empirical and Comprehensive Study
  22 May 2023 0 repositories listed
• DualVC: Dual-mode Voice Conversion using Intra-model Knowledge Distillation and Hybrid Predictive Coding
  21 May 2023 0 repositories listed
• One-Shot Federated Learning for LEO Constellations that Reduces Convergence Time from Days to 90 Minutes
  21 May 2023 0 repositories listed
• Understanding the Effect of Data Augmentation on Knowledge Distillation
  21 May 2023 0 repositories listed
• Accurate Knowledge Distillation with n-best Reranking
  20 May 2023 0 repositories listed
• Pseudo-Label Training and Model Inertia in Neural Machine Translation
  19 May 2023 0 repositories listed
• BERM: Training the Balanced and Extractable Representation for Matching to Improve Generalization Ability of Dense Retrieval
  18 May 2023 0 repositories listed
• Boost Vision Transformer with GPU-Friendly Sparsity and Quantization
  18 May 2023 0 repositories listed
• Student-friendly Knowledge Distillation
  18 May 2023 0 repositories listed
• DQ-Whisper: Joint Distillation and Quantization for Efficient Multilingual Speech Recognition
  18 May 2023 0 repositories listed
• When Gradient Descent Meets Derivative-Free Optimization: A Match Made in Black-Box Scenario
  17 May 2023 0 repositories listed
• Distilling Knowledge for Short-to-Long Term Trajectory Prediction
  15 May 2023 0 repositories listed
• Soft Prompt Decoding for Multilingual Dense Retrieval
  15 May 2023 0 repositories listed
• Analyzing Compression Techniques for Computer Vision
  14 May 2023 0 repositories listed
• Improving Defensive Distillation using Teacher Assistant
  14 May 2023 0 repositories listed
• AMTSS: An Adaptive Multi-Teacher Single-Student Knowledge Distillation Framework For Multilingual Language Inference
  13 May 2023 0 repositories listed
• Black-box Source-free Domain Adaptation via Two-stage Knowledge Distillation
  13 May 2023 0 repositories listed
• A Lightweight Domain Adversarial Neural Network Based on Knowledge Distillation for EEG-based Cross-subject Emotion Recognition
  12 May 2023 0 repositories listed
• Knowledge distillation with Segment Anything (SAM) model for Planetary Geological Mapping
  12 May 2023 0 repositories listed
• Explainable Knowledge Distillation for On-device Chest X-Ray Classification
  10 May 2023 0 repositories listed
• DynamicKD: An Effective Knowledge Distillation via Dynamic Entropy Correction-Based Distillation for Gap Optimizing
  9 May 2023 0 repositories listed
• SRIL: Selective Regularization for Class-Incremental Learning
  9 May 2023 0 repositories listed
• Do Not Blindly Imitate the Teacher: Using Perturbed Loss for Knowledge Distillation
  8 May 2023 0 repositories listed
• Web Content Filtering through knowledge distillation of Large Language Models
  8 May 2023 0 repositories listed
• Structural and Statistical Texture Knowledge Distillation for Semantic Segmentation
  6 May 2023 0 repositories listed
• Distilled Mid-Fusion Transformer Networks for Multi-Modal Human Activity Recognition
  5 May 2023 0 repositories listed
• Distill or Annotate? Cost-Efficient Fine-Tuning of Compact Models
  2 May 2023 0 repositories listed
• Structure Aware Incremental Learning with Personalized Imitation Weights for Recommender Systems
  2 May 2023 0 repositories listed
• CORSD: Class-Oriented Relational Self Distillation
  28 Apr 2023 0 repositories listed
• Learning Human-Human Interactions in Images from Weak Textual Supervision
  27 Apr 2023 0 repositories listed
• Shape-Net: Room Layout Estimation from Panoramic Images Robust to Occlusion using Knowledge Distillation with 3D Shapes as Additional Inputs
  25 Apr 2023 0 repositories listed
• Interruption-Aware Cooperative Perception for V2X Communication-Aided Autonomous Driving
  24 Apr 2023 0 repositories listed
• Decouple Non-parametric Knowledge Distillation For End-to-end Speech Translation
  20 Apr 2023 0 repositories listed
• Word Sense Induction with Knowledge Distillation from BERT
  20 Apr 2023 0 repositories listed
• Biologically inspired structure learning with reverse knowledge distillation for spiking neural networks
  19 Apr 2023 0 repositories listed
• Knowledge Distillation Under Ideal Joint Classifier Assumption
  19 Apr 2023 0 repositories listed
• Deep Collective Knowledge Distillation
  18 Apr 2023 0 repositories listed
• Always Strengthen Your Strengths: A Drift-Aware Incremental Learning Framework for CTR Prediction
  17 Apr 2023 0 repositories listed
• LaSNN: Layer-wise ANN-to-SNN Distillation for Effective and Efficient Training in Deep Spiking Neural Networks
  17 Apr 2023 0 repositories listed
• Class-Incremental Learning of Plant and Disease Detection: Growing Branches with Knowledge Distillation
  13 Apr 2023 0 repositories listed
• Constructing Deep Spiking Neural Networks from Artificial Neural Networks with Knowledge Distillation
  12 Apr 2023 0 repositories listed
• A Survey on Recent Teacher-student Learning Studies
  10 Apr 2023 0 repositories listed
• Grouped Knowledge Distillation for Deep Face Recognition
  10 Apr 2023 0 repositories listed
• A Comprehensive Survey on Knowledge Distillation of Diffusion Models
  9 Apr 2023 0 repositories listed
• Homogenizing Non-IID datasets via In-Distribution Knowledge Distillation for Decentralized Learning
  9 Apr 2023 0 repositories listed
• HyperINR: A Fast and Predictive Hypernetwork for Implicit Neural Representations via Knowledge Distillation
  9 Apr 2023 0 repositories listed
• Model-Agnostic Decentralized Collaborative Learning for On-Device POI Recommendation
  8 Apr 2023 0 repositories listed
• Continual Detection Transformer for Incremental Object Detection
  6 Apr 2023 0 repositories listed
• Towards Efficient Task-Driven Model Reprogramming with Foundation Models
  5 Apr 2023 0 repositories listed
• Cross-Class Feature Augmentation for Class Incremental Learning
  4 Apr 2023 0 repositories listed
• MadEye: Boosting Live Video Analytics Accuracy with Adaptive Camera Configurations
  4 Apr 2023 0 repositories listed
• Knowledge-Distilled Graph Neural Networks for Personalized Epileptic Seizure Detection
  3 Apr 2023 0 repositories listed
• A Unified Compression Framework for Efficient Speech-Driven Talking-Face Generation
  2 Apr 2023 0 repositories listed
• GVP: Generative Volumetric Primitives
  31 Mar 2023 0 repositories listed
• Quick Dense Retrievers Consume KALE: Post Training Kullback Leibler Alignment of Embeddings for Asymmetrical dual encoders
  31 Mar 2023 0 repositories listed
• Selective Knowledge Distillation for Non-Autoregressive Neural Machine Translation
  31 Mar 2023 0 repositories listed
• Asymmetric Image Retrieval with Cross Model Compatible Ensembles
  30 Mar 2023 0 repositories listed
• If At First You Don't Succeed: Test Time Re-ranking for Zero-shot, Cross-domain Retrieval
  30 Mar 2023 0 repositories listed
• KD-DLGAN: Data Limited Image Generation via Knowledge Distillation
  30 Mar 2023 0 repositories listed
• oBERTa: Improving Sparse Transfer Learning via improved initialization, distillation, and pruning regimes
  30 Mar 2023 0 repositories listed
• Information-Theoretic GAN Compression with Variational Energy-based Model
  28 Mar 2023 0 repositories listed
• Empowering Dual-Encoder with Query Generator for Cross-Lingual Dense Retrieval
  27 Mar 2023 0 repositories listed
• Mutually-paced Knowledge Distillation for Cross-lingual Temporal Knowledge Graph Reasoning
  27 Mar 2023 0 repositories listed
• Multi-Frame Self-Supervised Depth Estimation with Multi-Scale Feature Fusion in Dynamic Scenes
  26 Mar 2023 0 repositories listed
• Multi-view knowledge distillation transformer for human action recognition
  25 Mar 2023 0 repositories listed
• Task-Attentive Transformer Architecture for Continual Learning of Vision-and-Language Tasks Using Knowledge Distillation
  25 Mar 2023 0 repositories listed
• DyLiN: Making Light Field Networks Dynamic
  24 Mar 2023 0 repositories listed
• Edge-free but Structure-aware: Prototype-Guided Knowledge Distillation from GNNs to MLPs
  24 Mar 2023 0 repositories listed
• Exploiting Unlabelled Photos for Stronger Fine-Grained SBIR
  24 Mar 2023 0 repositories listed
• Mixed-Type Wafer Classification For Low Memory Devices Using Knowledge Distillation
  24 Mar 2023 0 repositories listed
• A Simple and Generic Framework for Feature Distillation via Channel-wise Transformation
  23 Mar 2023 0 repositories listed
• Open-Vocabulary Object Detection using Pseudo Caption Labels
  23 Mar 2023 0 repositories listed
• From Wide to Deep: Dimension Lifting Network for Parameter-efficient Knowledge Graph Embedding
  22 Mar 2023 0 repositories listed
• Heterogeneous-Branch Collaborative Learning for Dialogue Generation
  21 Mar 2023 0 repositories listed
• Out of Thin Air: Exploring Data-Free Adversarial Robustness Distillation
  21 Mar 2023 0 repositories listed
• Knowledge Distillation from Multiple Foundation Models for End-to-End Speech Recognition
  20 Mar 2023 0 repositories listed
• More From Less: Self-Supervised Knowledge Distillation for Routine Histopathology Data
  19 Mar 2023 0 repositories listed
• Confidence Attention and Generalization Enhanced Distillation for Continuous Video Domain Adaptation
  18 Mar 2023 0 repositories listed
• Crowd Counting with Online Knowledge Learning
  18 Mar 2023 0 repositories listed
• DC-CCL: Device-Cloud Collaborative Controlled Learning for Large Vision Models
  18 Mar 2023 0 repositories listed
• DistillW2V2: A Small and Streaming Wav2vec 2.0 Based ASR Model
  16 Mar 2023 0 repositories listed
• Knowledge Distillation for Adaptive MRI Prostate Segmentation Based on Limit-Trained Multi-Teacher Models
  16 Mar 2023 0 repositories listed
• Neural Architecture Search for Effective Teacher-Student Knowledge Transfer in Language Models
  16 Mar 2023 0 repositories listed
• Towards a Smaller Student: Capacity Dynamic Distillation for Efficient Image Retrieval
  16 Mar 2023 0 repositories listed
• Cross-resolution Face Recognition via Identity-Preserving Network and Knowledge Distillation
  15 Mar 2023 0 repositories listed
• Feature-Rich Audio Model Inversion for Data-Free Knowledge Distillation Towards General Sound Classification
  14 Mar 2023 0 repositories listed
• MetaMixer: A Regularization Strategy for Online Knowledge Distillation
  14 Mar 2023 0 repositories listed