Browse State-of-the-Art › Knowledge Distillation › Papers, page 41

Knowledge Distillation

Papers archive 2025-07-28

archive papers tagged: 4,240 · with a code link: 1,740 · where Syntology ran a sample: 451 (380 with a run with no instrument failure, 71 where every run was a failure of Syntology's instrument) Syntology

Show: all tagged papersonly where code ran (451 of 4,240 tagged: 380 with a run with no instrument failure, 71 where every run was a failure of Syntology's instrument)

Page 41 of 43: papers 4,001 to 4,100 of 4,240, in archive order: by repositories listed in the archive (most first), then newest first, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers that list no repository come after every paper that lists one.

Papers without a page here are shown as plain text. A Syntology line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the figure “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code); hover it for the repositories the samples that ran came from. Abstracts are on each paper's page.

• Improving Autoregressive NMT with Non-Autoregressive Model
  1 Jul 2020 0 repositories listed
• SimulSpeech: End-to-End Simultaneous Speech to Text Translation
  1 Jul 2020 0 repositories listed
• Xiaomi's Submissions for IWSLT 2020 Open Domain Translation Task
  1 Jul 2020 0 repositories listed
• Extracurricular Learning: Knowledge Transfer Beyond Empirical Distribution
  30 Jun 2020 0 repositories listed
• On the Demystification of Knowledge Distillation: A Residual Network Perspective
  30 Jun 2020 0 repositories listed
• Motion Pyramid Networks for Accurate and Efficient Cardiac Motion Estimation
  28 Jun 2020 0 repositories listed
• Diverse Knowledge Distillation (DKD): A Solution for Improving The Robustness of Ensemble Models Against Adversarial Attacks
  26 Jun 2020 0 repositories listed
• Streaming Transformer ASR with Blockwise Synchronous Inference
  25 Jun 2020 0 repositories listed
• Distilling Object Detectors with Task Adaptive Regularization
  23 Jun 2020 0 repositories listed
• Prior knowledge distillation based on financial time series
  16 Jun 2020 0 repositories listed
• Pixel Invisibility: Detecting Objects Invisible in Color Images
  15 Jun 2020 0 repositories listed
• Knowledge Distillation: A Survey
  9 Jun 2020 0 repositories listed
• ResKD: Residual-Guided Knowledge Distillation
  8 Jun 2020 0 repositories listed
• ADMP: An Adversarial Double Masks Based Pruning Framework For Unsupervised Cross-Domain Compression
  7 Jun 2020 0 repositories listed
• An Empirical Analysis of the Impact of Data Augmentation on Knowledge Distillation
  6 Jun 2020 0 repositories listed
• An Overview of Neural Network Compression
  5 Jun 2020 0 repositories listed
• End-to-End Speech-Translation with Knowledge Distillation: FBK@IWSLT2020
  4 Jun 2020 0 repositories listed
• ADINet: Attribute Driven Incremental Network for Retinal Image Classification
  1 Jun 2020 0 repositories listed
• Apprentissage automatique de représentation de voix à l'aide d'une distillation de la connaissance pour le casting vocal (Learning voice representation using knowledge distillation for automatic voice casting )
  1 Jun 2020 0 repositories listed
• Weight Squeezing: Reparameterization for Compression and Fast Inference
  30 May 2020 0 repositories listed
• Sub-Band Knowledge Distillation Framework for Speech Enhancement
  29 May 2020 0 repositories listed
• Syntactic Structure Distillation Pretraining For Bidirectional Encoders
  27 May 2020 0 repositories listed
• Why distillation helps: a statistical perspective
  21 May 2020 0 repositories listed
• Learning from a Lightweight Teacher for Efficient Knowledge Distillation
  19 May 2020 0 repositories listed
• Incremental Learning for End-to-End Automatic Speech Recognition
  11 May 2020 0 repositories listed
• Distilling Knowledge from Pre-trained Language Models via Text Smoothing
  8 May 2020 0 repositories listed
• Improving Non-autoregressive Neural Machine Translation with Monolingual Data
  2 May 2020 0 repositories listed
• Distilling Spikes: Knowledge Distillation in Spiking Neural Networks
  1 May 2020 0 repositories listed
• General Purpose Text Embeddings from Pre-trained Language Models for Scalable Inference
  29 Apr 2020 0 repositories listed
• LightPAFF: A Two-Stage Distillation Framework for Pre-training and Fine-tuning
  27 Apr 2020 0 repositories listed
• A Study of Non-autoregressive Model for Sequence Generation
  22 Apr 2020 0 repositories listed
• Knowledge Distillation for Multilingual Unsupervised Neural Machine Translation
  21 Apr 2020 0 repositories listed
• Knowledge Distillation for Action Anticipation via Label Smoothing
  16 Apr 2020 0 repositories listed
• Building a Multi-domain Neural Machine Translation Model using Knowledge Distillation
  15 Apr 2020 0 repositories listed
• Smart Inference for Multidigit Convolutional Neural Network based Barcode Decoding
  14 Apr 2020 0 repositories listed
• Towards Robust Classification with Image Quality Assessment
  14 Apr 2020 0 repositories listed
• XtremeDistil: Multi-stage Distillation for Massive Multilingual Models
  12 Apr 2020 0 repositories listed
• Knowledge Distillation for Mobile Edge Computation Offloading
  9 Apr 2020 0 repositories listed
• LadaBERT: Lightweight Adaptation of BERT through Hybrid Model Compression
  8 Apr 2020 0 repositories listed
• Towards Non-task-specific Distillation of BERT via Sentence Representation Approximation
  7 Apr 2020 0 repositories listed
• Enhancing Review Comprehension with Domain-Specific Commonsense
  6 Apr 2020 0 repositories listed
• Knowledge as Priors: Cross-Modal Knowledge Generalization for Datasets without Superior Knowledge
  1 Apr 2020 0 repositories listed
• SS-IL: Separated Softmax for Incremental Learning
  31 Mar 2020 0 repositories listed
• Spatio-Temporal Graph for Video Captioning with Knowledge Distillation
  31 Mar 2020 0 repositories listed
• Analysis of Knowledge Transfer in Kernel Regime
  30 Mar 2020 0 repositories listed
• A Survey of Methods for Low-Power Deep Learning and Computer Vision
  24 Mar 2020 0 repositories listed
• Synergic Adversarial Label Learning for Grading Retinal Diseases via Knowledge Distillation and Multi-task Learning
  24 Mar 2020 0 repositories listed
• Teacher-Student chain for efficient semi-supervised histology image classification
  17 Mar 2020 0 repositories listed
• Knowledge distillation via adaptive instance normalization
  9 Mar 2020 0 repositories listed
• Pacemaker: Intermediate Teacher Knowledge Distillation For On-The-Fly Convolutional Neural Network
  9 Mar 2020 0 repositories listed
• Distilling portable Generative Adversarial Networks for Image Translation
  7 Mar 2020 0 repositories listed
• Explaining Knowledge Distillation by Quantifying the Knowledge
  7 Mar 2020 0 repositories listed
• Distill, Adapt, Distill: Training Small, In-Domain Models for Neural Machine Translation
  5 Mar 2020 0 repositories listed
• An Efficient Method of Training Small Models for Regression Problems with Knowledge Distillation
  28 Feb 2020 0 repositories listed
• Residual Knowledge Distillation
  21 Feb 2020 0 repositories listed
• Balancing Cost and Benefit with Tied-Multi Transformers
  20 Feb 2020 0 repositories listed
• Self-Distillation Amplifies Regularization in Hilbert Space
  13 Feb 2020 0 repositories listed
• Meta-Learning across Meta-Tasks for Few-Shot Learning
  11 Feb 2020 0 repositories listed
• Regularized Evolutionary Population-Based Training
  11 Feb 2020 0 repositories listed
• Understanding and Improving Knowledge Distillation
  10 Feb 2020 0 repositories listed
• Unlabeled Data Deployment for Classification of Diabetic Retinopathy Images Using Knowledge Transfer
  9 Feb 2020 0 repositories listed
• Feature-map-level Online Adversarial Knowledge Distillation
  5 Feb 2020 0 repositories listed
• Search for Better Students to Learn Distilled Knowledge
  30 Jan 2020 0 repositories listed
• Developing Multi-Task Recommendations with Long-Term Rewards via Policy Distilled Reinforcement Learning
  27 Jan 2020 0 repositories listed
• Generation-Distillation for Efficient Natural Language Understanding in Low-Data Settings
  25 Jan 2020 0 repositories listed
• Data Techniques For Online End-to-end Speech Recognition
  24 Jan 2020 0 repositories listed
• A "Network Pruning Network" Approach to Deep Model Compression
  15 Jan 2020 0 repositories listed
• Lightweight 3D Human Pose Estimation Network Training Using Teacher-Student Learning
  15 Jan 2020 0 repositories listed
• Uncertainty-Aware Multi-Shot Knowledge Distillation for Image-Based Object Re-Identification
  15 Jan 2020 0 repositories listed
• Noisy Machines: Understanding Noisy Neural Networks and Enhancing Robustness to Analog Hardware Errors Using Distillation
  14 Jan 2020 0 repositories listed
• Learning Task-Agnostic Embedding of Multiple Black-Box Experts for Multi-Task Model Fusion
  1 Jan 2020 0 repositories listed
• Modeling Teacher-Student Techniques in Deep Neural Networks for Knowledge Distillation
  31 Dec 2019 0 repositories listed
• DeGAN : Data-Enriching GAN for Retrieving Representative Samples from a Trained Classifier
  27 Dec 2019 0 repositories listed
• Joint Architecture and Knowledge Distillation in CNN for Chinese Text Recognition
  17 Dec 2019 0 repositories listed
• Iterative Dual Domain Adaptation for Neural Machine Translation
  16 Dec 2019 0 repositories listed
• Explaining Sequence-Level Knowledge Distillation as Data-Augmentation for Neural Machine Translation
  6 Dec 2019 0 repositories listed
• Acquiring Knowledge from Pre-trained Model to Neural Machine Translation
  4 Dec 2019 0 repositories listed
• Efficient Convolutional Neural Networks for Depth-Based Multi-Person Pose Estimation
  2 Dec 2019 0 repositories listed
• Towards Oracle Knowledge Distillation with Neural Architecture Search
  29 Nov 2019 0 repositories listed
• Data-Driven Compression of Convolutional Neural Networks
  28 Nov 2019 0 repositories listed
• QKD: Quantization-aware Knowledge Distillation
  28 Nov 2019 0 repositories listed
• Search to Distill: Pearls are Everywhere but not the Eyes
  20 Nov 2019 0 repositories listed
• Towards Making Deep Transfer Learning Never Hurt
  18 Nov 2019 0 repositories listed
• Collaborative Distillation for Top-N Recommendation
  13 Nov 2019 0 repositories listed
• Knowledge Representing: Efficient, Sparse Representation of Prior Knowledge for Knowledge Distillation
  13 Nov 2019 0 repositories listed
• Graph Representation Learning via Multi-task Knowledge Distillation
  11 Nov 2019 0 repositories listed
• Knowledge Distillation in Document Retrieval
  11 Nov 2019 0 repositories listed
• MKD: a Multi-Task Knowledge Distillation Approach for Pretrained Language Models
  9 Nov 2019 0 repositories listed
• Knowledge Distillation for Incremental Learning in Semantic Segmentation
  8 Nov 2019 0 repositories listed
• Microsoft Research Asia's Systems for WMT19
  7 Nov 2019 0 repositories listed
• Teacher-Student Training for Robust Tacotron-based TTS
  7 Nov 2019 0 repositories listed
• Understanding Knowledge Distillation in Non-autoregressive Machine Translation
  7 Nov 2019 0 repositories listed
• ESPnet How2 Speech Translation System for IWSLT 2019: Pre-training, Knowledge Distillation, and Going Deeper
  1 Nov 2019 0 repositories listed
• Weakly Supervised Cross-lingual Semantic Relation Classification via Knowledge Distillation
  1 Nov 2019 0 repositories listed
• Distilling Pixel-Wise Feature Similarities for Semantic Segmentation
  31 Oct 2019 0 repositories listed
• A Simple but Effective BERT Model for Dialog State Tracking on Resource-Limited Systems
  28 Oct 2019 0 repositories listed
• Variational Student: Learning Compact and Sparser Networks in Knowledge Distillation Framework
  26 Oct 2019 0 repositories listed
• Secost: Sequential co-supervision for large scale weakly labeled audio event detection
  25 Oct 2019 0 repositories listed
• Adversarial Feature Alignment: Avoid Catastrophic Forgetting in Incremental Task Lifelong Learning
  24 Oct 2019 0 repositories listed
• An Empirical Study of Efficient ASR Rescoring with Transformers
  24 Oct 2019 0 repositories listed