Browse State-of-the-Art › Knowledge Distillation › Papers, page 42

Knowledge Distillation

Papers archive 2025-07-28

archive papers tagged: 4,240 · with a code link: 1,740 · where Syntology ran a sample: 451 (380 with a run with no instrument failure, 71 where every run was a failure of Syntology's instrument) Syntology

Show: all tagged papersonly where code ran (451 of 4,240 tagged: 380 with a run with no instrument failure, 71 where every run was a failure of Syntology's instrument)

Page 42 of 43: papers 4,101 to 4,200 of 4,240, in archive order: by repositories listed in the archive (most first), then newest first, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers that list no repository come after every paper that lists one.

Papers without a page here are shown as plain text. A Syntology line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the figure “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code); hover it for the repositories the samples that ran came from. Abstracts are on each paper's page.

• Model Compression with Two-stage Multi-teacher Knowledge Distillation for Web Question Answering System
  18 Oct 2019 0 repositories listed
• A Generalized and Robust Method Towards Practical Gaze Estimation on Smart Phone
  16 Oct 2019 0 repositories listed
• Noise as a Resource for Learning in Knowledge Distillation
  11 Oct 2019 0 repositories listed
• Cross-modal knowledge distillation for action recognition
  10 Oct 2019 0 repositories listed
• Knowledge Distillation from Internal Representations
  8 Oct 2019 0 repositories listed
• Distilling BERT into Simple Neural Networks with Unlabeled Transfer Data
  4 Oct 2019 0 repositories listed
• On the Efficacy of Knowledge Distillation
  3 Oct 2019 0 repositories listed
• AntMan: Sparse Low-Rank Compression to Accelerate RNN inference
  2 Oct 2019 0 repositories listed
• Improving Word Embedding Factorization for Compression Using Distilled Nonlinear Neural Decomposition
  2 Oct 2019 0 repositories listed
• A Bayesian Optimization Framework for Neural Network Compression
  1 Oct 2019 0 repositories listed
• Collaborative Inter-agent Knowledge Distillation for Reinforcement Learning
  25 Sep 2019 0 repositories listed
• Distilled embedding: non-linear embedding factorization using knowledge distillation
  25 Sep 2019 0 repositories listed
• Extremely Small BERT Models from Mixed-Vocabulary Training
  25 Sep 2019 0 repositories listed
• Proactive Sequence Generator via Knowledge Acquisition
  25 Sep 2019 0 repositories listed
• SELF-KNOWLEDGE DISTILLATION ADVERSARIAL ATTACK
  25 Sep 2019 0 repositories listed
• XD: Cross-lingual Knowledge Distillation for Polyglot Sentence Embeddings
  25 Sep 2019 0 repositories listed
• FEED: Feature-level Ensemble for Knowledge Distillation
  24 Sep 2019 0 repositories listed
• Technical report on Conversational Question Answering
  24 Sep 2019 0 repositories listed
• Learning Lightweight Pedestrian Detector with Hierarchical Knowledge Distillation
  20 Sep 2019 0 repositories listed
• Accelerating Transformer Decoding via a Hybrid of Self-attention and Recurrent Neural Network
  5 Sep 2019 0 repositories listed
• Knowledge distillation for optimization of quantized deep neural networks
  4 Sep 2019 0 repositories listed
• Online Sensor Hallucination via Knowledge Distillation for Multimodal Image Classification
  28 Aug 2019 0 repositories listed
• Adversarial-Based Knowledge Distillation for Multi-Model Ensemble and Noisy Data Refinement
  22 Aug 2019 0 repositories listed
• Language Graph Distillation for Low-Resource Machine Translation
  17 Aug 2019 0 repositories listed
• Knowledge distillation for semi-supervised domain adaptation
  16 Aug 2019 0 repositories listed
• Adaptive Regularization of Labels
  15 Aug 2019 0 repositories listed
• Effective Training of Convolutional Neural Networks with Low-bitwidth Weights and Activations
  10 Aug 2019 0 repositories listed
• Knowledge Consistency between Neural Networks and Beyond
  5 Aug 2019 0 repositories listed
• Self-Knowledge Distillation in Natural Language Processing
  2 Aug 2019 0 repositories listed
• Baidu Neural Machine Translation Systems for WMT19
  1 Aug 2019 0 repositories listed
• GTCOM Neural Machine Translation Systems for WMT19
  1 Aug 2019 0 repositories listed
• PANLP at MEDIQA 2019: Pre-trained Language Models, Transfer Learning and Knowledge Distillation
  1 Aug 2019 0 repositories listed
• The NiuTrans Machine Translation Systems for WMT19
  1 Aug 2019 0 repositories listed
• Distill-to-Label: Weakly Supervised Instance Labeling Using Knowledge Distillation
  26 Jul 2019 0 repositories listed
• Distilled Siamese Networks for Visual Tracking
  24 Jul 2019 0 repositories listed
• Lifelong GAN: Continual Learning for Conditional Image Generation
  23 Jul 2019 0 repositories listed
• Learn Spelling from Teachers: Transferring Knowledge from Language Models to Sequence-to-Sequence Speech Recognition
  13 Jul 2019 0 repositories listed
• Compression of Acoustic Event Detection Models With Quantized Distillation
  1 Jul 2019 0 repositories listed
• Reconstructing Perceived Images from Brain Activity by Visually-guided Cognitive Representation and Adversarial Learning
  27 Jun 2019 0 repositories listed
• Essence Knowledge Distillation for Speech Recognition
  26 Jun 2019 0 repositories listed
• GAN-Knowledge Distillation for one-stage Object Detection
  20 Jun 2019 0 repositories listed
• Membership Privacy for Machine Learning Models Through Knowledge Transfer
  15 Jun 2019 0 repositories listed
• Divide and Conquer: Leveraging Intermediate Feature Representations for Quantized Training of Neural Networks
  14 Jun 2019 0 repositories listed
• Scalable Syntax-Aware Language Models Using Knowledge Distillation
  14 Jun 2019 0 repositories listed
• Efficient Evaluation-Time Uncertainty Estimation by Improved Distillation
  12 Jun 2019 0 repositories listed
• Incremental Classifier Learning Based on PEDCC-Loss and Cosine Distance
  11 Jun 2019 0 repositories listed
• Private Deep Learning with Teacher Ensembles
  5 Jun 2019 0 repositories listed
• Deep Face Recognition Model Compression via Knowledge Transfer and Distillation
  3 Jun 2019 0 repositories listed
• On Knowledge distillation from complex networks for response prediction
  1 Jun 2019 0 repositories listed
• Online Distilling from Checkpoints for Neural Machine Translation
  1 Jun 2019 0 repositories listed
• Cross-Resolution Face Recognition via Prior-Aided Face Hallucination and Residual Knowledge Distillation
  26 May 2019 0 repositories listed
• Creating Lightweight Object Detectors with Model Compression for Deployment on Edge Devices
  6 May 2019 0 repositories listed
• FEED: Feature-level Ensemble Effect for knowledge Distillation
  1 May 2019 0 repositories listed
• Towards a better understanding of Vector Quantized Autoencoders
  1 May 2019 0 repositories listed
• Semi-supervised Acoustic Event Detection based on tri-training
  29 Apr 2019 0 repositories listed
• Segmenting the Future
  24 Apr 2019 0 repositories listed
• Model Compression with Multi-Task Knowledge Distillation for Web-scale Question Answering System
  21 Apr 2019 0 repositories listed
• End-to-End Speech Translation with Knowledge Distillation
  17 Apr 2019 0 repositories listed
• Guiding CTC Posterior Spike Timings for Improved Posterior Fusion and Knowledge Distillation
  17 Apr 2019 0 repositories listed
• Examining the Mapping Functions of Denoising Autoencoders in Singing Voice Separation
  12 Apr 2019 0 repositories listed
• Knowledge Squeezed Adversarial Network Compression
  10 Apr 2019 0 repositories listed
• Spatiotemporal Knowledge Distillation for Efficient Estimation of Aerial Video Saliency
  10 Apr 2019 0 repositories listed
• Knowledge Distillation for Human Action Anticipation
  9 Apr 2019 0 repositories listed
• Ultrafast Video Attention Prediction with Coupled Knowledge Distillation
  9 Apr 2019 0 repositories listed
• Knowledge Distillation For Recurrent Neural Network Language Modeling With Trust Regularization
  8 Apr 2019 0 repositories listed
• Long-Term Vehicle Localization by Recursive Knowledge Distillation
  7 Apr 2019 0 repositories listed
• Token-Level Ensemble Distillation for Grapheme-to-Phoneme Conversion
  6 Apr 2019 0 repositories listed
• M2KD: Multi-model and Multi-level Knowledge Distillation for Incremental Learning
  3 Apr 2019 0 repositories listed
• Making Neural Machine Reading Comprehension Faster
  29 Mar 2019 0 repositories listed
• Improving Route Choice Models by Incorporating Contextual Factors via Knowledge Distillation
  27 Mar 2019 0 repositories listed
• Rectified Decision Trees: Towards Interpretability, Compression and Empirical Soundness
  14 Mar 2019 0 repositories listed
• Refine and Distill: Exploiting Cycle-Inconsistency and Knowledge Distillation for Unsupervised Monocular Depth Estimation
  11 Mar 2019 0 repositories listed
• TKD: Temporal Knowledge Distillation for Active Perception
  4 Mar 2019 0 repositories listed
• MICIK: MIning Cross-Layer Inherent Similarity Knowledge for Deep Model Compression
  3 Feb 2019 0 repositories listed
• Compressing GANs using Knowledge Distillation
  1 Feb 2019 0 repositories listed
• Progressive Label Distillation: Learning Input-Efficient Deep Neural Networks
  26 Jan 2019 0 repositories listed
• Unsupervised Learning of Neural Networks to Explain Neural Networks (extended abstract)
  21 Jan 2019 0 repositories listed
• Stealing Neural Networks via Timing Side Channels
  31 Dec 2018 0 repositories listed
• Improving the Interpretability of Deep Neural Networks with Knowledge Distillation
  28 Dec 2018 0 repositories listed
• Learning Student Networks via Feature Embedding
  17 Dec 2018 0 repositories listed
• Spatial Knowledge Distillation to aid Visual Reasoning
  10 Dec 2018 0 repositories listed
• Optimizing speed/accuracy trade-off for person re-identification via knowledge distillation
  7 Dec 2018 0 repositories listed
• Accelerating Large Scale Knowledge Distillation via Dynamic Importance Sampling
  3 Dec 2018 0 repositories listed
• Knowledge Distillation with Feature Maps for Image Classification
  3 Dec 2018 0 repositories listed
• KDGAN: Knowledge Distillation with Generative Adversarial Networks
  1 Dec 2018 0 repositories listed
• Learning to Specialize with Knowledge Distillation for Visual Question Answering
  1 Dec 2018 0 repositories listed
• On Compressing U-net Using Knowledge Distillation
  1 Dec 2018 0 repositories listed
• ExpandNets: Linear Over-parameterization to Train Compact Convolutional Networks
  26 Nov 2018 0 repositories listed
• Low-resolution Face Recognition in the Wild via Selective Knowledge Distillation
  25 Nov 2018 0 repositories listed
• Structured Pruning of Neural Networks with Budget-Aware Regularization
  23 Nov 2018 0 repositories listed
• Graph-Adaptive Pruning for Efficient Inference of Convolutional Neural Networks
  21 Nov 2018 0 repositories listed
• Factorized Distillation: Training Holistic Person Re-identification Model by Distilling an Ensemble of Partial ReID Models
  20 Nov 2018 0 repositories listed
• Self-Referenced Deep Learning
  19 Nov 2018 0 repositories listed
• Private Model Compression via Knowledge Distillation
  13 Nov 2018 0 repositories listed
• Sequence-Level Knowledge Distillation for Model Compression of Attention-based Sequence-to-Sequence Speech Recognition
  12 Nov 2018 0 repositories listed
• A Closer Look at Deep Learning Heuristics: Learning rate restarts, Warmup and Distillation
  29 Oct 2018 0 repositories listed
• Block-wise Intermediate Representation Training for Model Compression
  20 Oct 2018 0 repositories listed
• KTAN: Knowledge Transfer Adversarial Network
  18 Oct 2018 0 repositories listed
• LIT: Block-wise Intermediate Representation Training for Model Compression
  2 Oct 2018 0 repositories listed
• Analyzing Knowledge Distillation in Neural Machine Translation
  1 Oct 2018 0 repositories listed