Browse State-of-the-Art › Knowledge Distillation › Papers, page 43

Knowledge Distillation

Papers archive 2025-07-28

archive papers tagged: 4,240 · with a code link: 1,740 · where Syntology ran a sample: 451 (380 with a run with no instrument failure, 71 where every run was a failure of Syntology's instrument) Syntology

Show: all tagged papersonly where code ran (451 of 4,240 tagged: 380 with a run with no instrument failure, 71 where every run was a failure of Syntology's instrument)

Page 43 of 43: papers 4,201 to 4,240 of 4,240, in archive order: by repositories listed in the archive (most first), then newest first, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers that list no repository come after every paper that lists one.

Papers without a page here are shown as plain text. A Syntology line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the figure “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code); hover it for the repositories the samples that ran came from. Abstracts are on each paper's page.

• Knowledge Distillation from Few Samples
  27 Sep 2018 0 repositories listed
• Label Denoising with Large Ensembles of Heterogeneous Neural Networks
  12 Sep 2018 0 repositories listed
• MotherNets: Rapid Deep Ensemble Learning
  12 Sep 2018 0 repositories listed
• Lifelong Learning via Progressive Distillation and Retrospection
  1 Sep 2018 0 repositories listed
• Attention-Guided Answer Distillation for Machine Reading Comprehension
  23 Aug 2018 0 repositories listed
• Whole-Slide Mitosis Detection in H&E Breast Histology Using PHH3 as a Reference to Train Distilled Stain-Invariant Convolutional Networks
  17 Aug 2018 0 repositories listed
• Cooperative Denoising for Distantly Supervised Relation Extraction
  1 Aug 2018 0 repositories listed
• Gradient Adversarial Training of Neural Networks
  21 Jun 2018 0 repositories listed
• Coupled End-to-End Transfer Learning With Generalized Fisher Information
  1 Jun 2018 0 repositories listed
• Collaborative Learning for Deep Neural Networks
  30 May 2018 0 repositories listed
• A novel channel pruning method for deep neural network compression
  29 May 2018 0 repositories listed
• Visual Relationship Detection Based on Guided Proposals and Semantic Knowledge Distillation
  28 May 2018 0 repositories listed
• Recurrent knowledge distillation
  18 May 2018 0 repositories listed
• Knowledge Distillation in Generations: More Tolerant Teachers Educate Better Students
  15 May 2018 0 repositories listed
• Neural Compatibility Modeling with Attentive Knowledge Distillation
  17 Apr 2018 0 repositories listed
• Few-shot learning of neural networks from scratch by pseudo example optimization
  8 Feb 2018 0 repositories listed
• Model compression for faster structural separation of macromolecules captured by Cellular Electron Cryo-Tomography
  31 Jan 2018 0 repositories listed
• Deep Net Triage: Analyzing the Importance of Network Layers via Structural Compression
  15 Jan 2018 0 repositories listed
• Generation and Consolidation of Recollections for Efficient Deep Lifelong Learning
  1 Jan 2018 0 repositories listed
• NestedNet: Learning Nested Sparse Structures in Deep Neural Networks
  11 Dec 2017 0 repositories listed
• Learning Efficient Object Detection Models with Knowledge Distillation
  1 Dec 2017 0 repositories listed
• Knowledge Concentration: Learning 100K Object Classifiers in a Single CNN
  21 Nov 2017 0 repositories listed
• Apprentice: Using Knowledge Distillation Techniques To Improve Low-Precision Network Accuracy
  15 Nov 2017 0 repositories listed
• A Survey of Model Compression and Acceleration for Deep Neural Networks
  23 Oct 2017 0 repositories listed
• Model Distillation with Knowledge Transfer from Face Classification to Alignment and Verification
  9 Sep 2017 0 repositories listed
• Training Shallow and Thin Networks for Acceleration via Knowledge Distillation with Conditional Adversarial Networks
  2 Sep 2017 0 repositories listed
• A Joint Sequential and Relational Model for Frame-Semantic Parsing
  1 Sep 2017 0 repositories listed
• Knowledge Distillation for Bilingual Dictionary Induction
  1 Sep 2017 0 repositories listed
• Visual Relationship Detection with Internal and External Linguistic Knowledge Distillation
  28 Jul 2017 0 repositories listed
• WebChild 2.0 : Fine-Grained Commonsense Knowledge Distillation
  1 Jul 2017 0 repositories listed
• TIP: Typifying the Interpretability of Procedures
  9 Jun 2017 0 repositories listed
• Knowledge distillation using unlabeled mismatched images
  21 Mar 2017 0 repositories listed
• Knowledge Adaptation: Teaching to Adapt
  7 Feb 2017 0 repositories listed
• Ensemble Distillation for Neural Machine Translation
  6 Feb 2017 0 repositories listed
• Neural Machine Translation from Simplified Translations
  19 Dec 2016 0 repositories listed
• In Teacher We Trust: Learning Compressed Models for Pedestrian Detection
  1 Dec 2016 0 repositories listed
• A scalable convolutional neural network for task-specified scenarios via knowledge distillation
  19 Sep 2016 0 repositories listed
• Knowledge Distillation for Small-footprint Highway Networks
  2 Aug 2016 0 repositories listed
• Adapting Models to Signal Degradation using Distillation
  1 Apr 2016 0 repositories listed
• Distilling Knowledge from Deep Networks with Applications to Healthcare Domain
  11 Dec 2015 0 repositories listed