Methods › General › Knowledge Distillation › Knowledge Distillation › Papers, page 31

Knowledge Distillation

Papers archive 2025-07-28

archive papers tagged: 3,071 · with a code link: 1,258 · where Syntology ran a sample: 320 (276 with a run with no instrument failure, 44 where every run was a failure of Syntology's instrument) Syntology

Show: all tagged papersonly where code ran (320 of 3,071 tagged: 276 with a run with no instrument failure, 44 where every run was a failure of Syntology's instrument)

Page 31 of 31: papers 3,001 to 3,071 of 3,071, newest first by the archive's date (ties by slug), in archive order.

Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code, as “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. It is per sample and not a correctness claim. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from.

• Towards a better understanding of Vector Quantized Autoencoders
  1 May 2019 · 0 repositories
• Segmenting the Future
  24 Apr 2019 · 0 repositories · arXiv:1904.10666
• TextKD-GAN: Text Generation using KnowledgeDistillation and Generative Adversarial Networks
  23 Apr 2019 · 1 repository · arXiv:1905.01976
• Model Compression with Multi-Task Knowledge Distillation for Web-scale Question Answering System
  21 Apr 2019 · 0 repositories · arXiv:1904.09636
• Improving Multi-Task Deep Neural Networks via Knowledge Distillation for Natural Language Understanding
  20 Apr 2019 · 3 repositories · arXiv:1904.09482
• Knowledge Distillation via Route Constrained Optimization
  19 Apr 2019 · 1 repository · arXiv:1904.09149
• End-to-End Speech Translation with Knowledge Distillation
  17 Apr 2019 · 0 repositories · arXiv:1904.08075
• Guiding CTC Posterior Spike Timings for Improved Posterior Fusion and Knowledge Distillation
  17 Apr 2019 · 0 repositories · arXiv:1904.08311
• Visual Relationship Detection with Language prior and Softmax
  16 Apr 2019 · 1 repository · arXiv:1904.07798
• Automatic adaptation of object detectors to new domains using self-training
  15 Apr 2019 · 1 repository · arXiv:1904.07305
  Syntology 8 ran (of which 0 constructed an object rather than computing a result; 8 with no instrument failure: 0 honoured, 0 violated, 8 with no contract checked; 0 where Syntology's instrument failed) · 10 unverified (of 18 harvested samples)
• Improved training of binary networks for human pose estimation and image recognition
  11 Apr 2019 · 1 repository · arXiv:1904.05868
• Relational Knowledge Distillation
  10 Apr 2019 · 3 repositories · arXiv:1904.05068
  Syntology 2 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 3 harvested samples) · 1 pointer-only (licence)
• Knowledge Distillation for Human Action Anticipation
  9 Apr 2019 · 0 repositories · arXiv:1904.04868
• Ultrafast Video Attention Prediction with Coupled Knowledge Distillation
  9 Apr 2019 · 0 repositories · arXiv:1904.04449
• Knowledge Distillation For Recurrent Neural Network Language Modeling With Trust Regularization
  8 Apr 2019 · 0 repositories · arXiv:1904.04163
• Correlation Congruence for Knowledge Distillation
  3 Apr 2019 · 2 repositories · arXiv:1904.01802
• M2KD: Multi-model and Multi-level Knowledge Distillation for Incremental Learning
  3 Apr 2019 · 0 repositories · arXiv:1904.01769
• Making Neural Machine Reading Comprehension Faster
  29 Mar 2019 · 0 repositories · arXiv:1904.00796
• Improving Neural Architecture Search Image Classifiers via Ensemble Learning
  14 Mar 2019 · 1 repository · arXiv:1903.06236
• Rectified Decision Trees: Towards Interpretability, Compression and Empirical Soundness
  14 Mar 2019 · 0 repositories · arXiv:1903.05965
• Refine and Distill: Exploiting Cycle-Inconsistency and Knowledge Distillation for Unsupervised Monocular Depth Estimation
  11 Mar 2019 · 0 repositories · arXiv:1903.04202
• Structured Knowledge Distillation for Dense Prediction
  11 Mar 2019 · 1 repository · arXiv:1903.04197
  Syntology official (archive's flag): 5 ran · 5 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 1 honoured, 0 violated, 1 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified (of 5 harvested samples) · 2 pointer-only (licence)
• SeizureNet: Multi-Spectral Deep Feature Learning for Seizure Type Classification
  8 Mar 2019 · 3 repositories · arXiv:1903.03232
• Progressive Label Distillation: Learning Input-Efficient Deep Neural Networks
  26 Jan 2019 · 0 repositories · arXiv:1901.09135
• Unsupervised Learning of Neural Networks to Explain Neural Networks (extended abstract)
  21 Jan 2019 · 0 repositories · arXiv:1901.07538
• Stealing Neural Networks via Timing Side Channels
  31 Dec 2018 · 0 repositories · arXiv:1812.11720
• An Embarrassingly Simple Approach for Knowledge Distillation
  5 Dec 2018 · 1 repository · arXiv:1812.01819
  Syntology 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 3 honoured, 0 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples) · 3 pointer-only (licence)
• Few Sample Knowledge Distillation for Efficient Network Compression
  5 Dec 2018 · 1 repository · arXiv:1812.01839
• Accelerating Large Scale Knowledge Distillation via Dynamic Importance Sampling
  3 Dec 2018 · 0 repositories · arXiv:1812.00914
• Knowledge Distillation with Feature Maps for Image Classification
  3 Dec 2018 · 0 repositories · arXiv:1812.00660
• Learning to Specialize with Knowledge Distillation for Visual Question Answering
  1 Dec 2018 · 0 repositories
• On Compressing U-net Using Knowledge Distillation
  1 Dec 2018 · 0 repositories · arXiv:1812.00249
• ExpandNets: Linear Over-parameterization to Train Compact Convolutional Networks
  26 Nov 2018 · 0 repositories · arXiv:1811.10495
• Graph-Adaptive Pruning for Efficient Inference of Convolutional Neural Networks
  21 Nov 2018 · 0 repositories · arXiv:1811.08589
• Factorized Distillation: Training Holistic Person Re-identification Model by Distilling an Ensemble of Partial ReID Models
  20 Nov 2018 · 0 repositories · arXiv:1811.08073
• Self-Referenced Deep Learning
  19 Nov 2018 · 0 repositories · arXiv:1811.07598
• Private Model Compression via Knowledge Distillation
  13 Nov 2018 · 0 repositories · arXiv:1811.05072
• Sequence-Level Knowledge Distillation for Model Compression of Attention-based Sequence-to-Sequence Speech Recognition
  12 Nov 2018 · 0 repositories · arXiv:1811.04531
• Cogni-Net: Cognitive Feature Learning through Deep Visual Perception
  1 Nov 2018 · 1 repository · arXiv:1811.00201
• A Closer Look at Deep Learning Heuristics: Learning rate restarts, Warmup and Distillation
  29 Oct 2018 · 0 repositories · arXiv:1810.13243
• Fast Neural Architecture Search of Compact Semantic Segmentation Models via Auxiliary Cells
  25 Oct 2018 · 4 repositories · arXiv:1810.10804
• KTAN: Knowledge Transfer Adversarial Network
  18 Oct 2018 · 0 repositories · arXiv:1810.08126
• Knowledge Distillation from Few Samples
  27 Sep 2018 · 0 repositories
• Ranking Distillation: Learning Compact Ranking Models With High Performance for Recommender System
  19 Sep 2018 · 1 repository · arXiv:1809.07428
• Real-Time Joint Semantic Segmentation and Depth Estimation Using Asymmetric Annotations
  13 Sep 2018 · 4 repositories · arXiv:1809.04766
  Syntology official (archive's flag): 3 ran · 6 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 6 where Syntology's instrument failed) · 0 unverified (of 6 harvested samples) · 6 pointer-only (licence)
• Label Denoising with Large Ensembles of Heterogeneous Neural Networks
  12 Sep 2018 · 0 repositories · arXiv:1809.04403
• MotherNets: Rapid Deep Ensemble Learning
  12 Sep 2018 · 0 repositories · arXiv:1809.04270
• RDPD: Rich Data Helps Poor Data via Imitation
  6 Sep 2018 · 1 repository · arXiv:1809.01921
• Lifelong Learning via Progressive Distillation and Retrospection
  1 Sep 2018 · 0 repositories
• Whole-Slide Mitosis Detection in H&E Breast Histology Using PHH3 as a Reference to Train Distilled Stain-Invariant Convolutional Networks
  17 Aug 2018 · 0 repositories · arXiv:1808.05896
• Cooperative Denoising for Distantly Supervised Relation Extraction
  1 Aug 2018 · 0 repositories
• Self-supervised Knowledge Distillation Using Singular Value Decomposition
  18 Jul 2018 · 3 repositories · arXiv:1807.06819
• Distillation Techniques for Pseudo-rehearsal Based Incremental Learning
  8 Jul 2018 · 1 repository · arXiv:1807.02799
• Channel Gating Neural Networks
  29 May 2018 · 1 repository · arXiv:1805.12549
  Syntology 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 2 unverified (of 4 harvested samples) · 2 pointer-only (licence)
• Knowledge Distillation with Adversarial Samples Supporting Decision Boundary
  15 May 2018 · 1 repository · arXiv:1805.05532
  Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 4 harvested samples) · 1 pointer-only (licence)
• Few-shot learning of neural networks from scratch by pseudo example optimization
  8 Feb 2018 · 0 repositories · arXiv:1802.03039
• Faster gaze prediction with dense networks and Fisher pruning
  17 Jan 2018 · 2 repositories · arXiv:1801.05787
  Syntology 3 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples)
• Generation and Consolidation of Recollections for Efficient Deep Lifelong Learning
  1 Jan 2018 · 0 repositories
• Learning Deep and Compact Models for Gesture Recognition
  29 Dec 2017 · 1 repository · arXiv:1712.10136
• Learning Efficient Object Detection Models with Knowledge Distillation
  1 Dec 2017 · 0 repositories
• MicroExpNet: An Extremely Small and Fast Model For Expression Recognition From Face Images
  19 Nov 2017 · 3 repositories · arXiv:1711.07011
• Apprentice: Using Knowledge Distillation Techniques To Improve Low-Precision Network Accuracy
  15 Nov 2017 · 0 repositories · arXiv:1711.05852
• Knowledge Distillation for Bilingual Dictionary Induction
  1 Sep 2017 · 0 repositories
• TIP: Typifying the Interpretability of Procedures
  9 Jun 2017 · 0 repositories · arXiv:1706.02952
• Knowledge distillation using unlabeled mismatched images
  21 Mar 2017 · 0 repositories · arXiv:1703.07131
• Collaborative Deep Reinforcement Learning
  19 Feb 2017 · 1 repository · arXiv:1702.05796
• Neural Machine Translation from Simplified Translations
  19 Dec 2016 · 0 repositories · arXiv:1612.06139
• In Teacher We Trust: Learning Compressed Models for Pedestrian Detection
  1 Dec 2016 · 0 repositories · arXiv:1612.00478
• Sequence-Level Knowledge Distillation
  25 Jun 2016 · 6 repositories · arXiv:1606.07947
  Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 2 harvested samples)
• Adapting Models to Signal Degradation using Distillation
  1 Apr 2016 · 0 repositories · arXiv:1604.00433
• Distilling the Knowledge in a Neural Network
  9 Mar 2015 · 64 repositories · arXiv:1503.02531
  Syntology 23 ran (of which 0 constructed an object rather than computing a result; 14 with no instrument failure: 6 honoured, 0 violated, 8 with no contract checked; 9 where Syntology's instrument failed) · 14 unverified (of 37 harvested samples) · 11 pointer-only (licence)