Methods › General › Knowledge Distillation › Knowledge Distillation › Papers, page 29
Knowledge Distillation
Papers archive 2025-07-28
archive papers tagged: 3,071 · with a code link: 1,258 · where Syntology ran a sample: 320 (276 with a run with no instrument failure, 44 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (320 of 3,071 tagged: 276 with a run with no instrument failure, 44 where every run was a failure of Syntology's instrument)
Page 29 of 31: papers 2,801 to 2,900 of 3,071, newest first by the archive's date (ties by slug), in archive order.
Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code, as “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. It is per sample and not a correctness claim. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from.
-
Motion Pyramid Networks for Accurate and Efficient Cardiac Motion Estimation 28 Jun 2020 · 0 repositories · arXiv:2006.15710
-
Streaming Transformer ASR with Blockwise Synchronous Inference 25 Jun 2020 · 0 repositories · arXiv:2006.14941
-
Self-Knowledge Distillation with Progressive Refinement of Targets 22 Jun 2020 · 1 repository · arXiv:2006.12000Syntology official (archive's flag): 5 ran · 5 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 4 where Syntology's instrument failed) · 0 unverified (of 5 harvested samples) · 3 pointer-only (licence)
-
Paying more attention to snapshots of Iterative Pruning: Improving Model Compression via Ensemble Distillation 20 Jun 2020 · 1 repository · arXiv:2006.11487Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 1 where Syntology's instrument failed) · 4 unverified (of 8 harvested samples) · 2 pointer-only (licence)
-
Multi-fidelity Neural Architecture Search with Knowledge Distillation 15 Jun 2020 · 1 repository · arXiv:2006.08341
-
Pixel Invisibility: Detecting Objects Invisible in Color Images 15 Jun 2020 · 0 repositories · arXiv:2006.08383
-
Ensemble Distillation for Robust Model Fusion in Federated Learning 12 Jun 2020 · 1 repository · arXiv:2006.07242Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
Knowledge Distillation Meets Self-Supervision 12 Jun 2020 · 2 repositories · arXiv:2006.07114Syntology community repositories only · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
Real-Time Video Inference on Edge Devices via Adaptive Model Streaming 11 Jun 2020 · 1 repository · arXiv:2006.06628
-
Knowledge Distillation: A Survey 9 Jun 2020 · 0 repositories · arXiv:2006.05525
-
Classification Under Misspecification: Halfspaces, Generalized Linear Models, and Connections to Evolvability 8 Jun 2020 · 1 repository · arXiv:2006.04787
-
Continual Representation Learning for Biometric Identification 8 Jun 2020 · 1 repository · arXiv:2006.04455
-
FastSpeech 2: Fast and High-Quality End-to-End Text to Speech 8 Jun 2020 · 37 repositories · arXiv:2006.04558Syntology 83 ran (of which 27 constructed an object rather than computing a result; 73 with no instrument failure: 9 honoured, 1 violated, 63 with no contract checked; 10 where Syntology's instrument failed) · 36 unverified (of 119 harvested samples) · 40 pointer-only (licence)
-
ResKD: Residual-Guided Knowledge Distillation 8 Jun 2020 · 0 repositories · arXiv:2006.04719
-
ADMP: An Adversarial Double Masks Based Pruning Framework For Unsupervised Cross-Domain Compression 7 Jun 2020 · 0 repositories · arXiv:2006.04127
-
Multi-view Contrastive Learning for Online Knowledge Distillation 7 Jun 2020 · 1 repository · arXiv:2006.04093
-
Peer Collaborative Learning for Online Knowledge Distillation 7 Jun 2020 · 1 repository · arXiv:2006.04147Syntology 0 ran · 1 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
An Overview of Neural Network Compression 5 Jun 2020 · 0 repositories · arXiv:2006.03669
-
End-to-End Speech-Translation with Knowledge Distillation: FBK@IWSLT2020 4 Jun 2020 · 0 repositories · arXiv:2006.02965
-
Channel Distillation: Channel-Wise Attention for Knowledge Distillation 2 Jun 2020 · 1 repository · arXiv:2006.01683
-
ADINet: Attribute Driven Incremental Network for Retinal Image Classification 1 Jun 2020 · 0 repositories
-
Distilling Cross-Task Knowledge via Relationship Matching 1 Jun 2020 · 1 repository
-
Distilling Image Dehazing With Heterogeneous Task Imitation 1 Jun 2020 · 2 repositories
-
Online Knowledge Distillation via Collaborative Learning 1 Jun 2020 · 1 repository
-
Transferring Inductive Biases through Knowledge Distillation 31 May 2020 · 1 repository · arXiv:2006.00555Syntology official (archive's flag): 7 ran · 7 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 7 harvested samples)
-
Weight Squeezing: Reparameterization for Compression and Fast Inference 30 May 2020 · 0 repositories
-
Sub-Band Knowledge Distillation Framework for Speech Enhancement 29 May 2020 · 0 repositories · arXiv:2005.14435
-
Syntactic Structure Distillation Pretraining For Bidirectional Encoders 27 May 2020 · 0 repositories · arXiv:2005.13482
-
Learning from a Lightweight Teacher for Efficient Knowledge Distillation 19 May 2020 · 0 repositories · arXiv:2005.09163
-
Joint Progressive Knowledge Distillation and Unsupervised Domain Adaptation 16 May 2020 · 2 repositories · arXiv:2005.07839
-
Incremental Learning for End-to-End Automatic Speech Recognition 11 May 2020 · 0 repositories · arXiv:2005.04288
-
MAZE: Data-Free Model Stealing Attack Using Zeroth-Order Gradient Estimation 6 May 2020 · 1 repository · arXiv:2005.03161
-
Improving Non-autoregressive Neural Machine Translation with Monolingual Data 2 May 2020 · 0 repositories · arXiv:2005.00932
-
Distilling Spikes: Knowledge Distillation in Spiking Neural Networks 1 May 2020 · 0 repositories · arXiv:2005.00288
-
LightPAFF: A Two-Stage Distillation Framework for Pre-training and Fine-tuning 27 Apr 2020 · 0 repositories · arXiv:2004.12817
-
Distilling Knowledge from Refinement in Multiple Instance Detection Networks 23 Apr 2020 · 1 repository · arXiv:2004.10943
-
A Study of Non-autoregressive Model for Sequence Generation 22 Apr 2020 · 0 repositories · arXiv:2004.10454
-
Knowledge Distillation for Multilingual Unsupervised Neural Machine Translation 21 Apr 2020 · 0 repositories · arXiv:2004.10171
-
Triplet Loss for Knowledge Distillation 17 Apr 2020 · 1 repository · arXiv:2004.08116
-
Knowledge Distillation for Action Anticipation via Label Smoothing 16 Apr 2020 · 0 repositories · arXiv:2004.07711
-
Multimodal and multiview distillation for real-time player detection on a football field 16 Apr 2020 · 1 repository · arXiv:2004.07544
-
Building a Multi-domain Neural Machine Translation Model using Knowledge Distillation 15 Apr 2020 · 0 repositories · arXiv:2004.07324
-
Dark Experience for General Continual Learning: a Strong, Simple Baseline 15 Apr 2020 · 3 repositories · arXiv:2004.07211
-
Smart Inference for Multidigit Convolutional Neural Network based Barcode Decoding 14 Apr 2020 · 0 repositories · arXiv:2004.06297
-
Towards Robust Classification with Image Quality Assessment 14 Apr 2020 · 0 repositories · arXiv:2004.06288
-
Knowledge Distillation and Student-Teacher Learning for Visual Intelligence: A Review and New Outlooks 13 Apr 2020 · 2 repositories · arXiv:2004.05937
-
XtremeDistil: Multi-stage Distillation for Massive Multilingual Models 12 Apr 2020 · 0 repositories · arXiv:2004.05686
-
Inter-Region Affinity Distillation for Road Marking Segmentation 11 Apr 2020 · 1 repository · arXiv:2004.05304Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 4 harvested samples)
-
KD-MRI: A knowledge distillation framework for image reconstruction and image restoration in MRI workflow 11 Apr 2020 · 1 repository · arXiv:2004.05319
-
Knowledge Distillation for Mobile Edge Computation Offloading 9 Apr 2020 · 0 repositories · arXiv:2004.04366
-
LadaBERT: Lightweight Adaptation of BERT through Hybrid Model Compression 8 Apr 2020 · 0 repositories · arXiv:2004.04124
-
Towards Non-task-specific Distillation of BERT via Sentence Representation Approximation 7 Apr 2020 · 0 repositories · arXiv:2004.03097
-
Enhancing Review Comprehension with Domain-Specific Commonsense 6 Apr 2020 · 0 repositories · arXiv:2004.03020
-
Temporally Distributed Networks for Fast Video Semantic Segmentation 3 Apr 2020 · 1 repository · arXiv:2004.01800Syntology 5 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 5 harvested samples) · 2 pointer-only (licence)
-
Knowledge as Priors: Cross-Modal Knowledge Generalization for Datasets without Superior Knowledge 1 Apr 2020 · 0 repositories · arXiv:2004.00176
-
More Grounded Image Captioning by Distilling Image-Text Matching Model 1 Apr 2020 · 1 repository · arXiv:2004.00390Syntology official (archive's flag): 7 ran · 7 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 3 where Syntology's instrument failed) · 1 unverified (of 8 harvested samples)
-
SS-IL: Separated Softmax for Incremental Learning 31 Mar 2020 · 0 repositories · arXiv:2003.13947
-
Distilled Semantics for Comprehensive Scene Understanding from Videos 31 Mar 2020 · 1 repository · arXiv:2003.14030
-
Neural Networks Are More Productive Teachers Than Human Raters: Active Mixup for Data-Efficient Knowledge Distillation from a Blackbox Model 31 Mar 2020 · 1 repository · arXiv:2003.13960
-
Spatio-Temporal Graph for Video Captioning with Knowledge Distillation 31 Mar 2020 · 0 repositories · arXiv:2003.13942
-
Squeezed Deep 6DoF Object Detection Using Knowledge Distillation 30 Mar 2020 · 2 repositories · arXiv:2003.13586
-
Circumventing Outliers of AutoAugment with Knowledge Distillation 25 Mar 2020 · 1 repository · arXiv:2003.11342
-
Synergic Adversarial Label Learning for Grading Retinal Diseases via Knowledge Distillation and Multi-task Learning 24 Mar 2020 · 0 repositories · arXiv:2003.10607
-
Distilling Knowledge from Graph Convolutional Networks 23 Mar 2020 · 1 repository · arXiv:2003.10477Syntology official (archive's flag): 7 ran · 7 ran (of which 0 constructed an object rather than computing a result; 7 with no instrument failure: 0 honoured, 0 violated, 7 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 7 harvested samples)
-
Collaborative Distillation for Ultra-Resolution Universal Style Transfer 18 Mar 2020 · 1 repository · arXiv:2003.08436Syntology official (archive's flag): 7 ran · 7 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 2 where Syntology's instrument failed) · 1 unverified (of 8 harvested samples) · 1 pointer-only (licence)
-
Incremental Object Detection via Meta-Learning 17 Mar 2020 · 2 repositories · arXiv:2003.08798Syntology official (archive's flag): 6 ran · 7 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 1 where Syntology's instrument failed) · 2 unverified (of 9 harvested samples) · 9 pointer-only (licence)
-
Teacher-Student chain for efficient semi-supervised histology image classification 17 Mar 2020 · 0 repositories · arXiv:2003.08797
-
Deformation Flow Based Two-Stream Network for Lip Reading 12 Mar 2020 · 1 repository · arXiv:2003.05709
-
Knowledge distillation via adaptive instance normalization 9 Mar 2020 · 0 repositories · arXiv:2003.04289
-
Pacemaker: Intermediate Teacher Knowledge Distillation For On-The-Fly Convolutional Neural Network 9 Mar 2020 · 0 repositories · arXiv:2003.03944
-
Explaining Knowledge Distillation by Quantifying the Knowledge 7 Mar 2020 · 0 repositories · arXiv:2003.03622
-
Distill, Adapt, Distill: Training Small, In-Domain Models for Neural Machine Translation 5 Mar 2020 · 0 repositories · arXiv:2003.02877
-
An Efficient Method of Training Small Models for Regression Problems with Knowledge Distillation 28 Feb 2020 · 0 repositories · arXiv:2002.12597
-
TextBrewer: An Open-Source Knowledge Distillation Toolkit for Natural Language Processing 28 Feb 2020 · 1 repository · arXiv:2002.12620
-
Efficient Semantic Video Segmentation with Per-frame Inference 26 Feb 2020 · 1 repository · arXiv:2002.11433Syntology 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 2 unverified (of 3 harvested samples) · 3 pointer-only (licence)
-
Semi-Supervised Speech Recognition via Local Prior Matching 24 Feb 2020 · 1 repository · arXiv:2002.10336
-
Residual Knowledge Distillation 21 Feb 2020 · 0 repositories · arXiv:2002.09168
-
Balancing Cost and Benefit with Tied-Multi Transformers 20 Feb 2020 · 0 repositories · arXiv:2002.08614
-
Knapsack Pruning with Inner Distillation 19 Feb 2020 · 1 repository · arXiv:2002.08258Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples)
-
Content Based Singing Voice Extraction From a Musical Mixture 12 Feb 2020 · 1 repository · arXiv:2002.04933
-
Regularized Evolutionary Population-Based Training 11 Feb 2020 · 0 repositories · arXiv:2002.04225
-
Unlabeled Data Deployment for Classification of Diabetic Retinopathy Images Using Knowledge Transfer 9 Feb 2020 · 0 repositories · arXiv:2002.03321
-
SUOD: Toward Scalable Unsupervised Outlier Detection 8 Feb 2020 · 2 repositories · arXiv:2002.03222
-
BERT-of-Theseus: Compressing BERT by Progressive Module Replacing 7 Feb 2020 · 2 repositories · arXiv:2002.02925Syntology official: harvested, nothing ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 4 unverified (of 5 harvested samples) · 1 pointer-only (licence)
-
Feature-map-level Online Adversarial Knowledge Distillation 5 Feb 2020 · 0 repositories · arXiv:2002.01775
-
Periodic Intra-Ensemble Knowledge Distillation for Reinforcement Learning 1 Feb 2020 · 1 repository · arXiv:2002.00149
-
MSE-Optimal Neural Network Initialization via Layer Fusion 28 Jan 2020 · 1 repository · arXiv:2001.10509
-
Developing Multi-Task Recommendations with Long-Term Rewards via Policy Distilled Reinforcement Learning 27 Jan 2020 · 0 repositories · arXiv:2001.09595
-
Generation-Distillation for Efficient Natural Language Understanding in Low-Data Settings 25 Jan 2020 · 0 repositories · arXiv:2002.00733
-
Data Techniques For Online End-to-end Speech Recognition 24 Jan 2020 · 0 repositories · arXiv:2001.09221
-
Lightweight 3D Human Pose Estimation Network Training Using Teacher-Student Learning 15 Jan 2020 · 0 repositories · arXiv:2001.05097
-
Noisy Machines: Understanding Noisy Neural Networks and Enhancing Robustness to Analog Hardware Errors Using Distillation 14 Jan 2020 · 0 repositories · arXiv:2001.04974
-
AdaBERT: Task-Adaptive BERT Compression with Differentiable Neural Architecture Search 13 Jan 2020 · 1 repository · arXiv:2001.04246Syntology 0 ran · 3 unverified (of 3 harvested samples)
-
Learning From Multiple Experts: Self-paced Knowledge Distillation for Long-tailed Classification 6 Jan 2020 · 1 repository · arXiv:2001.01536
-
Learning Task-Agnostic Embedding of Multiple Black-Box Experts for Multi-Task Model Fusion 1 Jan 2020 · 0 repositories
-
DeGAN : Data-Enriching GAN for Retrieving Representative Samples from a Trained Classifier 27 Dec 2019 · 0 repositories · arXiv:1912.11960
-
The State of Knowledge Distillation for Classification 20 Dec 2019 · 1 repository · arXiv:1912.10850
-
Joint Architecture and Knowledge Distillation in CNN for Chinese Text Recognition 17 Dec 2019 · 0 repositories · arXiv:1912.07806
-
Iterative Dual Domain Adaptation for Neural Machine Translation 16 Dec 2019 · 0 repositories · arXiv:1912.07239
-
Explaining Sequence-Level Knowledge Distillation as Data-Augmentation for Neural Machine Translation 6 Dec 2019 · 0 repositories · arXiv:1912.03334