Methods › General › Knowledge Distillation › Knowledge Distillation › Papers, page 27
Knowledge Distillation
Papers archive 2025-07-28
archive papers tagged: 3,071 · with a code link: 1,258 · where Syntology ran a sample: 320 (276 with a run with no instrument failure, 44 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (320 of 3,071 tagged: 276 with a run with no instrument failure, 44 where every run was a failure of Syntology's instrument)
Page 27 of 31: papers 2,601 to 2,700 of 3,071, newest first by the archive's date (ties by slug), in archive order.
Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code, as “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. It is per sample and not a correctness claim. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from.
-
Deep Epidemiological Modeling by Black-box Knowledge Distillation: An Accurate Deep Learning Model for COVID-19 20 Jan 2021 · 0 repositories · arXiv:2101.10280
-
Learning to Augment for Data-Scarce Domain BERT Knowledge Distillation 20 Jan 2021 · 0 repositories · arXiv:2101.08106Syntology 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 13 unverified (of 15 harvested samples) · 15 pointer-only (licence)
-
Knowledge Distillation Methods for Efficient Unsupervised Adaptation Across Multiple Domains 18 Jan 2021 · 0 repositories · arXiv:2101.07308
-
Mining Data Impressions from Deep Models as Substitute for the Unavailable Training Data 15 Jan 2021 · 0 repositories · arXiv:2101.06069
-
KDLSQ-BERT: A Quantized Bert Combining Knowledge Distillation with Learned Step Size Quantization 15 Jan 2021 · 0 repositories · arXiv:2101.05938
-
Interpretable discovery of new semiconductors with machine learning 12 Jan 2021 · 0 repositories · arXiv:2101.04383
-
Resolution-Based Distillation for Efficient Histology Image Classification 11 Jan 2021 · 0 repositories · arXiv:2101.04170
-
Adversarially Robust and Explainable Model Compression with On-Device Personalization for Text Classification 10 Jan 2021 · 0 repositories · arXiv:2101.05624
-
Knowledge Distillation in Iterative Generative Models for Improved Sampling Speed 7 Jan 2021 · 2 repositories · arXiv:2101.02388
-
MSD: Saliency-aware Knowledge Distillation for Multimodal Understanding 6 Jan 2021 · 0 repositories · arXiv:2101.01881
-
Active Learning for Lane Detection: A Knowledge Distillation Approach 1 Jan 2021 · 0 repositories
-
Contextual Knowledge Distillation for Transformer Compression 1 Jan 2021 · 0 repositories
-
Don't be picky, all students in the right family can learn from good teachers 1 Jan 2021 · 0 repositories
-
Explicit Connection Distillation 1 Jan 2021 · 0 repositories
-
Exploring Inter-Channel Correlation for Diversity-Preserved Knowledge Distillation 1 Jan 2021 · 2 repositories
-
Improve Object Detection with Feature-based Knowledge Distillation: Towards Accurate and Efficient Detectors 1 Jan 2021 · 1 repository
-
Knowledge Distillation based Ensemble Learning for Neural Machine Translation 1 Jan 2021 · 0 repositories
-
Learning from deep model via exploring local targets 1 Jan 2021 · 0 repositories
-
Long Live the Lottery: The Existence of Winning Tickets in Lifelong Learning 1 Jan 2021 · 0 repositories
-
Robust Overfitting may be mitigated by properly learned smoothening 1 Jan 2021 · 0 repositories
-
Self-Mutual Distillation Learning for Continuous Sign Language Recognition 1 Jan 2021 · 1 repository
-
STEM: An Approach to Multi-Source Domain Adaptation With Guarantees 1 Jan 2021 · 1 repository
-
Student Customized Knowledge Distillation: Bridging the Gap Between Student and Teacher 1 Jan 2021 · 0 repositories
-
Unpaired Learning for Deep Image Deraining With Rain Direction Regularizer 1 Jan 2021 · 0 repositories
-
Fully Synthetic Data Improves Neural Machine Translation with Knowledge Distillation 31 Dec 2020 · 0 repositories · arXiv:2012.15455
-
Towards Zero-Shot Knowledge Distillation for Natural Language Processing 31 Dec 2020 · 0 repositories · arXiv:2012.15495
-
Unified Mandarin TTS Front-end Based on Distilled BERT Model 31 Dec 2020 · 1 repository · arXiv:2012.15404
-
Knowledge Distillation with Adaptive Asymmetric Label Sharpening for Semi-supervised Fracture Detection in Chest X-rays 30 Dec 2020 · 0 repositories · arXiv:2012.15359
-
Learning Light-Weight Translation Models from Deep Transformer 27 Dec 2020 · 1 repository · arXiv:2012.13866Syntology official (archive's flag): 1 ran · 2 ran (of which 2 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified; every one of the 2 samples that ran constructed an object rather than computing a result (of 2 harvested samples) · 1 pointer-only (licence)
-
Towards a Universal Continuous Knowledge Base 25 Dec 2020 · 0 repositories · arXiv:2012.13568
-
AttentionLite: Towards Efficient Self-Attention Models for Vision 21 Dec 2020 · 0 repositories · arXiv:2101.05216
-
Diverse Knowledge Distillation for End-to-End Person Search 21 Dec 2020 · 0 repositories · arXiv:2012.11187
-
Computation-Efficient Knowledge Distillation via Uncertainty-Aware Mixup 17 Dec 2020 · 1 repository · arXiv:2012.09413
-
Invariant Teacher and Equivariant Student for Unsupervised 3D Human Pose Estimation 17 Dec 2020 · 1 repository · arXiv:2012.09398
-
Towards Understanding Ensemble, Knowledge Distillation and Self-Distillation in Deep Learning 17 Dec 2020 · 0 repositories · arXiv:2012.09816
-
Distilling Optimal Neural Networks: Rapid Search in Diverse Spaces 16 Dec 2020 · 0 repositories · arXiv:2012.08859
-
Wasserstein Contrastive Representation Distillation 15 Dec 2020 · 0 repositories · arXiv:2012.08674
-
LRC-BERT: Latent-representation Contrastive Knowledge Distillation for Natural Language Understanding 14 Dec 2020 · 0 repositories · arXiv:2012.07335
-
Periocular Embedding Learning with Consistent Knowledge Distillation from Face 12 Dec 2020 · 0 repositories · arXiv:2012.06746
-
Reinforced Multi-Teacher Selection for Knowledge Distillation 11 Dec 2020 · 0 repositories · arXiv:2012.06048
-
Progressive Network Grafting for Few-Shot Knowledge Distillation 9 Dec 2020 · 2 repositories · arXiv:2012.04915
-
DE-RRD: A Knowledge Distillation Framework for Recommender System 8 Dec 2020 · 2 repositories · arXiv:2012.04357Syntology community repositories only · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
Model Compression Using Optimal Transport 7 Dec 2020 · 0 repositories · arXiv:2012.03907
-
Cross-Layer Distillation with Semantic Calibration 6 Dec 2020 · 2 repositories · arXiv:2012.03236
-
Multi-head Knowledge Distillation for Model Compression 5 Dec 2020 · 0 repositories · arXiv:2012.02911
-
Parallel Blockwise Knowledge Distillation for Deep Neural Network Compression 5 Dec 2020 · 1 repository · arXiv:2012.03096
-
Reciprocal Supervised Learning Improves Neural Machine Translation 5 Dec 2020 · 1 repository · arXiv:2012.02975
-
Meta-KD: A Meta Knowledge Distillation Framework for Language Model Compression across Domains 2 Dec 2020 · 1 repository · arXiv:2012.01266
-
Agree to Disagree: Adaptive Ensemble Knowledge Distillation in Gradient Space 1 Dec 2020 · 1 repository
-
Classification Under Misspecification: Halfspaces, Generalized Linear Models, and Evolvability 1 Dec 2020 · 0 repositories
-
Knowledge Base Embedding By Cooperative Knowledge Distillation 1 Dec 2020 · 1 repository
-
Multi-level Knowledge Distillation via Knowledge Alignment and Correlation 1 Dec 2020 · 1 repository · arXiv:2012.00573
-
Query Distillation: BERT-based Distillation for Ensemble Ranking 1 Dec 2020 · 0 repositories
-
Reverse-engineering recurrent neural network solutions to a hierarchical inference task for mice 1 Dec 2020 · 0 repositories
-
Solvable Model for Inheriting the Regularization through Knowledge Distillation 1 Dec 2020 · 0 repositories · arXiv:2012.00194
-
A Selective Survey on Versatile Knowledge Distillation Paradigm for Neural Network Models 30 Nov 2020 · 0 repositories · arXiv:2011.14554
-
KD-Lib: A PyTorch library for Knowledge Distillation, Pruning and Quantization 30 Nov 2020 · 1 repository · arXiv:2011.14691
-
Real-time Spatio-temporal Action Localization via Learning Motion Representation 30 Nov 2020 · 0 repositories
-
Adaptive Multiplane Image Generation from a Single Internet Picture 26 Nov 2020 · 0 repositories · arXiv:2011.13317
-
torchdistill: A Modular, Configuration-Driven Framework for Knowledge Distillation 25 Nov 2020 · 1 repository · arXiv:2011.12913Syntology official (archive's flag): 10 ran · 10 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 10 where Syntology's instrument failed) · 16 unverified (of 26 harvested samples)
-
Generative Adversarial Simulator 23 Nov 2020 · 0 repositories · arXiv:2011.11472
-
Evolving Search Space for Neural Architecture Search 22 Nov 2020 · 1 repository · arXiv:2011.10904
-
Head Network Distillation: Splitting Distilled Deep Neural Networks for Resource-Constrained Edge Computing Systems 20 Nov 2020 · 2 repositories
-
KD3A: Unsupervised Multi-Source Decentralized Domain Adaptation via Knowledge Distillation 19 Nov 2020 · 1 repository · arXiv:2011.09757
-
Effectiveness of Arbitrary Transfer Sets for Data-free Knowledge Distillation 18 Nov 2020 · 0 repositories · arXiv:2011.09113
-
Privileged Knowledge Distillation for Online Action Detection 18 Nov 2020 · 0 repositories · arXiv:2011.09158
-
Deep Serial Number: Computational Watermarking for DNN Intellectual Property Protection 17 Nov 2020 · 0 repositories · arXiv:2011.08960
-
Generalized Continual Zero-Shot Learning 17 Nov 2020 · 0 repositories · arXiv:2011.08508
-
Anomaly Detection in Video via Self-Supervised and Multi-Task Learning 15 Nov 2020 · 1 repository · arXiv:2011.07491
-
Online Ensemble Model Compression using Knowledge Distillation 15 Nov 2020 · 1 repository · arXiv:2011.07449
-
Distill2Vec: Dynamic Graph Representation Learning with Knowledge Distillation 11 Nov 2020 · 1 repository · arXiv:2011.05664
-
EGAD: Evolving Graph Representation Learning with Self-Attention and Knowledge Distillation for Live Video Streaming Events 11 Nov 2020 · 1 repository · arXiv:2011.05705
-
Real-Time Decentralized knowledge Transfer at the Edge 11 Nov 2020 · 1 repository · arXiv:2011.05961
-
On Estimating the Training Cost of Conversational Recommendation Systems 10 Nov 2020 · 0 repositories · arXiv:2011.05302
-
Knowledge Distillation for Singing Voice Detection 9 Nov 2020 · 1 repository · arXiv:2011.04297
-
Ensemble Knowledge Distillation for CTR Prediction 8 Nov 2020 · 0 repositories · arXiv:2011.04106
-
Channel Planting for Deep Neural Networks using Knowledge Distillation 4 Nov 2020 · 0 repositories · arXiv:2011.02390
-
Federated Knowledge Distillation 4 Nov 2020 · 4 repositories · arXiv:2011.02367Syntology 0 ran · 1 unverified (of 1 harvested sample)
-
On Self-Distilling Graph Neural Network 4 Nov 2020 · 0 repositories · arXiv:2011.02255
-
A Comprehensive Study of Class Incremental Learning Algorithms for Visual Tasks 3 Nov 2020 · 1 repository · arXiv:2011.01844
-
Domain Adaptive Knowledge Distillation for Driving Scene Semantic Segmentation 3 Nov 2020 · 1 repository · arXiv:2011.08007
-
Data-free Knowledge Distillation for Segmentation using Data-Enriching GAN 2 Nov 2020 · 1 repository · arXiv:2011.00809
-
Bridging the Gap between Prior and Posterior Knowledge Selection for Knowledge-Grounded Dialogue Generation 1 Nov 2020 · 0 repositories
-
Fast End-to-end Coreference Resolution for Korean 1 Nov 2020 · 0 repositories
-
HW-TSC’s Participation in the WMT 2020 News Translation Shared Task 1 Nov 2020 · 0 repositories
-
MixKD: Towards Efficient Distillation of Large-scale Language Models 1 Nov 2020 · 0 repositories · arXiv:2011.00593
-
The NiuTrans Machine Translation Systems for WMT20 1 Nov 2020 · 0 repositories
-
Using the Past Knowledge to Improve Sentiment Classification 1 Nov 2020 · 0 repositories
-
ProxylessKD: Direct Knowledge Distillation with Inherited Classifier for Face Recognition 31 Oct 2020 · 0 repositories · arXiv:2011.00265
-
Activation Map Adaptation for Effective Knowledge Distillation 26 Oct 2020 · 0 repositories · arXiv:2010.13500
-
Empowering Knowledge Distillation via Open Set Recognition for Robust 3D Point Cloud Classification 25 Oct 2020 · 0 repositories · arXiv:2010.13114
-
Two-stage Textual Knowledge Distillation for End-to-End Spoken Language Understanding 25 Oct 2020 · 1 repository · arXiv:2010.13105
-
Improved Synthetic Training for Reading Comprehension 24 Oct 2020 · 0 repositories · arXiv:2010.12776
-
Pre-trained Summarization Distillation 24 Oct 2020 · 1 repository · arXiv:2010.13002
-
Distilling Dense Representations for Ranking using Tightly-Coupled Teachers 22 Oct 2020 · 2 repositories · arXiv:2010.11386
-
Contextualized Attention-based Knowledge Transfer for Spoken Conversational Question Answering 21 Oct 2020 · 0 repositories · arXiv:2010.11066
-
Knowledge Distillation for Improved Accuracy in Spoken Question Answering 21 Oct 2020 · 0 repositories · arXiv:2010.11067
-
Fast Video Salient Object Detection via Spatiotemporal Knowledge Distillation 20 Oct 2020 · 0 repositories · arXiv:2010.10027
-
Knowledge Distillation in Wide Neural Networks: Risk Bound, Data Efficiency and Imperfect Teacher 20 Oct 2020 · 0 repositories · arXiv:2010.10090
-
Comparing Fisher Information Regularization with Distillation for DNN Quantization 19 Oct 2020 · 0 repositories