Methods › General › Knowledge Distillation › Knowledge Distillation › Papers, page 28
Knowledge Distillation
Papers archive 2025-07-28
archive papers tagged: 3,071 · with a code link: 1,258 · where Syntology ran a sample: 320 (276 with a run with no instrument failure, 44 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (320 of 3,071 tagged: 276 with a run with no instrument failure, 44 where every run was a failure of Syntology's instrument)
Page 28 of 31: papers 2,701 to 2,800 of 3,071, newest first by the archive's date (ties by slug), in archive order.
Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code, as “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. It is per sample and not a correctness claim. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from.
-
Reducing the Teacher-Student Gap via Spherical Knowledge Disitllation 15 Oct 2020 · 1 repository · arXiv:2010.07485
-
AutoADR: Automatic Model Design for Ad Relevance 14 Oct 2020 · 0 repositories · arXiv:2010.07075
-
MulDE: Multi-teacher Knowledge Distillation for Low-dimensional Knowledge Graph Embeddings 14 Oct 2020 · 0 repositories · arXiv:2010.07152
-
Task Decoupled Knowledge Distillation For Lightweight Face Detectors 14 Oct 2020 · 1 repository
-
Collective Wisdom: Improving Low-resource Neural Machine Translation using Adaptive Knowledge Distillation 12 Oct 2020 · 0 repositories · arXiv:2010.05445
-
Dual-mode ASR: Unify and Improve Streaming ASR with Full-context Modeling 12 Oct 2020 · 0 repositories · arXiv:2010.06030
-
Distilling a Deep Neural Network into a Takagi-Sugeno-Kang Fuzzy Inference System 10 Oct 2020 · 0 repositories · arXiv:2010.04974
-
Structural Knowledge Distillation: Tractably Distilling Information for Structured Predictor 10 Oct 2020 · 1 repository · arXiv:2010.05010
-
Be Your Own Best Competitor! Multi-Branched Adversarial Knowledge Transfer 9 Oct 2020 · 0 repositories · arXiv:2010.04516
-
Locally Linear Region Knowledge Distillation 9 Oct 2020 · 0 repositories · arXiv:2010.04812
-
DiPair: Fast and Accurate Distillation for Trillion-Scale Text Matching and Pair Modeling 7 Oct 2020 · 0 repositories · arXiv:2010.03099
-
Galileo at SemEval-2020 Task 12: Multi-lingual Learning for Offensive Language Identification using Pre-trained Language Models 7 Oct 2020 · 0 repositories · arXiv:2010.03542
-
Deep Representation Learning of Patient Data from Electronic Health Records (EHR): A Systematic Review 6 Oct 2020 · 0 repositories · arXiv:2010.02809
-
Improving Efficient Neural Ranking Models with Cross-Architecture Knowledge Distillation 6 Oct 2020 · 1 repository · arXiv:2010.02666
-
Why Skip If You Can Combine: A Simple Knowledge Distillation Technique for Intermediate Layers 6 Oct 2020 · 2 repositories · arXiv:2010.03034Syntology official: harvested, nothing ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 3 harvested samples)
-
Improving Neural Topic Models using Knowledge Distillation 5 Oct 2020 · 1 repository · arXiv:2010.02377Syntology official: harvested, nothing ran · 4 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 5 harvested samples) · 1 pointer-only (licence)
-
Lifelong Language Knowledge Distillation 5 Oct 2020 · 1 repository · arXiv:2010.02123Syntology official (archive's flag): 1 ran · 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; the one sample that ran constructed an object rather than computing a result (of 1 harvested sample) · 1 pointer-only (licence)
-
Towards Cross-modality Medical Image Segmentation with Online Mutual Knowledge Distillation 4 Oct 2020 · 0 repositories · arXiv:2010.01532
-
Neighbourhood Distillation: On the benefits of non end-to-end distillation 2 Oct 2020 · 0 repositories · arXiv:2010.01189
-
Online Knowledge Distillation via Multi-branch Diversity Enhancement 2 Oct 2020 · 0 repositories · arXiv:2010.00795
-
Improved Knowledge Distillation via Full Kernel Matrix Transfer 30 Sep 2020 · 1 repository · arXiv:2009.14416Syntology official (archive's flag): 6 ran · 6 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 6 harvested samples)
-
Pea-KD: Parameter-efficient and Accurate Knowledge Distillation on BERT 30 Sep 2020 · 0 repositories · arXiv:2009.14822
-
Stochastic Precision Ensemble: Self-Knowledge Distillation for Quantized Deep Neural Networks 30 Sep 2020 · 0 repositories · arXiv:2009.14502
-
Contrastive Distillation on Intermediate Representations for Language Model Compression 29 Sep 2020 · 1 repository · arXiv:2009.14167Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 4 harvested samples)
-
TinyGAN: Distilling BigGAN for Conditional Image Generation 29 Sep 2020 · 1 repository · arXiv:2009.13829
-
Kernel Based Progressive Distillation for Adder Neural Networks 28 Sep 2020 · 0 repositories · arXiv:2009.13044
-
Pea-KD: Parameter-efficient and accurate Knowledge Distillation 28 Sep 2020 · 0 repositories
-
TernaryBERT: Distillation-aware Ultra-low Bit BERT 27 Sep 2020 · 5 repositories · arXiv:2009.12812
-
Multi-Frame to Single-Frame: Knowledge Distillation for 3D Object Detection 24 Sep 2020 · 0 repositories · arXiv:2009.11859
-
N-LTP: An Open-source Neural Language Technology Platform for Chinese 24 Sep 2020 · 1 repository · arXiv:2009.11616
-
Open-set Short Utterance Forensic Speaker Verification using Teacher-Student Network with Explicit Inductive Bias 21 Sep 2020 · 0 repositories · arXiv:2009.09556
-
EI-MTD:Moving Target Defense for Edge Intelligence against Adversarial Attacks 19 Sep 2020 · 0 repositories · arXiv:2009.10537
-
Weight Distillation: Transferring the Knowledge in Neural Network Parameters 19 Sep 2020 · 0 repositories · arXiv:2009.09152
-
Densely Guided Knowledge Distillation using Multiple Teacher Assistants 18 Sep 2020 · 1 repository · arXiv:2009.08825
-
MEAL V2: Boosting Vanilla ResNet-50 to 80%+ Top-1 Accuracy on ImageNet without Tricks 17 Sep 2020 · 1 repository · arXiv:2009.08453
-
S2SD: Simultaneous Similarity-based Self-Distillation for Deep Metric Learning 17 Sep 2020 · 1 repository · arXiv:2009.08348Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 3 harvested samples)
-
Mimic and Conquer: Heterogeneous Tree Structure Distillation for Syntactic NLP 16 Sep 2020 · 0 repositories · arXiv:2009.07411
-
Simplified TinyBERT: Knowledge Distillation for Document Retrieval 16 Sep 2020 · 4 repositories · arXiv:2009.07531
-
Collaborative Distillation in the Parameter and Spectrum Domains for Video Action Recognition 15 Sep 2020 · 0 repositories · arXiv:2009.06902
-
BoostingBERT:Integrating Multi-Class Boosting into BERT for NLP Tasks 13 Sep 2020 · 0 repositories · arXiv:2009.05959
-
DualDE: Dually Distilling Knowledge Graph Embedding for Faster and Cheaper Reasoning 13 Sep 2020 · 0 repositories · arXiv:2009.05912
-
SSKD: Self-Supervised Knowledge Distillation for Cross Domain Adaptive Person Re-Identification 13 Sep 2020 · 0 repositories · arXiv:2009.05972
-
Extending Label Smoothing Regularization with Self-Knowledge Distillation 11 Sep 2020 · 0 repositories · arXiv:2009.05226
-
On the Orthogonality of Knowledge Distillation with Other Techniques: From an Ensemble Perspective 9 Sep 2020 · 0 repositories · arXiv:2009.04120
-
Lifelong Object Detection 2 Sep 2020 · 0 repositories · arXiv:2009.01129
-
Automatic Assignment of Radiology Examination Protocols Using Pre-trained Language Models with Knowledge Distillation 1 Sep 2020 · 1 repository · arXiv:2009.00694
-
Classification of Diabetic Retinopathy Using Unlabeled Data and Knowledge Distillation 1 Sep 2020 · 0 repositories · arXiv:2009.00982
-
Semantics-aware Adaptive Knowledge Distillation for Sensor-to-Vision Action Recognition 1 Sep 2020 · 1 repository · arXiv:2009.00210
-
Initial Classifier Weights Replay for Memoryless Class Incremental Learning 31 Aug 2020 · 1 repository · arXiv:2008.13710
-
Performance Optimization for Federated Person Re-identification via Benchmark Analysis 26 Aug 2020 · 2 repositories · arXiv:2008.11560
-
Active Class Incremental Learning for Imbalanced Datasets 25 Aug 2020 · 1 repository · arXiv:2008.10968
-
Learn to Talk via Proactive Knowledge Transfer 23 Aug 2020 · 0 repositories · arXiv:2008.10077
-
Multi-Person Full Body Pose Estimation 23 Aug 2020 · 0 repositories · arXiv:2008.10060
-
Rectified Decision Trees: Exploring the Landscape of Interpretable and Effective Machine Learning 21 Aug 2020 · 0 repositories · arXiv:2008.09413
-
Cascaded channel pruning using hierarchical self-distillation 16 Aug 2020 · 0 repositories · arXiv:2008.06814
-
Compression of Deep Learning Models for Text: A Survey 12 Aug 2020 · 0 repositories · arXiv:2008.05221
-
Towards Unsupervised Crowd Counting via Regression-Detection Bi-knowledge Transfer 12 Aug 2020 · 0 repositories · arXiv:2008.05383
-
Compact Speaker Embedding: lrx-vector 11 Aug 2020 · 0 repositories · arXiv:2008.05011
-
S2OSC: A Holistic Semi-Supervised Approach for Open Set Classification 11 Aug 2020 · 0 repositories · arXiv:2008.04662
-
Distilling the Knowledge of BERT for Sequence-to-Sequence ASR 9 Aug 2020 · 1 repository · arXiv:2008.03822
-
LRSpeech: Extremely Low-Resource Speech Synthesis and Recognition 9 Aug 2020 · 0 repositories · arXiv:2008.03687
-
MED-TEX: Transferring and Explaining Knowledge with Less Data from Pretrained Medical Imaging Models 6 Aug 2020 · 0 repositories · arXiv:2008.02593
-
Teacher-Student Training and Triplet Loss for Facial Expression Recognition under Occlusion 3 Aug 2020 · 0 repositories · arXiv:2008.01003
-
TutorNet: Towards Flexible Knowledge Distillation for End-to-End Speech Recognition 3 Aug 2020 · 0 repositories · arXiv:2008.00671
-
Differentiable Feature Aggregation Search for Knowledge Distillation 2 Aug 2020 · 0 repositories · arXiv:2008.00506
-
AMLN: Adversarial-based Mutual Learning Network for Online Knowledge Distillation 1 Aug 2020 · 0 repositories
-
Distilling Visual Priors from Self-Supervised Learning 1 Aug 2020 · 1 repository · arXiv:2008.00261
-
Feature Normalized Knowledge Distillation for Image Classification 1 Aug 2020 · 1 repository
-
Improving Knowledge Distillation via Category Structure 1 Aug 2020 · 1 repository
-
Intra-class Feature Variation Distillation for Semantic Segmentation 1 Aug 2020 · 1 repository
-
Local Correlation Consistency for Knowledge Distillation 1 Aug 2020 · 0 repositories
-
Weight Decay Scheduling and Knowledge Distillation for Active Learning 1 Aug 2020 · 0 repositories
-
YOLO in the Dark - Domain Adaptation Method for Merging Multiple Models - 1 Aug 2020 · 0 repositories
-
Neural Compression and Filtering for Edge-assisted Real-time Object Detection in Challenged Networks 31 Jul 2020 · 2 repositories · arXiv:2007.15818
-
Group Knowledge Transfer: Federated Learning of Large CNNs at the Edge 28 Jul 2020 · 2 repositories · arXiv:2007.14513Syntology community repositories only · 3 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 4 harvested samples)
-
Weakly Supervised 3D Object Detection from Point Clouds 28 Jul 2020 · 1 repository · arXiv:2007.13970Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified (of 7 harvested samples)
-
Split Computing for Complex Object Detectors: Challenges and Preliminary Results 27 Jul 2020 · 2 repositories · arXiv:2007.13312
-
Dynamic Knowledge Distillation for Black-box Hypothesis Transfer Learning 24 Jul 2020 · 0 repositories · arXiv:2007.12355
-
Interpretable Foreground Object Search As Knowledge Distillation 20 Jul 2020 · 0 repositories · arXiv:2007.09867
-
Multi-label Contrastive Predictive Coding 20 Jul 2020 · 0 repositories · arXiv:2007.09852
-
Knowledge Distillation in Deep Learning and its Applications 17 Jul 2020 · 0 repositories · arXiv:2007.09029
-
Self-supervision on Unlabelled OR Data for Multi-person 2D/3D Human Pose Estimation 16 Jul 2020 · 1 repository · arXiv:2007.08354
-
Knowledge Distillation for Multi-task Learning 14 Jul 2020 · 4 repositories · arXiv:2007.06889Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 4 unverified (of 5 harvested samples) · 4 pointer-only (licence)
-
P-KDGAN: Progressive Knowledge Distillation with GANs for One-class Novelty Detection 14 Jul 2020 · 0 repositories · arXiv:2007.06963
-
Unsupervised Multi-Target Domain Adaptation Through Knowledge Distillation 14 Jul 2020 · 1 repository · arXiv:2007.07077
-
Learning to Learn Parameterized Classification Networks for Scalable Input Images 13 Jul 2020 · 1 repository · arXiv:2007.06181
-
RATT: Recurrent Attention to Transient Tasks for Continual Image Captioning 13 Jul 2020 · 2 repositories · arXiv:2007.06271
-
Temporal Self-Ensembling Teacher for Semi-Supervised Object Detection 13 Jul 2020 · 1 repository · arXiv:2007.06144
-
Towards Practical Lipreading with Distilled and Efficient Models 13 Jul 2020 · 1 repository · arXiv:2007.06504
-
Data-Efficient Ranking Distillation for Image Retrieval 10 Jul 2020 · 0 repositories · arXiv:2007.05299
-
Optical Flow Distillation: Towards Efficient and Stable Video Style Transfer 10 Jul 2020 · 0 repositories · arXiv:2007.05146
-
Tracking-by-Trackers with a Distilled and Reinforced Model 8 Jul 2020 · 1 repository · arXiv:2007.04108
-
Robust Re-Identification by Multiple Views Knowledge Distillation 8 Jul 2020 · 1 repository · arXiv:2007.04174
-
Interactive Knowledge Distillation 3 Jul 2020 · 0 repositories · arXiv:2007.01476
-
Knowledge Distillation Beyond Model Compression 3 Jul 2020 · 0 repositories · arXiv:2007.01922
-
CASIA's System for IWSLT 2020 Open Domain Translation 1 Jul 2020 · 0 repositories
-
Exploring the Limits of Simple Learners in Knowledge Distillation for Document Classification with DocBERT 1 Jul 2020 · 0 repositories
-
Improving Event Detection via Open-domain Trigger Knowledge 1 Jul 2020 · 1 repository
-
SimulSpeech: End-to-End Simultaneous Speech to Text Translation 1 Jul 2020 · 0 repositories
-
Extracurricular Learning: Knowledge Transfer Beyond Empirical Distribution 30 Jun 2020 · 0 repositories · arXiv:2007.00051