Methods › General › Knowledge Distillation › Knowledge Distillation › Papers, page 25
Knowledge Distillation
Papers archive 2025-07-28
archive papers tagged: 3,071 · with a code link: 1,258 · where Syntology ran a sample: 320 (276 with a run with no instrument failure, 44 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (320 of 3,071 tagged: 276 with a run with no instrument failure, 44 where every run was a failure of Syntology's instrument)
Page 25 of 31: papers 2,401 to 2,500 of 3,071, newest first by the archive's date (ties by slug), in archive order.
Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code, as “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. It is per sample and not a correctness claim. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from.
-
MS-KD: Multi-Organ Segmentation with Multiple Binary-Labeled Datasets 5 Aug 2021 · 0 repositories · arXiv:2108.02559
-
Learning Compatible Embeddings 4 Aug 2021 · 1 repository · arXiv:2108.01958Syntology official (archive's flag): 1 ran · 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; the one sample that ran constructed an object rather than computing a result (of 1 harvested sample) · 1 pointer-only (licence)
-
Online Knowledge Distillation for Efficient Pose Estimation 4 Aug 2021 · 1 repository · arXiv:2108.02092Syntology official (archive's flag): 2 ran · 2 ran (of which 2 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; every one of the 2 samples that ran constructed an object rather than computing a result (of 2 harvested samples) · 2 pointer-only (licence)
-
Semi-Supervising Learning, Transfer Learning, and Knowledge Distillation with SimCLR 2 Aug 2021 · 0 repositories · arXiv:2108.00587
-
In-Batch Negatives for Knowledge Distillation with Tightly-Coupled Teachers for Dense Retrieval 1 Aug 2021 · 0 repositories
-
Multi-Strategy Knowledge Distillation Based Teacher-Student Framework for Machine Reading Comprehension 1 Aug 2021 · 0 repositories
-
NAIST English-to-Japanese Simultaneous Translation System for IWSLT 2021 Simultaneous Text-to-text Task 1 Aug 2021 · 0 repositories
-
On Knowledge Distillation for Translating Erroneous Speech Transcriptions 1 Aug 2021 · 0 repositories
-
POS-Constrained Parallel Decoding for Non-autoregressive Generation 1 Aug 2021 · 1 repository
-
Trigger is Not Sufficient: Exploiting Frame-aware Knowledge for Implicit Event Argument Extraction 1 Aug 2021 · 0 repositories
-
Pose-Guided Feature Learning with Knowledge Distillation for Occluded Person Re-Identification 31 Jul 2021 · 0 repositories · arXiv:2108.00139
-
QuPeD: Quantized Personalization via Distillation with Applications to Federated Learning 29 Jul 2021 · 0 repositories · arXiv:2107.13892
-
Using Perturbed Length-aware Positional Encoding for Non-autoregressive Neural Machine Translation 29 Jul 2021 · 0 repositories · arXiv:2107.13689
-
Text is Text, No Matter What: Unifying Text Recognition using Knowledge Distillation 26 Jul 2021 · 0 repositories · arXiv:2107.12087
-
ROD: Reception-aware Online Distillation for Sparse Graphs 25 Jul 2021 · 1 repository · arXiv:2107.11789
-
Follow Your Path: a Progressive Method for Knowledge Distillation 20 Jul 2021 · 0 repositories · arXiv:2107.09305
-
Learning ULMFiT and Self-Distillation with Calibration for Medical Dialogue System 20 Jul 2021 · 0 repositories · arXiv:2107.09625
-
Double Similarity Distillation for Semantic Image Segmentation 19 Jul 2021 · 0 repositories · arXiv:2107.08591
-
Federated Action Recognition on Heterogeneous Embedded Devices 18 Jul 2021 · 0 repositories · arXiv:2107.12147
-
Scene-adaptive Knowledge Distillation for Sequential Recommendation via Differentiable Architecture Search 15 Jul 2021 · 0 repositories · arXiv:2107.07173
-
Improving Speech Translation by Understanding and Learning from the Auxiliary Text Translation Task 12 Jul 2021 · 0 repositories · arXiv:2107.05782
-
Technical Report of Team GraphMIRAcles in the WikiKG90M-LSC Track of OGB-LSC @ KDD Cup 2021 12 Jul 2021 · 0 repositories · arXiv:2107.05476
-
Contrast R-CNN for Continual Learning in Object Detection 11 Jul 2021 · 0 repositories · arXiv:2108.04224
-
Consensual Collaborative Training And Knowledge Distillation Based Facial Expression Recognition Under Noisy Annotations 10 Jul 2021 · 3 repositories · arXiv:2107.04746
-
Lifelong Twin Generative Adversarial Networks 9 Jul 2021 · 0 repositories · arXiv:2107.04708
-
Categorical Relation-Preserving Contrastive Knowledge Distillation for Medical Image Classification 7 Jul 2021 · 1 repository · arXiv:2107.03225
-
Novel Visual Category Discovery with Dual Ranking Statistics and Mutual Knowledge Distillation 7 Jul 2021 · 0 repositories · arXiv:2107.03358
-
WeClick: Weakly-Supervised Video Semantic Segmentation with Click Annotations 7 Jul 2021 · 0 repositories · arXiv:2107.03088
-
Confidence Conditioned Knowledge Distillation 6 Jul 2021 · 0 repositories · arXiv:2107.06993
-
CoReD: Generalizing Fake Media Detection with Continual Representation using Distillation 6 Jul 2021 · 2 repositories · arXiv:2107.02408Syntology 8 ran (of which 0 constructed an object rather than computing a result; 8 with no instrument failure: 0 honoured, 0 violated, 8 with no contract checked; 0 where Syntology's instrument failed) · 7 unverified (of 15 harvested samples) · 5 pointer-only (licence)
-
Embracing the Dark Knowledge: Domain Generalization Using Regularized Knowledge Distillation 6 Jul 2021 · 0 repositories · arXiv:2107.02629
-
A Light-weight Deep Human Activity Recognition Algorithm Using Multi-knowledge Distillation 6 Jul 2021 · 0 repositories · arXiv:2107.07331
-
VidLanKD: Improving Language Understanding via Video-Distilled Knowledge Transfer 6 Jul 2021 · 1 repository · arXiv:2107.02681
-
Continual Contrastive Learning for Image Classification 5 Jul 2021 · 1 repository · arXiv:2107.01776Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 2 where Syntology's instrument failed) · 1 unverified (of 5 harvested samples)
-
On The Distribution of Penultimate Activations of Classification Networks 5 Jul 2021 · 0 repositories · arXiv:2107.01900
-
Audio-Oriented Multimodal Machine Comprehension: Task, Dataset and Model 4 Jul 2021 · 0 repositories · arXiv:2107.01571
-
Learning Efficient Vision Transformers via Fine-Grained Manifold Distillation 3 Jul 2021 · 1 repository · arXiv:2107.01378
-
Isotonic Data Augmentation for Knowledge Distillation 3 Jul 2021 · 0 repositories · arXiv:2107.01412
-
Pool of Experts: Realtime Querying Specialized Knowledge in Massive Neural Networks 3 Jul 2021 · 2 repositories · arXiv:2107.01354
-
Split-and-Bridge: Adaptable Class Incremental Learning within a Single Neural Network 3 Jul 2021 · 1 repository · arXiv:2107.01349Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 4 unverified (of 5 harvested samples) · 5 pointer-only (licence)
-
ESPnet-ST IWSLT 2021 Offline Speech Translation System 1 Jul 2021 · 0 repositories · arXiv:2107.00636
-
Revisiting Knowledge Distillation: An Inheritance and Exploration Framework 1 Jul 2021 · 1 repository · arXiv:2107.00181
-
Local-Global Knowledge Distillation in Heterogeneous Federated Learning with Non-IID Data 30 Jun 2021 · 0 repositories · arXiv:2107.00051
-
Learning without Forgetting for 3D Point Cloud Objects 27 Jun 2021 · 1 repository · arXiv:2106.14275
-
Reward-Based 1-bit Compressed Federated Distillation on Blockchain 27 Jun 2021 · 0 repositories · arXiv:2106.14265
-
Adapt-and-Distill: Developing Small, Fast and Effective Pretrained Language Models for Domains 25 Jun 2021 · 0 repositories · arXiv:2106.13474
-
PQK: Model Compression via Pruning, Quantization, and Knowledge Distillation 25 Jun 2021 · 0 repositories · arXiv:2106.14681
-
DnS: Distill-and-Select for Efficient and Accurate Video Indexing and Retrieval 24 Jun 2021 · 1 repository · arXiv:2106.13266Syntology official: harvested, nothing ran · 0 ran · 1 unverified (of 1 harvested sample)
-
Dealing with training and test segmentation mismatch: FBK@IWSLT2021 23 Jun 2021 · 0 repositories · arXiv:2106.12607
-
SSUL: Semantic Segmentation with Unknown Label for Exemplar-based Class-Incremental Learning 22 Jun 2021 · 1 repository · arXiv:2106.11562Syntology official (archive's flag): 6 ran · 6 ran (of which 6 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 0 where Syntology's instrument failed) · 6 unverified; every one of the 6 samples that ran constructed an object rather than computing a result (of 12 harvested samples) · 12 pointer-only (licence)
-
Knowledge Distillation via Instance-level Sequence Learning 21 Jun 2021 · 0 repositories · arXiv:2106.10885
-
Structured Sparse R-CNN for Direct Scene Graph Generation 21 Jun 2021 · 4 repositories · arXiv:2106.10815Syntology official: no sample here; runs from other or unrecorded repositories · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
CapsuleRRT: Relationships-Aware Regression Tracking via Capsules 19 Jun 2021 · 0 repositories
-
Cross Modality Knowledge Distillation for Multi-Modal Aerial View Object Classification 19 Jun 2021 · 1 repository
-
Learning Student Networks in the Wild 19 Jun 2021 · 1 repository
-
Minimally Invasive Surgery for Sparse Neural Networks in Contrastive Manner 19 Jun 2021 · 0 repositories
-
Space-Time Distillation for Video Super-Resolution 19 Jun 2021 · 0 repositories
-
Tree-Like Decision Distillation 19 Jun 2021 · 0 repositories
-
Dual-Teacher Class-Incremental Learning With Data-Free Generative Replay 17 Jun 2021 · 0 repositories · arXiv:2106.09835
-
Topology Distillation for Recommender System 16 Jun 2021 · 0 repositories · arXiv:2106.08700
-
Simon Says: Evaluating and Mitigating Bias in Pruned Neural Networks with Knowledge Distillation 15 Jun 2021 · 1 repository · arXiv:2106.07849Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 2 where Syntology's instrument failed) · 3 unverified (of 7 harvested samples) · 1 pointer-only (licence)
-
CoDERT: Distilling Encoder Representations with Co-learning for Transducer-based Speech Recognition 14 Jun 2021 · 0 repositories · arXiv:2106.07734
-
Context-Aware Image Inpainting with Learned Semantic Priors 14 Jun 2021 · 1 repository · arXiv:2106.07220
-
Energy-efficient Knowledge Distillation for Spiking Neural Networks 14 Jun 2021 · 0 repositories · arXiv:2106.07172
-
Guiding Teacher Forcing with Seer Forcing for Neural Machine Translation 12 Jun 2021 · 0 repositories · arXiv:2106.06751Syntology 4 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 5 harvested samples) · 5 pointer-only (licence)
-
LENAS: Learning-based Neural Architecture Search and Ensemble for 3D Radiotherapy Dose Prediction 12 Jun 2021 · 1 repository · arXiv:2106.06733
-
Generate, Annotate, and Learn: NLP with Synthetic Text 11 Jun 2021 · 1 repository · arXiv:2106.06168Syntology official (archive's flag): 1 ran · 3 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples) · 3 pointer-only (licence)
-
RefBERT: Compressing BERT by Referencing to Pre-computed Representations 11 Jun 2021 · 0 repositories · arXiv:2106.08898
-
Does Knowledge Distillation Really Work? 10 Jun 2021 · 2 repositories · arXiv:2106.05945Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)
-
Marginal Utility Diminishes: Exploring the Minimum Knowledge for BERT Knowledge Distillation 10 Jun 2021 · 1 repository · arXiv:2106.05691Syntology official: harvested, nothing ran · 0 ran · 1 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
Distilling Image Classifiers in Object Detectors 9 Jun 2021 · 1 repository · arXiv:2106.05209
-
Knowledge distillation: A good teacher is patient and consistent 9 Jun 2021 · 10 repositories · arXiv:2106.05237
-
Learning by Distillation: A Self-Supervised Learning Framework for Optical Flow Estimation 8 Jun 2021 · 0 repositories · arXiv:2106.04195
-
BERT Learns to Teach: Knowledge Distillation with Meta Learning 8 Jun 2021 · 1 repository · arXiv:2106.04570Syntology official (archive's flag): 4 ran · 5 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 3 where Syntology's instrument failed) · 4 unverified (of 9 harvested samples) · 2 pointer-only (licence)
-
XtremeDistilTransformers: Task Transfer for Task-agnostic Distillation 8 Jun 2021 · 1 repository · arXiv:2106.04563
-
RoSearch: Search for Robust Student Architectures When Distilling Pre-trained Language Models 7 Jun 2021 · 0 repositories · arXiv:2106.03613
-
ERNIE-Tiny : A Progressive Distillation Framework for Pretrained Transformer Compression 4 Jun 2021 · 1 repository · arXiv:2106.02241
-
Not All Knowledge Is Created Equal: Mutual Distillation of Confident Knowledge 2 Jun 2021 · 0 repositories · arXiv:2106.01489
-
One Teacher is Enough? Pre-trained Language Model Distillation from Multiple Teachers 2 Jun 2021 · 0 repositories · arXiv:2106.01023
-
Claim Matching Beyond English to Scale Global Fact-Checking 1 Jun 2021 · 0 repositories · arXiv:2106.00853
-
Continual Learning for Neural Machine Translation 1 Jun 2021 · 0 repositories
-
Cost-effective Deployment of BERT Models in Serverless Environment 1 Jun 2021 · 0 repositories
-
Modality-specific Distillation 1 Jun 2021 · 0 repositories
-
Multi-Grained Knowledge Distillation for Named Entity Recognition 1 Jun 2021 · 0 repositories
-
Natural Statistics of Network Activations and Implications for Knowledge Distillation 1 Jun 2021 · 0 repositories · arXiv:2106.00368
-
Towards Quantifiable Dialogue Coherence Evaluation 1 Jun 2021 · 1 repository · arXiv:2106.00507
-
Greedy-layer Pruning: Speeding up Transformer Models for Natural Language Processing 31 May 2021 · 1 repository · arXiv:2105.14839
-
FReTAL: Generalizing Deepfake Detection using Knowledge Distillation and Representation Learning 28 May 2021 · 0 repositories · arXiv:2105.13617
-
Knowledge Inheritance for Pre-trained Language Models 28 May 2021 · 2 repositories · arXiv:2105.13880
-
Not Far Away, Not So Close: Sample Efficient Nearest Neighbour Data Augmentation via MiniMax 28 May 2021 · 1 repository · arXiv:2105.13608
-
Transformer-Based Source-Free Domain Adaptation 28 May 2021 · 1 repository · arXiv:2105.14138
-
Fair Feature Distillation for Visual Recognition 27 May 2021 · 0 repositories · arXiv:2106.04411
-
How Does Distilled Data Complexity Impact the Quality and Confidence of Non-Autoregressive Machine Translation? 27 May 2021 · 0 repositories · arXiv:2105.12900
-
Joint-DetNAS: Upgrade Your Detector with NAS, Pruning and Dynamic Distillation 27 May 2021 · 0 repositories · arXiv:2105.12971
-
Selective Knowledge Distillation for Neural Machine Translation 27 May 2021 · 1 repository · arXiv:2105.12967Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 5 harvested samples) · 5 pointer-only (licence)
-
KnowSR: Knowledge Sharing among Homogeneous Agents in Multi-agent Reinforcement Learning 25 May 2021 · 0 repositories · arXiv:2105.11611
-
AirNet: Neural Network Transmission over the Air 24 May 2021 · 0 repositories · arXiv:2105.11166
-
Experimenting with Knowledge Distillation techniques for performing Brain Tumor Segmentation 24 May 2021 · 0 repositories · arXiv:2105.11486
-
Backdoor Attacks on Self-Supervised Learning 21 May 2021 · 2 repositories · arXiv:2105.10123Syntology official (archive's flag): 9 ran · 11 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 1 honoured, 0 violated, 4 with no contract checked; 6 where Syntology's instrument failed) · 2 unverified (of 13 harvested samples) · 8 pointer-only (licence)
-
Data-Free Knowledge Distillation for Heterogeneous Federated Learning 20 May 2021 · 4 repositories · arXiv:2105.10056