Methods › General › Knowledge Distillation › Knowledge Distillation › Papers, page 26
Knowledge Distillation
Papers archive 2025-07-28
archive papers tagged: 3,071 · with a code link: 1,258 · where Syntology ran a sample: 320 (276 with a run with no instrument failure, 44 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (320 of 3,071 tagged: 276 with a run with no instrument failure, 44 where every run was a failure of Syntology's instrument)
Page 26 of 31: papers 2,501 to 2,600 of 3,071, newest first by the archive's date (ties by slug), in archive order.
Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code, as “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. It is per sample and not a correctness claim. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from.
-
Intra-Document Cascading: Learning to Select Passages for Neural Document Ranking 20 May 2021 · 1 repository · arXiv:2105.09816
-
Inplace knowledge distillation with teacher assistant for improved training of flexible deep neural networks 18 May 2021 · 0 repositories · arXiv:2105.08369
-
Class-Incremental Few-Shot Object Detection 17 May 2021 · 0 repositories · arXiv:2105.07637
-
AgeFlow: Conditional Age Progression and Regression with Normalizing Flows 15 May 2021 · 1 repository · arXiv:2105.07239Syntology official (archive's flag): 21 ran · 21 ran (of which 11 constructed an object rather than computing a result; 14 with no instrument failure: 3 honoured, 0 violated, 11 with no contract checked; 7 where Syntology's instrument failed) · 2 unverified (of 23 harvested samples) · 23 pointer-only (licence)
-
Boosting Light-Weight Depth Estimation Via Knowledge Distillation 13 May 2021 · 2 repositories · arXiv:2105.06143
-
When Human Pose Estimation Meets Robustness: Adversarial Algorithms and Benchmarks 13 May 2021 · 1 repository · arXiv:2105.06152Syntology official (archive's flag): 6 ran · 14 ran (of which 1 constructed an object rather than computing a result; 7 with no instrument failure: 0 honoured, 0 violated, 7 with no contract checked; 7 where Syntology's instrument failed) · 11 unverified (of 25 harvested samples) · 4 pointer-only (licence)
-
MATE-KD: Masked Adversarial TExt, a Companion to Knowledge Distillation 12 May 2021 · 1 repository · arXiv:2105.05912
-
Stacked Acoustic-and-Textual Encoding: Integrating the Pre-trained Models into Speech Translation Encoders 12 May 2021 · 0 repositories · arXiv:2105.05752
-
Test-Time Adaptation Toward Personalized Speech Enhancement: Zero-Shot Learning with Knowledge Distillation 8 May 2021 · 0 repositories · arXiv:2105.03544
-
Regression Bugs Are In Your Model! Measuring, Reducing and Analyzing Regressions In NLP Model Updates 7 May 2021 · 0 repositories · arXiv:2105.03048
-
Knowledge Distillation for Swedish NER models: A Search for Performance and Efficiency 1 May 2021 · 0 repositories
-
Distilling EEG Representations via Capsules for Affective Computing 30 Apr 2021 · 0 repositories · arXiv:2105.00104
-
Semantic Relation Preserving Knowledge Distillation for Image-to-Image Translation 30 Apr 2021 · 0 repositories · arXiv:2104.15082
-
LIDAR and Position-Aided mmWave Beam Selection with Non-local CNNs and Curriculum Training 29 Apr 2021 · 1 repository · arXiv:2104.14579
-
Spirit Distillation: A Model Compression Method with Multi-domain Knowledge Transfer 29 Apr 2021 · 0 repositories · arXiv:2104.14696
-
Self-distillation with Batch Knowledge Ensembling Improves ImageNet Classification 27 Apr 2021 · 0 repositories · arXiv:2104.13298
-
Distilling Audio-Visual Knowledge by Compositional Contrastive Learning 22 Apr 2021 · 1 repository · arXiv:2104.10955Syntology official: harvested, nothing ran · 0 ran · 1 unverified (of 1 harvested sample)
-
Relational Subsets Knowledge Distillation for Long-tailed Retinal Diseases Recognition 22 Apr 2021 · 0 repositories · arXiv:2104.11057
-
Balanced Knowledge Distillation for Long-tailed Learning 21 Apr 2021 · 1 repository · arXiv:2104.10510Syntology official: harvested, nothing ran · 0 ran · 3 unverified (of 3 harvested samples)
-
Brittle Features May Help Anomaly Detection 21 Apr 2021 · 0 repositories · arXiv:2104.10453
-
Orderly Dual-Teacher Knowledge Distillation for Lightweight Human Pose Estimation 21 Apr 2021 · 0 repositories · arXiv:2104.10414
-
Distill on the Go: Online knowledge distillation in self-supervised learning 20 Apr 2021 · 1 repository · arXiv:2104.09866Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples)
-
EduPal leaves no professor behind: Supporting faculty via a peer-powered recommender system 20 Apr 2021 · 0 repositories · arXiv:2104.12558
-
Knowledge Distillation as Semiparametric Inference 20 Apr 2021 · 1 repository · arXiv:2104.09732Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples)
-
Compact CNN Structure Learning by Knowledge Distillation 19 Apr 2021 · 0 repositories · arXiv:2104.09191
-
On Learning the Geodesic Path for Incremental Learning 17 Apr 2021 · 1 repository · arXiv:2104.08572Syntology 0 ran · 1 unverified (of 1 harvested sample)
-
Ego-Exo: Transferring Visual Representations from Third-person to First-person Videos 16 Apr 2021 · 1 repository · arXiv:2104.07905
-
Continual Learning for Fake Audio Detection 15 Apr 2021 · 0 repositories · arXiv:2104.07286
-
Integration of Pre-trained Networks with Continuous Token Interface for End-to-End Spoken Language Understanding 15 Apr 2021 · 0 repositories · arXiv:2104.07253
-
Annealing Knowledge Distillation 14 Apr 2021 · 1 repository · arXiv:2104.07163
-
Sentence Embeddings by Ensemble Distillation 14 Apr 2021 · 0 repositories · arXiv:2104.06719
-
The Curious Case of Hallucinations in Neural Machine Translation 14 Apr 2021 · 1 repository · arXiv:2104.06683
-
Dealing with Missing Modalities in the Visual Question Answer-Difference Prediction Task through Knowledge Distillation 13 Apr 2021 · 0 repositories · arXiv:2104.05965
-
Source and Target Bidirectional Knowledge Distillation for End-to-end Speech Translation 13 Apr 2021 · 0 repositories · arXiv:2104.06457
-
Class-Balanced Distillation for Long-Tailed Visual Recognition 12 Apr 2021 · 3 repositories · arXiv:2104.05279
-
Dual Discriminator Adversarial Distillation for Data-free Model Compression 12 Apr 2021 · 0 repositories · arXiv:2104.05382
-
Content-Aware GAN Compression 6 Apr 2021 · 1 repository · arXiv:2104.02244Syntology official (archive's flag): 9 ran · 9 ran (of which 5 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 1 violated, 5 with no contract checked; 3 where Syntology's instrument failed) · 7 unverified (of 16 harvested samples)
-
Compressing Visual-linguistic Model via Knowledge Distillation 5 Apr 2021 · 0 repositories · arXiv:2104.02096
-
Knowledge Distillation For Wireless Edge Learning 3 Apr 2021 · 1 repository · arXiv:2104.06374
-
Decentralized and Model-Free Federated Learning: Consensus-Based Distillation in Function Space 1 Apr 2021 · 0 repositories · arXiv:2104.00352
-
Dialect Identification through Adversarial Learning and Knowledge Distillation on Romanian BERT 1 Apr 2021 · 0 repositories
-
Topic Modeling for Maternal Health Using Reddit 1 Apr 2021 · 0 repositories
-
Unsupervised Domain Expansion for Visual Categorization 1 Apr 2021 · 2 repositories · arXiv:2104.00233Syntology community repositories only · 10 ran (of which 0 constructed an object rather than computing a result; 7 with no instrument failure: 0 honoured, 0 violated, 7 with no contract checked; 3 where Syntology's instrument failed) · 1 unverified (of 11 harvested samples) · 1 pointer-only (licence)
-
Fixing the Teacher-Student Knowledge Discrepancy in Distillation 31 Mar 2021 · 0 repositories · arXiv:2103.16844
-
HAD-Net: A Hierarchical Adversarial Knowledge Distillation Network for Improved Enhanced Tumour Segmentation Without Post-Contrast Images 30 Mar 2021 · 1 repository · arXiv:2103.16617
-
Complementary Relation Contrastive Distillation 29 Mar 2021 · 1 repository · arXiv:2103.16367Syntology 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 4 harvested samples) · 4 pointer-only (licence)
-
Industry Scale Semi-Supervised Learning for Natural Language Understanding 29 Mar 2021 · 0 repositories · arXiv:2103.15871
-
Distilling Virtual Examples for Long-tailed Recognition 28 Mar 2021 · 1 repository · arXiv:2103.15042
-
KnowRU: Knowledge Reusing via Knowledge Distillation in Multi-agent Reinforcement Learning 27 Mar 2021 · 0 repositories · arXiv:2103.14891
-
Distilling a Powerful Student Model via Online Knowledge Distillation 26 Mar 2021 · 1 repository · arXiv:2103.14473
-
Leaning Compact and Representative Features for Cross-Modality Person Re-Identification 26 Mar 2021 · 1 repository · arXiv:2103.14210
-
Weakly-Supervised Domain Adaptation of Deep Regression Trackers via Reinforced Knowledge Distillation 26 Mar 2021 · 0 repositories · arXiv:2103.14496
-
Pruning-then-Expanding Model for Domain Adaptation of Neural Machine Translation 25 Mar 2021 · 1 repository · arXiv:2103.13678
-
Spirit Distillation: Precise Real-time Semantic Segmentation of Road Scenes with Insufficient Data 25 Mar 2021 · 0 repositories · arXiv:2103.13733
-
Student Network Learning via Evolutionary Knowledge Distillation 23 Mar 2021 · 0 repositories · arXiv:2103.13811
-
The NLP Cookbook: Modern Recipes for Transformer based Deep Learning Architectures 23 Mar 2021 · 0 repositories · arXiv:2104.10640
-
ROSITA: Refined BERT cOmpreSsion with InTegrAted techniques 21 Mar 2021 · 1 repository · arXiv:2103.11367Syntology official: harvested, nothing ran · 0 ran · 1 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
Compacting Deep Neural Networks for Internet of Things: Methods and Applications 20 Mar 2021 · 0 repositories · arXiv:2103.11083
-
Cost-effective Deployment of BERT Models in Serverless Environment 19 Mar 2021 · 0 repositories · arXiv:2103.10673
-
Online Lifelong Generalized Zero-Shot Learning 19 Mar 2021 · 1 repository · arXiv:2103.10741
-
Variational Knowledge Distillation for Disease Classification in Chest X-Rays 19 Mar 2021 · 0 repositories · arXiv:2103.10825
-
Human-Inspired Multi-Agent Navigation using Knowledge Distillation 18 Mar 2021 · 1 repository · arXiv:2103.10000
-
Self-Supervised Adaptation for Video Super-Resolution 18 Mar 2021 · 1 repository · arXiv:2103.10081
-
Similarity Transfer for Knowledge Distillation 18 Mar 2021 · 0 repositories · arXiv:2103.10047
-
Leveraging Recent Advances in Deep Learning for Audio-Visual Emotion Recognition 16 Mar 2021 · 0 repositories · arXiv:2103.09154
-
Robustly Optimized and Distilled Training for Natural Language Understanding 16 Mar 2021 · 0 repositories · arXiv:2103.08809
-
Refine Myself by Teaching Myself: Feature Refinement via Self-Knowledge Distillation 15 Mar 2021 · 1 repository · arXiv:2103.08273Syntology official (archive's flag): 1 ran · 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified; the one sample that ran constructed an object rather than computing a result (of 3 harvested samples)
-
Robust Model Compression Using Deep Hypotheses 13 Mar 2021 · 1 repository · arXiv:2103.07668
-
A New Training Framework for Deep Neural Network 12 Mar 2021 · 0 repositories · arXiv:2103.07350
-
Beyond Self-Supervision: A Simple Yet Effective Network Distillation Alternative to Improve Backbones 10 Mar 2021 · 2 repositories · arXiv:2103.05959
-
Parser-Free Virtual Try-on via Distilling Appearance Flows 8 Mar 2021 · 2 repositories · arXiv:2103.04559
-
Adaptive Multi-Teacher Multi-level Knowledge Distillation 6 Mar 2021 · 1 repository · arXiv:2103.04062Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 2 harvested samples) · 1 pointer-only (licence)
-
Distributed Dynamic Map Fusion via Federated Learning for Intelligent Networked Vehicles 5 Mar 2021 · 1 repository · arXiv:2103.03786
-
Deep Neural Network Models Compression 4 Mar 2021 · 0 repositories
-
Extract the Knowledge of Graph Neural Networks and Go Beyond it: An Effective Knowledge Distillation Framework 4 Mar 2021 · 1 repository · arXiv:2103.02885Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 1 unverified (of 3 harvested samples) · 3 pointer-only (licence)
-
General Instance Distillation for Object Detection 3 Mar 2021 · 1 repository · arXiv:2103.02340
-
Feature-Align Network with Knowledge Distillation for Efficient Denoising 2 Mar 2021 · 0 repositories · arXiv:2103.01524
-
Embedded Knowledge Distillation in Depth-Level Dynamic Neural Network 1 Mar 2021 · 0 repositories · arXiv:2103.00793
-
Exploring Complementary Strengths of Invariant and Equivariant Representations for Few-Shot Learning 1 Mar 2021 · 1 repository · arXiv:2103.01315Syntology official (archive's flag): 1 ran · 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; the one sample that ran constructed an object rather than computing a result (of 1 harvested sample)
-
Distilling Knowledge via Intermediate Classifiers 28 Feb 2021 · 2 repositories · arXiv:2103.00497
-
Knowledge Distillation Circumvents Nonlinearity for Optical Convolutional Neural Networks 26 Feb 2021 · 0 repositories · arXiv:2102.13323
-
PURSUhInT: In Search of Informative Hint Points Based on Layer Clustering for Knowledge Distillation 26 Feb 2021 · 0 repositories · arXiv:2103.00053
-
Localization Distillation for Dense Object Detection 24 Feb 2021 · 2 repositories · arXiv:2102.12252
-
Multi-View Feature Representation for Dialogue Generation with Bidirectional Distillation 22 Feb 2021 · 0 repositories · arXiv:2102.10780
-
Hierarchical Transformer-based Large-Context End-to-end ASR with Large-Context Knowledge Distillation 16 Feb 2021 · 0 repositories · arXiv:2102.07935
-
CAP-GAN: Towards Adversarial Robustness with Cycle-consistent Attentional Purification 15 Feb 2021 · 0 repositories · arXiv:2102.07304
-
Improved Customer Transaction Classification using Semi-Supervised Knowledge Distillation 15 Feb 2021 · 0 repositories · arXiv:2102.07635
-
Leveraging Acoustic and Linguistic Embeddings from Pretrained speech and language Models for Intent Classification 15 Feb 2021 · 0 repositories · arXiv:2102.07370
-
Self Regulated Learning Mechanism for Data Efficient Knowledge Distillation 14 Feb 2021 · 0 repositories · arXiv:2102.07125
-
Learning Student-Friendly Teacher Networks for Knowledge Distillation 12 Feb 2021 · 0 repositories · arXiv:2102.07650
-
Semantically-Conditioned Negative Samples for Efficient Contrastive Learning 12 Feb 2021 · 0 repositories · arXiv:2102.06603
-
NewsBERT: Distilling Pre-trained Language Model for Intelligent News Application 9 Feb 2021 · 0 repositories · arXiv:2102.04887
-
ML-Doctor: Holistic Risk Assessment of Inference Attacks Against Machine Learning Models 4 Feb 2021 · 1 repository · arXiv:2102.02551Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 2 unverified (of 3 harvested samples)
-
Do Not Forget to Attend to Uncertainty while Mitigating Catastrophic Forgetting 3 Feb 2021 · 0 repositories · arXiv:2102.01906
-
Evolutionary Generative Adversarial Networks with Crossover Based Knowledge Distillation 27 Jan 2021 · 1 repository · arXiv:2101.11186
-
ISP Distillation 25 Jan 2021 · 0 repositories · arXiv:2101.10203
-
Memory-Efficient Semi-Supervised Continual Learning: The World is its Own Replay Buffer 23 Jan 2021 · 1 repository · arXiv:2101.09536Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)
-
Network-Agnostic Knowledge Transfer for Medical Image Segmentation 23 Jan 2021 · 0 repositories · arXiv:2101.09560
-
Bridging the gap between Human Action Recognition and Online Action Detection 21 Jan 2021 · 0 repositories · arXiv:2101.08851
-
Collaborative Teacher-Student Learning via Multiple Knowledge Transfer 21 Jan 2021 · 0 repositories · arXiv:2101.08471