Browse State-of-the-Art › Knowledge Distillation › Papers, page 39

Knowledge Distillation

Papers archive 2025-07-28

archive papers tagged: 4,240 · with a code link: 1,740 · where Syntology ran a sample: 451 (380 with a run with no instrument failure, 71 where every run was a failure of Syntology's instrument) Syntology

Show: all tagged papersonly where code ran (451 of 4,240 tagged: 380 with a run with no instrument failure, 71 where every run was a failure of Syntology's instrument)

Page 39 of 43: papers 3,801 to 3,900 of 4,240, in archive order: by repositories listed in the archive (most first), then newest first, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers that list no repository come after every paper that lists one.

Papers without a page here are shown as plain text. A Syntology line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the figure “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code); hover it for the repositories the samples that ran came from. Abstracts are on each paper's page.

• Transformer-based ASR Incorporating Time-reduction Layer and Fine-tuning with Self-Knowledge Distillation
  17 Mar 2021 0 repositories listed
• Leveraging Recent Advances in Deep Learning for Audio-Visual Emotion Recognition
  16 Mar 2021 0 repositories listed
• Robustly Optimized and Distilled Training for Natural Language Understanding
  16 Mar 2021 0 repositories listed
• A New Training Framework for Deep Neural Network
  12 Mar 2021 0 repositories listed
• Semantic-aware Knowledge Distillation for Few-Shot Class-Incremental Learning
  6 Mar 2021 0 repositories listed
• Deep Neural Network Models Compression
  4 Mar 2021 0 repositories listed
• Feature-Align Network with Knowledge Distillation for Efficient Denoising
  2 Mar 2021 0 repositories listed
• Embedded Knowledge Distillation in Depth-Level Dynamic Neural Network
  1 Mar 2021 0 repositories listed
• Alignment Knowledge Distillation for Online Streaming Attention-based Speech Recognition
  28 Feb 2021 0 repositories listed
• Knowledge Distillation Circumvents Nonlinearity for Optical Convolutional Neural Networks
  26 Feb 2021 0 repositories listed
• PURSUhInT: In Search of Informative Hint Points Based on Layer Clustering for Knowledge Distillation
  26 Feb 2021 0 repositories listed
• Enhancing Data-Free Adversarial Distillation with Activation Regularization and Virtual Interpolation
  23 Feb 2021 0 repositories listed
• Multi-View Feature Representation for Dialogue Generation with Bidirectional Distillation
  22 Feb 2021 0 repositories listed
• Exploring Knowledge Distillation of a Deep Neural Network for Multi-Script identification
  20 Feb 2021 0 repositories listed
• End-to-End Automatic Speech Recognition with Deep Mutual Learning
  16 Feb 2021 0 repositories listed
• Hierarchical Transformer-based Large-Context End-to-end ASR with Large-Context Knowledge Distillation
  16 Feb 2021 0 repositories listed
• CAP-GAN: Towards Adversarial Robustness with Cycle-consistent Attentional Purification
  15 Feb 2021 0 repositories listed
• Improved Customer Transaction Classification using Semi-Supervised Knowledge Distillation
  15 Feb 2021 0 repositories listed
• Leveraging Acoustic and Linguistic Embeddings from Pretrained speech and language Models for Intent Classification
  15 Feb 2021 0 repositories listed
• Self Regulated Learning Mechanism for Data Efficient Knowledge Distillation
  14 Feb 2021 0 repositories listed
• Learning Student-Friendly Teacher Networks for Knowledge Distillation
  12 Feb 2021 0 repositories listed
• Semantically-Conditioned Negative Samples for Efficient Contrastive Learning
  12 Feb 2021 0 repositories listed
• NewsBERT: Distilling Pre-trained Language Model for Intelligent News Application
  9 Feb 2021 0 repositories listed
• Do Not Forget to Attend to Uncertainty while Mitigating Catastrophic Forgetting
  3 Feb 2021 0 repositories listed
• ISP Distillation
  25 Jan 2021 0 repositories listed
• Network-Agnostic Knowledge Transfer for Medical Image Segmentation
  23 Jan 2021 0 repositories listed
• Bridging the gap between Human Action Recognition and Online Action Detection
  21 Jan 2021 0 repositories listed
• Collaborative Teacher-Student Learning via Multiple Knowledge Transfer
  21 Jan 2021 0 repositories listed
• Deep Epidemiological Modeling by Black-box Knowledge Distillation: An Accurate Deep Learning Model for COVID-19
  20 Jan 2021 0 repositories listed
• Learning to Augment for Data-Scarce Domain BERT Knowledge Distillation
  20 Jan 2021 0 repositories listed Syntology 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 13 unverified (of 15 harvested samples) · 15 pointer-only (licence)
• Incremental Knowledge Based Question Answering
  18 Jan 2021 0 repositories listed
• Knowledge Distillation Methods for Efficient Unsupervised Adaptation Across Multiple Domains
  18 Jan 2021 0 repositories listed
• Mining Data Impressions from Deep Models as Substitute for the Unavailable Training Data
  15 Jan 2021 0 repositories listed
• KDLSQ-BERT: A Quantized Bert Combining Knowledge Distillation with Learned Step Size Quantization
  15 Jan 2021 0 repositories listed
• Interpretable discovery of new semiconductors with machine learning
  12 Jan 2021 0 repositories listed
• Resolution-Based Distillation for Efficient Histology Image Classification
  11 Jan 2021 0 repositories listed
• Adversarially Robust and Explainable Model Compression with On-Device Personalization for Text Classification
  10 Jan 2021 0 repositories listed
• MSD: Saliency-aware Knowledge Distillation for Multimodal Understanding
  6 Jan 2021 0 repositories listed
• Label Augmentation via Time-based Knowledge Distillation for Financial Anomaly Detection
  5 Jan 2021 0 repositories listed
• Active Learning for Lane Detection: A Knowledge Distillation Approach
  1 Jan 2021 0 repositories listed
• Can Students Outperform Teachers in Knowledge Distillation based Model Compression?
  1 Jan 2021 0 repositories listed
• Contextual Knowledge Distillation for Transformer Compression
  1 Jan 2021 0 repositories listed
• Disentanglement, Visualization and Analysis of Complex Features in DNNs
  1 Jan 2021 0 repositories listed
• Don't be picky, all students in the right family can learn from good teachers
  1 Jan 2021 0 repositories listed
• Explicit Connection Distillation
  1 Jan 2021 0 repositories listed
• FLAR: A Unified Prototype Framework for Few-Sample Lifelong Active Recognition
  1 Jan 2021 0 repositories listed
• Improving De-Raining Generalization via Neural Reorganization
  1 Jan 2021 0 repositories listed
• Kernel Methods in Hyperbolic Spaces
  1 Jan 2021 0 repositories listed
• Knowledge Distillation based Ensemble Learning for Neural Machine Translation
  1 Jan 2021 0 repositories listed
• Knowledge distillation via softmax regression representation learning
  1 Jan 2021 0 repositories listed
• Learning from deep model via exploring local targets
  1 Jan 2021 0 repositories listed
• Long Live the Lottery: The Existence of Winning Tickets in Lifelong Learning
  1 Jan 2021 0 repositories listed
• Rethinking Soft Labels for Knowledge Distillation: A Bias–Variance Tradeoff Perspective
  1 Jan 2021 0 repositories listed
• Robust Overfitting may be mitigated by properly learned smoothening
  1 Jan 2021 0 repositories listed
• Student Customized Knowledge Distillation: Bridging the Gap Between Student and Teacher
  1 Jan 2021 0 repositories listed
• Understanding Adversarial Attacks on Autoencoders
  1 Jan 2021 0 repositories listed
• Understanding Knowledge Distillation
  1 Jan 2021 0 repositories listed
• Unpaired Learning for Deep Image Deraining With Rain Direction Regularizer
  1 Jan 2021 0 repositories listed
• Fully Synthetic Data Improves Neural Machine Translation with Knowledge Distillation
  31 Dec 2020 0 repositories listed
• Towards Zero-Shot Knowledge Distillation for Natural Language Processing
  31 Dec 2020 0 repositories listed
• Knowledge Distillation with Adaptive Asymmetric Label Sharpening for Semi-supervised Fracture Detection in Chest X-rays
  30 Dec 2020 0 repositories listed
• Understanding and Improving Lexical Choice in Non-Autoregressive Translation
  29 Dec 2020 0 repositories listed
• ALP-KD: Attention-Based Layer Projection for Knowledge Distillation
  27 Dec 2020 0 repositories listed
• Towards a Universal Continuous Knowledge Base
  25 Dec 2020 0 repositories listed
• Future-Guided Incremental Transformer for Simultaneous Translation
  23 Dec 2020 0 repositories listed
• AttentionLite: Towards Efficient Self-Attention Models for Vision
  21 Dec 2020 0 repositories listed
• Diverse Knowledge Distillation for End-to-End Person Search
  21 Dec 2020 0 repositories listed
• Towards Understanding Ensemble, Knowledge Distillation and Self-Distillation in Deep Learning
  17 Dec 2020 0 repositories listed
• Distilling Optimal Neural Networks: Rapid Search in Diverse Spaces
  16 Dec 2020 0 repositories listed
• Wasserstein Contrastive Representation Distillation
  15 Dec 2020 0 repositories listed
• LRC-BERT: Latent-representation Contrastive Knowledge Distillation for Natural Language Understanding
  14 Dec 2020 0 repositories listed
• Periocular Embedding Learning with Consistent Knowledge Distillation from Face
  12 Dec 2020 0 repositories listed
• Improving Task-Agnostic BERT Distillation with Layer Mapping Search
  11 Dec 2020 0 repositories listed
• Reinforced Multi-Teacher Selection for Knowledge Distillation
  11 Dec 2020 0 repositories listed
• Large-Scale Generative Data-Free Distillation
  10 Dec 2020 0 repositories listed
• Model Compression Using Optimal Transport
  7 Dec 2020 0 repositories listed
• Multi-head Knowledge Distillation for Model Compression
  5 Dec 2020 0 repositories listed
• Classification Under Misspecification: Halfspaces, Generalized Linear Models, and Evolvability
  1 Dec 2020 0 repositories listed
• Query Distillation: BERT-based Distillation for Ensemble Ranking
  1 Dec 2020 0 repositories listed
• Reverse-engineering recurrent neural network solutions to a hierarchical inference task for mice
  1 Dec 2020 0 repositories listed
• Self-Supervised Generative Adversarial Compression
  1 Dec 2020 0 repositories listed
• Solvable Model for Inheriting the Regularization through Knowledge Distillation
  1 Dec 2020 0 repositories listed
• A Selective Survey on Versatile Knowledge Distillation Paradigm for Neural Network Models
  30 Nov 2020 0 repositories listed
• Real-time Spatio-temporal Action Localization via Learning Motion Representation
  30 Nov 2020 0 repositories listed
• Adaptive Multiplane Image Generation from a Single Internet Picture
  26 Nov 2020 0 repositories listed
• Generative Adversarial Simulator
  23 Nov 2020 0 repositories listed
• MixMix: All You Need for Data-Free Compression Are Feature and Data Mixing
  19 Nov 2020 0 repositories listed
• Effectiveness of Arbitrary Transfer Sets for Data-free Knowledge Distillation
  18 Nov 2020 0 repositories listed
• Privileged Knowledge Distillation for Online Action Detection
  18 Nov 2020 0 repositories listed
• Deep Serial Number: Computational Watermarking for DNN Intellectual Property Protection
  17 Nov 2020 0 repositories listed
• Digging Deeper into CRNN Model in Chinese Text Images Recognition
  17 Nov 2020 0 repositories listed
• Generalized Continual Zero-Shot Learning
  17 Nov 2020 0 repositories listed
• On Estimating the Training Cost of Conversational Recommendation Systems
  10 Nov 2020 0 repositories listed
• Ensemble Knowledge Distillation for CTR Prediction
  8 Nov 2020 0 repositories listed
• Human-Like Active Learning: Machines Simulating the Human Learning Process
  7 Nov 2020 0 repositories listed
• Channel Planting for Deep Neural Networks using Knowledge Distillation
  4 Nov 2020 0 repositories listed
• On Self-Distilling Graph Neural Network
  4 Nov 2020 0 repositories listed
• Paralinguistic Privacy Protection at the Edge
  4 Nov 2020 0 repositories listed
• Learning to Maximize Speech Quality Directly Using MOS Prediction for Neural Text-to-Speech
  2 Nov 2020 0 repositories listed
• Bridging the Gap between Prior and Posterior Knowledge Selection for Knowledge-Grounded Dialogue Generation
  1 Nov 2020 0 repositories listed

Syntology lines on 1 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced; each line links to that paper's sample list. Syntology's record for this page has not changed since 2026-09-28, the first build that kept a record date for it; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.