Browse State-of-the-Art › Knowledge Distillation › Papers, page 38

Knowledge Distillation

Papers archive 2025-07-28

archive papers tagged: 4,240 · with a code link: 1,740 · where Syntology ran a sample: 451 (380 with a run with no instrument failure, 71 where every run was a failure of Syntology's instrument) Syntology

Show: all tagged papersonly where code ran (451 of 4,240 tagged: 380 with a run with no instrument failure, 71 where every run was a failure of Syntology's instrument)

Page 38 of 43: papers 3,701 to 3,800 of 4,240, in archive order: by repositories listed in the archive (most first), then newest first, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers that list no repository come after every paper that lists one.

Papers without a page here are shown as plain text. A Syntology line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the figure “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code); hover it for the repositories the samples that ran came from. Abstracts are on each paper's page.

• Confidence Conditioned Knowledge Distillation
  6 Jul 2021 0 repositories listed
• Embracing the Dark Knowledge: Domain Generalization Using Regularized Knowledge Distillation
  6 Jul 2021 0 repositories listed
• A Light-weight Deep Human Activity Recognition Algorithm Using Multi-knowledge Distillation
  6 Jul 2021 0 repositories listed
• On The Distribution of Penultimate Activations of Classification Networks
  5 Jul 2021 0 repositories listed
• Audio-Oriented Multimodal Machine Comprehension: Task, Dataset and Model
  4 Jul 2021 0 repositories listed
• Isotonic Data Augmentation for Knowledge Distillation
  3 Jul 2021 0 repositories listed
• ESPnet-ST IWSLT 2021 Offline Speech Translation System
  1 Jul 2021 0 repositories listed
• Local-Global Knowledge Distillation in Heterogeneous Federated Learning with Non-IID Data
  30 Jun 2021 0 repositories listed
• Reward-Based 1-bit Compressed Federated Distillation on Blockchain
  27 Jun 2021 0 repositories listed
• Adapt-and-Distill: Developing Small, Fast and Effective Pretrained Language Models for Domains
  25 Jun 2021 0 repositories listed
• PQK: Model Compression via Pruning, Quantization, and Knowledge Distillation
  25 Jun 2021 0 repositories listed
• Dealing with training and test segmentation mismatch: FBK@IWSLT2021
  23 Jun 2021 0 repositories listed
• Efficient Inference via Universal LSH Kernel
  21 Jun 2021 0 repositories listed
• Knowledge Distillation via Instance-level Sequence Learning
  21 Jun 2021 0 repositories listed
• CapsuleRRT: Relationships-Aware Regression Tracking via Capsules
  19 Jun 2021 0 repositories listed
• Data-Free Knowledge Distillation for Image Super-Resolution
  19 Jun 2021 0 repositories listed
• Minimally Invasive Surgery for Sparse Neural Networks in Contrastive Manner
  19 Jun 2021 0 repositories listed
• Positive-Unlabeled Data Purification in the Wild for Object Detection
  19 Jun 2021 0 repositories listed
• Space-Time Distillation for Video Super-Resolution
  19 Jun 2021 0 repositories listed
• Teacher's pet: understanding and mitigating biases in distillation
  19 Jun 2021 0 repositories listed
• Tree-Like Decision Distillation
  19 Jun 2021 0 repositories listed
• Recurrent Stacking of Layers in Neural Networks: An Application to Neural Machine Translation
  18 Jun 2021 0 repositories listed
• Dual-Teacher Class-Incremental Learning With Data-Free Generative Replay
  17 Jun 2021 0 repositories listed
• Dynamic Knowledge Distillation With Noise Elimination for RGB-D Salient Object Detection
  17 Jun 2021 0 repositories listed
• Knowledge distillation from multi-modal to mono-modal segmentation networks
  17 Jun 2021 0 repositories listed
• Topology Distillation for Recommender System
  16 Jun 2021 0 repositories listed
• CoDERT: Distilling Encoder Representations with Co-learning for Transducer-based Speech Recognition
  14 Jun 2021 0 repositories listed
• Energy-efficient Knowledge Distillation for Spiking Neural Networks
  14 Jun 2021 0 repositories listed
• Guiding Teacher Forcing with Seer Forcing for Neural Machine Translation
  12 Jun 2021 0 repositories listed Syntology 4 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 5 harvested samples) · 5 pointer-only (licence)
• RefBERT: Compressing BERT by Referencing to Pre-computed Representations
  11 Jun 2021 0 repositories listed
• AKE-GNN: Effective Graph Learning with Adaptive Knowledge Exchange
  10 Jun 2021 0 repositories listed
• Learning by Distillation: A Self-Supervised Learning Framework for Optical Flow Estimation
  8 Jun 2021 0 repositories listed
• RoSearch: Search for Robust Student Architectures When Distilling Pre-trained Language Models
  7 Jun 2021 0 repositories listed
• MergeDistill: Merging Pre-trained Language Models using Distillation
  5 Jun 2021 0 repositories listed
• Not All Knowledge Is Created Equal: Mutual Distillation of Confident Knowledge
  2 Jun 2021 0 repositories listed
• One Teacher is Enough? Pre-trained Language Model Distillation from Multiple Teachers
  2 Jun 2021 0 repositories listed
• Claim Matching Beyond English to Scale Global Fact-Checking
  1 Jun 2021 0 repositories listed
• Continual Learning for Neural Machine Translation
  1 Jun 2021 0 repositories listed
• Cost-effective Deployment of BERT Models in Serverless Environment
  1 Jun 2021 0 repositories listed
• Modality-specific Distillation
  1 Jun 2021 0 repositories listed
• Multi-Grained Knowledge Distillation for Named Entity Recognition
  1 Jun 2021 0 repositories listed
• Natural Statistics of Network Activations and Implications for Knowledge Distillation
  1 Jun 2021 0 repositories listed
• Reinforced Iterative Knowledge Distillation for Cross-Lingual Named Entity Recognition
  1 Jun 2021 0 repositories listed
• FReTAL: Generalizing Deepfake Detection using Knowledge Distillation and Representation Learning
  28 May 2021 0 repositories listed
• Fair Feature Distillation for Visual Recognition
  27 May 2021 0 repositories listed
• How Does Distilled Data Complexity Impact the Quality and Confidence of Non-Autoregressive Machine Translation?
  27 May 2021 0 repositories listed
• Joint-DetNAS: Upgrade Your Detector with NAS, Pruning and Dynamic Distillation
  27 May 2021 0 repositories listed
• Towards Understanding Knowledge Distillation
  27 May 2021 0 repositories listed
• KnowSR: Knowledge Sharing among Homogeneous Agents in Multi-agent Reinforcement Learning
  25 May 2021 0 repositories listed
• Real-time Monocular Depth Estimation with Sparse Supervision on Mobile
  25 May 2021 0 repositories listed
• AirNet: Neural Network Transmission over the Air
  24 May 2021 0 repositories listed
• Experimenting with Knowledge Distillation techniques for performing Brain Tumor Segmentation
  24 May 2021 0 repositories listed
• Revisiting Knowledge Distillation for Object Detection
  22 May 2021 0 repositories listed
• Inplace knowledge distillation with teacher assistant for improved training of flexible deep neural networks
  18 May 2021 0 repositories listed
• Weakly Supervised Dense Video Captioning via Jointly Usage of Knowledge Distillation and Cross-modal Matching
  18 May 2021 0 repositories listed
• Class-Incremental Few-Shot Object Detection
  17 May 2021 0 repositories listed
• Stacked Acoustic-and-Textual Encoding: Integrating the Pre-trained Models into Speech Translation Encoders
  12 May 2021 0 repositories listed
• Test-Time Adaptation Toward Personalized Speech Enhancement: Zero-Shot Learning with Knowledge Distillation
  8 May 2021 0 repositories listed
• Regression Bugs Are In Your Model! Measuring, Reducing and Analyzing Regressions In NLP Model Updates
  7 May 2021 0 repositories listed
• Black-Box Dissector: Towards Erasing-based Hard-Label Model Stealing Attack
  3 May 2021 0 repositories listed
• A Peek Into the Reasoning of Neural Networks: Interpreting with Structural Visual Concepts
  1 May 2021 0 repositories listed
• Knowledge Distillation for Swedish NER models: A Search for Performance and Efficiency
  1 May 2021 0 repositories listed
• Distilling EEG Representations via Capsules for Affective Computing
  30 Apr 2021 0 repositories listed
• Semantic Relation Preserving Knowledge Distillation for Image-to-Image Translation
  30 Apr 2021 0 repositories listed
• Spirit Distillation: A Model Compression Method with Multi-domain Knowledge Transfer
  29 Apr 2021 0 repositories listed
• Self-distillation with Batch Knowledge Ensembling Improves ImageNet Classification
  27 Apr 2021 0 repositories listed
• Extract then Distill: Efficient and Effective Task-Agnostic BERT Distillation
  24 Apr 2021 0 repositories listed
• Relational Subsets Knowledge Distillation for Long-tailed Retinal Diseases Recognition
  22 Apr 2021 0 repositories listed
• Brittle Features May Help Anomaly Detection
  21 Apr 2021 0 repositories listed
• Orderly Dual-Teacher Knowledge Distillation for Lightweight Human Pose Estimation
  21 Apr 2021 0 repositories listed
• EduPal leaves no professor behind: Supporting faculty via a peer-powered recommender system
  20 Apr 2021 0 repositories listed
• Compact CNN Structure Learning by Knowledge Distillation
  19 Apr 2021 0 repositories listed
• Continual Learning for Fake Audio Detection
  15 Apr 2021 0 repositories listed
• Integration of Pre-trained Networks with Continuous Token Interface for End-to-End Spoken Language Understanding
  15 Apr 2021 0 repositories listed
• Unsupervised Continual Learning Via Pseudo Labels
  14 Apr 2021 0 repositories listed
• Sentence Embeddings by Ensemble Distillation
  14 Apr 2021 0 repositories listed
• Dealing with Missing Modalities in the Visual Question Answer-Difference Prediction Task through Knowledge Distillation
  13 Apr 2021 0 repositories listed
• RankDistil: Knowledge Distillation for Ranking
  13 Apr 2021 0 repositories listed
• Source and Target Bidirectional Knowledge Distillation for End-to-end Speech Translation
  13 Apr 2021 0 repositories listed
• Dual Discriminator Adversarial Distillation for Data-free Model Compression
  12 Apr 2021 0 repositories listed
• Data-Free Knowledge Distillation with Soft Targeted Transfer Set Synthesis
  10 Apr 2021 0 repositories listed
• Compressing Visual-linguistic Model via Knowledge Distillation
  5 Apr 2021 0 repositories listed
• Decentralized and Model-Free Federated Learning: Consensus-Based Distillation in Function Space
  1 Apr 2021 0 repositories listed
• Dialect Identification through Adversarial Learning and Knowledge Distillation on Romanian BERT
  1 Apr 2021 0 repositories listed
• Is Label Smoothing Truly Incompatible with Knowledge Distillation: An Empirical Study
  1 Apr 2021 0 repositories listed
• Topic Modeling for Maternal Health Using Reddit
  1 Apr 2021 0 repositories listed
• Fixing the Teacher-Student Knowledge Discrepancy in Distillation
  31 Mar 2021 0 repositories listed
• Industry Scale Semi-Supervised Learning for Natural Language Understanding
  29 Mar 2021 0 repositories listed
• KnowRU: Knowledge Reusing via Knowledge Distillation in Multi-agent Reinforcement Learning
  27 Mar 2021 0 repositories listed
• A Practical Survey on Faster and Lighter Transformers
  26 Mar 2021 0 repositories listed
• Hands-on Guidance for Distilling Object Detectors
  26 Mar 2021 0 repositories listed
• Weakly-Supervised Domain Adaptation of Deep Regression Trackers via Reinforced Knowledge Distillation
  26 Mar 2021 0 repositories listed
• Spirit Distillation: Precise Real-time Semantic Segmentation of Road Scenes with Insufficient Data
  25 Mar 2021 0 repositories listed
• Balanced softmax cross-entropy for incremental learning with and without memory
  23 Mar 2021 0 repositories listed
• Student Network Learning via Evolutionary Knowledge Distillation
  23 Mar 2021 0 repositories listed
• The NLP Cookbook: Modern Recipes for Transformer based Deep Learning Architectures
  23 Mar 2021 0 repositories listed
• Compacting Deep Neural Networks for Internet of Things: Methods and Applications
  20 Mar 2021 0 repositories listed
• Cost-effective Deployment of BERT Models in Serverless Environment
  19 Mar 2021 0 repositories listed
• Variational Knowledge Distillation for Disease Classification in Chest X-Rays
  19 Mar 2021 0 repositories listed
• Similarity Transfer for Knowledge Distillation
  18 Mar 2021 0 repositories listed

Syntology lines on 1 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced; each line links to that paper's sample list. Syntology's record for this page has not changed since 2026-09-28, the first build that kept a record date for it; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.