Browse State-of-the-Art › Knowledge Distillation › Papers, page 37

Knowledge Distillation

Papers archive 2025-07-28

archive papers tagged: 4,240 · with a code link: 1,740 · where Syntology ran a sample: 451 (380 with a run with no instrument failure, 71 where every run was a failure of Syntology's instrument) Syntology

Show: all tagged papersonly where code ran (451 of 4,240 tagged: 380 with a run with no instrument failure, 71 where every run was a failure of Syntology's instrument)

Page 37 of 43: papers 3,601 to 3,700 of 4,240, in archive order: by repositories listed in the archive (most first), then newest first, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers that list no repository come after every paper that lists one.

Papers without a page here are shown as plain text. A Syntology line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the figure “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code); hover it for the repositories the samples that ran came from. Abstracts are on each paper's page.

• A Unified Knowledge Distillation Framework for Deep Directed Graphical Models
  29 Sep 2021 0 repositories listed
• Adaptive Label Smoothing with Self-Knowledge
  29 Sep 2021 0 repositories listed
• Automated Channel Pruning with Learned Importance
  29 Sep 2021 0 repositories listed
• Convolutional Neural Network Compression through Generalized Kronecker Product Decomposition
  29 Sep 2021 0 repositories listed
• Distilling GANs with Style-Mixed Triplets for X2I Translation with Limited Data
  29 Sep 2021 0 repositories listed
• Explaining Knowledge Graph Embedding via Latent Rule Learning
  29 Sep 2021 0 repositories listed
• Exploiting Knowledge Distillation for Few-Shot Image Generation
  29 Sep 2021 0 repositories listed
• Fast and Efficient Once-For-All Networks for Diverse Hardware Deployment
  29 Sep 2021 0 repositories listed
• Feature Kernel Distillation
  29 Sep 2021 0 repositories listed
• Generate, Annotate, and Learn: Generative Models Advance Self-Training and Knowledge Distillation
  29 Sep 2021 0 repositories listed
• Learning Efficient Image Super-Resolution Networks via Structure-Regularized Pruning
  29 Sep 2021 0 repositories listed
• MOBA: Multi-teacher Model Based Reinforcement Learning
  29 Sep 2021 0 repositories listed
• Neural Architecture Search via Ensemble-based Knowledge Distillation
  29 Sep 2021 0 repositories listed
• Not All Regions are Worthy to be Distilled: Region-aware Knowledge Distillation Towards Efficient Image-to-Image Translation
  29 Sep 2021 0 repositories listed
• Prototypical Contrastive Predictive Coding
  29 Sep 2021 0 repositories listed
• Pseudo Knowledge Distillation: Towards Learning Optimal Instance-specific Label Smoothing Regularization
  29 Sep 2021 0 repositories listed
• Reducing the Teacher-Student Gap via Adaptive Temperatures
  29 Sep 2021 0 repositories listed
• Representation Consolidation from Multiple Expert Teachers
  29 Sep 2021 0 repositories listed
• Scaling Fair Learning to Hundreds of Intersectional Groups
  29 Sep 2021 0 repositories listed
• Self-Distilled Pruning Of Neural Networks
  29 Sep 2021 0 repositories listed
• Self-Slimming Vision Transformer
  29 Sep 2021 0 repositories listed
• Self-supervised Models are Good Teaching Assistants for Vision Transformers
  29 Sep 2021 0 repositories listed
• SeqPATE: Differentially Private Text Generation via Knowledge Distillation
  29 Sep 2021 0 repositories listed
• Source-Target Unified Knowledge Distillation for Memory-Efficient Federated Domain Adaptation on Edge Devices
  29 Sep 2021 0 repositories listed
• Stingy Teacher: Sparse Logits Suffice to Fail Knowledge Distillation
  29 Sep 2021 0 repositories listed
• To Smooth or not to Smooth? On Compatibility between Label Smoothing and Knowledge Distillation
  29 Sep 2021 0 repositories listed
• Understanding the Success of Knowledge Distillation -- A Data Augmentation Perspective
  29 Sep 2021 0 repositories listed
• Wakening Past Concepts without Past Data: Class-incremental Learning from Placebos
  29 Sep 2021 0 repositories listed
• Partial to Whole Knowledge Distillation: Progressive Distilling Decomposed Knowledge Boosts Student Better
  26 Sep 2021 0 repositories listed
• Recent Advances of Continual Learning in Computer Vision: An Overview
  23 Sep 2021 0 repositories listed
• K-AID: Enhancing Pre-trained Language Models with Domain Knowledge for Question Answering
  22 Sep 2021 0 repositories listed
• Low-Latency Incremental Text-to-Speech Synthesis with Distilled Context Prediction Network
  22 Sep 2021 0 repositories listed
• The NiuTrans Machine Translation Systems for WMT21
  22 Sep 2021 0 repositories listed
• Knowledge Distillation with Noisy Labels for Natural Language Understanding
  21 Sep 2021 0 repositories listed
• RAIL-KD: RAndom Intermediate Layer Mapping for Knowledge Distillation
  21 Sep 2021 0 repositories listed
• Towards Full Utilization on Mask Task for Distilling PLMs into NMT
  17 Sep 2021 0 repositories listed
• Label Assignment Distillation for Object Detection
  16 Sep 2021 0 repositories listed
• New Perspective on Progressive GANs Distillation for One-class Novelty Detection
  15 Sep 2021 0 repositories listed
• AligNART: Non-autoregressive Neural Machine Translation by Jointly Learning to Estimate Alignment and Translate
  14 Sep 2021 0 repositories listed
• Multihop: Leveraging Complex Models to Learn Accurate Simple Models
  14 Sep 2021 0 repositories listed
• A Note on Knowledge Distillation Loss Function for Object Classification
  14 Sep 2021 0 repositories listed
• Secure Your Ride: Real-time Matching Success Rate Prediction for Passenger-Driver Pairs
  14 Sep 2021 0 repositories listed
• KroneckerBERT: Learning Kronecker Decomposition for Pre-trained Language Models via Knowledge Distillation
  13 Sep 2021 0 repositories listed
• UniMS: A Unified Framework for Multimodal Summarization with Knowledge Distillation
  13 Sep 2021 0 repositories listed
• Federated Ensemble Model-based Reinforcement Learning in Edge Computing
  12 Sep 2021 0 repositories listed
• On the Efficiency of Subclass Knowledge Distillation in Classification Tasks
  12 Sep 2021 0 repositories listed
• Learning to Teach with Student Feedback
  10 Sep 2021 0 repositories listed
• Towards Developing a Multilingual and Code-Mixed Visual Question Answering System by Knowledge Distillation
  10 Sep 2021 0 repositories listed
• CAM-loss: Towards Learning Spatially Discriminative Feature Representations
  3 Sep 2021 0 repositories listed
• Decoupled Transformer for Scalable Inference in Open-domain Question Answering
  1 Sep 2021 0 repositories listed
• Knowledge Distillation with BERT for Image Tag-Based Privacy Prediction
  1 Sep 2021 0 repositories listed
• FedKD: Communication Efficient Federated Learning via Knowledge Distillation
  30 Aug 2021 0 repositories listed
• Lipschitz Continuity Guided Knowledge Distillation
  29 Aug 2021 0 repositories listed
• CoCo DistillNet: a Cross-layer Correlation Distillation Network for Pathological Gastric Cancer Segmentation
  27 Aug 2021 0 repositories listed
• SIGN: Spatial-information Incorporated Generative Network for Generalized Zero-shot Semantic Segmentation
  27 Aug 2021 0 repositories listed
• Efficient training of lightweight neural networks using Online Self-Acquired Knowledge Distillation
  26 Aug 2021 0 repositories listed
• Deploying a BERT-based Query-Title Relevance Classifier in a Production System: a View from the Trenches
  23 Aug 2021 0 repositories listed
• Personalised Federated Learning: A Combinational Approach
  22 Aug 2021 0 repositories listed
• Boosting of Head Pose Estimation by Knowledge Distillation
  20 Aug 2021 0 repositories listed
• BERT Learns to Teach: Knowledge Distillation with Meta Learning
  17 Aug 2021 0 repositories listed
• G-DetKD: Towards General Distillation Framework for Object Detectors via Contrastive and Semantic-guided Feature Imitation
  17 Aug 2021 0 repositories listed
• Online Continual Learning For Visual Food Classification
  15 Aug 2021 0 repositories listed
• Learning from Matured Dumb Teacher for Fine Generalization
  12 Aug 2021 0 repositories listed
• Preventing Catastrophic Forgetting and Distribution Mismatch in Knowledge Distillation via Synthetic Data
  11 Aug 2021 0 repositories listed
• Lifelong Intent Detection via Multi-Strategy Rebalancing
  10 Aug 2021 0 repositories listed
• Learning an Augmented RGB Representation with Cross-Modal Knowledge Distillation for Action Detection
  8 Aug 2021 0 repositories listed
• A distillation based approach for the diagnosis of diseases
  7 Aug 2021 0 repositories listed
• Spatio-Temporal Attention Mechanism and Knowledge Distillation for Lip Reading
  7 Aug 2021 0 repositories listed
• Decoupled Transformer for Scalable Inference in Open-domain Question Answering
  5 Aug 2021 0 repositories listed
• MS-KD: Multi-Organ Segmentation with Multiple Binary-Labeled Datasets
  5 Aug 2021 0 repositories listed
• WeChat Neural Machine Translation Systems for WMT21
  5 Aug 2021 0 repositories listed
• Semi-Supervising Learning, Transfer Learning, and Knowledge Distillation with SimCLR
  2 Aug 2021 0 repositories listed
• In-Batch Negatives for Knowledge Distillation with Tightly-Coupled Teachers for Dense Retrieval
  1 Aug 2021 0 repositories listed
• 基于层间知识蒸馏的神经机器翻译(Inter-layer Knowledge Distillation for Neural Machine Translation)
  1 Aug 2021 0 repositories listed
• Matching Distributions between Model and Data: Cross-domain Knowledge Distillation for Unsupervised Domain Adaptation
  1 Aug 2021 0 repositories listed
• Multi-Strategy Knowledge Distillation Based Teacher-Student Framework for Machine Reading Comprehension
  1 Aug 2021 0 repositories listed
• NAIST English-to-Japanese Simultaneous Translation System for IWSLT 2021 Simultaneous Text-to-text Task
  1 Aug 2021 0 repositories listed
• On Knowledge Distillation for Translating Erroneous Speech Transcriptions
  1 Aug 2021 0 repositories listed
• PRAL: A Tailored Pre-Training Model for Task-Oriented Dialog Generation
  1 Aug 2021 0 repositories listed
• Samsung R&D Institute Poland submission to WAT 2021 Indic Language Multilingual Task
  1 Aug 2021 0 repositories listed
• The USYD-JD Speech Translation System for IWSLT2021
  1 Aug 2021 0 repositories listed
• Trigger is Not Sufficient: Exploiting Frame-aware Knowledge for Implicit Event Argument Extraction
  1 Aug 2021 0 repositories listed
• Pose-Guided Feature Learning with Knowledge Distillation for Occluded Person Re-Identification
  31 Jul 2021 0 repositories listed
• On the Efficacy of Small Self-Supervised Contrastive Models without Distillation Signals
  30 Jul 2021 0 repositories listed
• QuPeD: Quantized Personalization via Distillation with Applications to Federated Learning
  29 Jul 2021 0 repositories listed
• Using Perturbed Length-aware Positional Encoding for Non-autoregressive Neural Machine Translation
  29 Jul 2021 0 repositories listed
• In Defense of the Learning Without Forgetting for Task Incremental Learning
  26 Jul 2021 0 repositories listed
• Text is Text, No Matter What: Unifying Text Recognition using Knowledge Distillation
  26 Jul 2021 0 repositories listed
• The USYD-JD Speech Translation System for IWSLT 2021
  24 Jul 2021 0 repositories listed
• Follow Your Path: a Progressive Method for Knowledge Distillation
  20 Jul 2021 0 repositories listed
• Learning ULMFiT and Self-Distillation with Calibration for Medical Dialogue System
  20 Jul 2021 0 repositories listed
• Double Similarity Distillation for Semantic Image Segmentation
  19 Jul 2021 0 repositories listed
• Federated Action Recognition on Heterogeneous Embedded Devices
  18 Jul 2021 0 repositories listed
• Scene-adaptive Knowledge Distillation for Sequential Recommendation via Differentiable Architecture Search
  15 Jul 2021 0 repositories listed
• Improving Speech Translation by Understanding and Learning from the Auxiliary Text Translation Task
  12 Jul 2021 0 repositories listed
• Technical Report of Team GraphMIRAcles in the WikiKG90M-LSC Track of OGB-LSC @ KDD Cup 2021
  12 Jul 2021 0 repositories listed
• Contrast R-CNN for Continual Learning in Object Detection
  11 Jul 2021 0 repositories listed
• Lifelong Twin Generative Adversarial Networks
  9 Jul 2021 0 repositories listed
• Novel Visual Category Discovery with Dual Ranking Statistics and Mutual Knowledge Distillation
  7 Jul 2021 0 repositories listed
• WeClick: Weakly-Supervised Video Semantic Segmentation with Click Annotations
  7 Jul 2021 0 repositories listed