Browse State-of-the-Art › Knowledge Distillation › Papers, page 35

Knowledge Distillation

Papers archive 2025-07-28

archive papers tagged: 4,240 · with a code link: 1,740 · where Syntology ran a sample: 451 (380 with a run with no instrument failure, 71 where every run was a failure of Syntology's instrument) Syntology

Show: all tagged papersonly where code ran (451 of 4,240 tagged: 380 with a run with no instrument failure, 71 where every run was a failure of Syntology's instrument)

Page 35 of 43: papers 3,401 to 3,500 of 4,240, in archive order: by repositories listed in the archive (most first), then newest first, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers that list no repository come after every paper that lists one.

Papers without a page here are shown as plain text. A Syntology line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the figure “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code); hover it for the repositories the samples that ran came from. Abstracts are on each paper's page.

• Multitask Emotion Recognition Model with Knowledge Distillation and Task Discriminator
  24 Mar 2022 0 repositories listed
• Mitigating Gender Bias in Distilled Language Models via Counterfactual Role Reversal
  23 Mar 2022 0 repositories listed
• Scale-Equivalent Distillation for Semi-Supervised Object Detection
  23 Mar 2022 0 repositories listed
• Towards Expressive Speaking Style Modelling with Hierarchical Context Information for Mandarin Speech Synthesis
  23 Mar 2022 0 repositories listed
• Channel Self-Supervision for Online Knowledge Distillation
  22 Mar 2022 0 repositories listed
• On Neural Network Equivalence Checking using SMT Solvers
  22 Mar 2022 0 repositories listed
• A Closer Look at Knowledge Distillation with Features, Logits, and Gradients
  18 Mar 2022 0 repositories listed
• Domain Adaptive Hand Keypoint and Pixel Localization in the Wild
  16 Mar 2022 0 repositories listed
• Sample, Translate, Recombine: Leveraging Audio Alignments for Data Augmentation in End-to-end Speech Translation
  16 Mar 2022 0 repositories listed
• DS3-Net: Difficulty-perceived Common-to-T1ce Semi-Supervised Multimodal MRI Synthesis Network
  14 Mar 2022 0 repositories listed
• On the benefits of knowledge distillation for adversarial robustness
  14 Mar 2022 0 repositories listed
• CEKD:Cross Ensemble Knowledge Distillation for Augmented Fine-grained Data
  13 Mar 2022 0 repositories listed
• Enabling Multimodal Generation on CLIP via Vision-Language Knowledge Distillation
  12 Mar 2022 0 repositories listed
• Wavelet Knowledge Distillation: Towards Efficient Image-to-Image Translation
  12 Mar 2022 0 repositories listed
• Deep Class Incremental Learning from Decentralized Data
  11 Mar 2022 0 repositories listed
• Medical Image Segmentation on MRI Images with Missing Modalities: A Review
  11 Mar 2022 0 repositories listed
• Improving Neural ODEs via Knowledge Distillation
  10 Mar 2022 0 repositories listed
• Look Backward and Forward: Self-Knowledge Distillation with Bidirectional Decoder for Neural Machine Translation
  10 Mar 2022 0 repositories listed
• Membership Privacy Protection for Image Translation Models via Adversarial Knowledge Distillation
  10 Mar 2022 0 repositories listed
• How many Observations are Enough? Knowledge Distillation for Trajectory Forecasting
  9 Mar 2022 0 repositories listed
• On Generalizing Beyond Domains in Cross-Domain Continual Learning
  8 Mar 2022 0 repositories listed
• Multi-trial Neural Architecture Search with Lottery Tickets
  8 Mar 2022 0 repositories listed
• MIAShield: Defending Membership Inference Attacks via Preemptive Exclusion of Members
  2 Mar 2022 0 repositories listed
• Dual Embodied-Symbolic Concept Representations for Deep Learning
  1 Mar 2022 0 repositories listed
• TRILLsson: Distilled Universal Paralinguistic Speech Representations
  1 Mar 2022 0 repositories listed
• Confidence Based Bidirectional Global Context Aware Training Framework for Neural Machine Translation
  28 Feb 2022 0 repositories listed
• Bridging the Gap Between Patient-specific and Patient-independent Seizure Prediction via Knowledge Distillation
  25 Feb 2022 0 repositories listed
• Learn From the Past: Experience Ensemble Knowledge Distillation
  25 Feb 2022 0 repositories listed
• Efficient Video Segmentation Models with Per-frame Inference
  24 Feb 2022 0 repositories listed
• Multi-Teacher Knowledge Distillation for Incremental Implicitly-Refined Classification
  23 Feb 2022 0 repositories listed
• A Novel Architecture Slimming Method for Network Pruning and Knowledge Distillation
  21 Feb 2022 0 repositories listed
• Learning Bayesian Sparse Networks with Full Experience Replay for Continual Learning
  21 Feb 2022 0 repositories listed
• Cross-Task Knowledge Distillation in Multi-Task Recommendation
  20 Feb 2022 0 repositories listed
• Knowledge Distillation with Deep Supervision
  16 Feb 2022 0 repositories listed
• Meta Knowledge Distillation
  16 Feb 2022 0 repositories listed
• No One Left Behind: Inclusive Federated Learning over Heterogeneous Devices
  16 Feb 2022 0 repositories listed
• AI can evolve without labels: self-evolving vision transformer for chest X-ray diagnosis through knowledge distillation
  13 Feb 2022 0 repositories listed
• Uni-Retriever: Towards Learning The Unified Embedding Based Retriever in Bing Sponsored Search
  13 Feb 2022 0 repositories listed
• Distillation with Contrast is All You Need for Self-Supervised Point Cloud Representation Learning
  9 Feb 2022 0 repositories listed
• Measuring and Reducing Model Update Regression in Structured Prediction for NLP
  7 Feb 2022 0 repositories listed
• Bootstrapped Representation Learning for Skeleton-Based Action Recognition
  4 Feb 2022 0 repositories listed
• Cross domain knowledge compression in realtime optical flow prediction on ultrasound sequences
  4 Feb 2022 0 repositories listed
• Iterative Self Knowledge Distillation -- From Pothole Classification to Fine-Grained and COVID Recognition
  4 Feb 2022 0 repositories listed
• Win the Lottery Ticket via Fourier Analysis: Frequencies Guided Network Pruning
  30 Jan 2022 0 repositories listed
• AutoDistil: Few-shot Task-agnostic Neural Architecture Search for Distilling Large Language Models
  29 Jan 2022 0 repositories listed
• Adaptive Instance Distillation for Object Detection in Autonomous Driving
  26 Jan 2022 0 repositories listed
• One Student Knows All Experts Know: From Sparse to Dense
  26 Jan 2022 0 repositories listed
• TrustAL: Trustworthy Active Learning using Knowledge Distillation
  26 Jan 2022 0 repositories listed
• Jointly Learning Knowledge Embedding and Neighborhood Consensus with Relational Knowledge Distillation for Entity Alignment
  25 Jan 2022 0 repositories listed
• Federated Unlearning with Knowledge Distillation
  24 Jan 2022 0 repositories listed
• AutoDistill: an End-to-End Framework to Explore and Distill Hardware-Efficient Language Models
  21 Jan 2022 0 repositories listed
• Can Model Compression Improve NLP Fairness
  21 Jan 2022 0 repositories listed
• Image-to-Video Re-Identification via Mutual Discriminative Knowledge Transfer
  21 Jan 2022 0 repositories listed
• UKD: Debiasing Conversion Rate Estimation via Uncertainty-regularized Knowledge Distillation
  20 Jan 2022 0 repositories listed
• Improving Neural Machine Translation by Denoising Training
  19 Jan 2022 0 repositories listed
• Cross-modal Contrastive Distillation for Instructional Activity Anticipation
  18 Jan 2022 0 repositories listed
• Knowledge Distillation as Self-Supervised Learning
  17 Jan 2022 0 repositories listed
• CL-ReKD: Cross-lingual Knowledge Distillation for Multilingual Retrieval Question Answering
  16 Jan 2022 0 repositories listed
• KD-VLP: Improving End-to-End Vision-and-Language Pretraining with Object Knowledge Distillation
  16 Jan 2022 0 repositories listed
• Learning Cross-Lingual IR from an English Retriever
  16 Jan 2022 0 repositories listed
• MoEBERT: from BERT to Mixture-of-Experts via Importance-Guided Adaptation
  16 Jan 2022 0 repositories listed
• Nearest Neighbor Knowledge Distillation for Neural Machine Translation
  16 Jan 2022 0 repositories listed
• Re2G: Retrieve, Rerank, Generate
  16 Jan 2022 0 repositories listed
• Transferring Knowledge from Structure-aware Self-attention Language Model to Sequence-to-Sequence Semantic Parsing
  16 Jan 2022 0 repositories listed
• Tree Knowledge Distillation for Compressing Transformer-Based Language Models
  16 Jan 2022 0 repositories listed
• Technical Report for ICCV 2021 Challenge SSLAD-Track3B: Transformers Are Better Continual Learners
  13 Jan 2022 0 repositories listed
• FedDTG:Federated Data-Free Knowledge Distillation via Three-Player Generative Adversarial Networks
  10 Jan 2022 0 repositories listed
• Two-Pass End-to-End ASR Model Compression
  8 Jan 2022 0 repositories listed
• Microdosing: Knowledge Distillation for GAN based Compression
  7 Jan 2022 0 repositories listed
• Which Student is Best? A Comprehensive Knowledge Distillation Exam for Task-Specific BERT Models
  3 Jan 2022 0 repositories listed
• Class Similarity Weighted Knowledge Distillation for Continual Semantic Segmentation
  1 Jan 2022 0 repositories listed
• Distillation Using Oracle Queries for Transformer-Based Human-Object Interaction Detection
  1 Jan 2022 0 repositories listed
• Image Restoration using Feature-guidance
  1 Jan 2022 0 repositories listed
• Improving Video Model Transfer With Dynamic Representation Learning
  1 Jan 2022 0 repositories listed
• Multi-Objective Diverse Human Motion Prediction With Knowledge Distillation
  1 Jan 2022 0 repositories listed
• Performance-Aware Mutual Knowledge Distillation for Improving Neural Architecture Search
  1 Jan 2022 0 repositories listed
• Conditional Generative Data-free Knowledge Distillation
  31 Dec 2021 0 repositories listed
• Data-Free Knowledge Transfer: A Survey
  31 Dec 2021 0 repositories listed
• An Efficient Federated Distillation Learning System for Multi-task Time Series Classification
  30 Dec 2021 0 repositories listed
• Automatic Mixed-Precision Quantization Search of BERT
  30 Dec 2021 0 repositories listed
• Adaptive Beam Search to Enhance On-device Abstractive Summarization
  22 Dec 2021 0 repositories listed
• Self-Distillation Mixup Training for Non-autoregressive Neural Machine Translation
  22 Dec 2021 0 repositories listed
• Multi-Modality Distillation via Learning the teacher's modality-level Gram Matrix
  21 Dec 2021 0 repositories listed
• Supervised Graph Contrastive Pretraining for Text Classification
  21 Dec 2021 0 repositories listed
• Controlling the Quality of Distillation in Response-Based Network Compression
  19 Dec 2021 0 repositories listed
• LegoDNN: Block-grained Scaling of Deep Neural Networks for Mobile Vision
  18 Dec 2021 0 repositories listed
• Distill and De-bias: Mitigating Bias in Face Verification using Knowledge Distillation
  17 Dec 2021 0 repositories listed
• Distillation of Human-Object Interaction Contexts for Action Recognition
  17 Dec 2021 0 repositories listed
• Knowledge Distillation Improves Stability in Retranslation-based Simultaneous Translation
  17 Dec 2021 0 repositories listed
• Weakly Supervised Semantic Segmentation via Alternative Self-Dual Teaching
  17 Dec 2021 0 repositories listed
• Amortized Noisy Channel Neural Machine Translation
  16 Dec 2021 0 repositories listed
• Towards a Unified Foundation Model: Jointly Pre-Training Transformers on Unpaired Images and Text
  14 Dec 2021 0 repositories listed
• Lifelong Unsupervised Domain Adaptive Person Re-identification with Coordinated Anti-forgetting and Adaptation
  13 Dec 2021 0 repositories listed
• Knowledge Distillation for Object Detection via Rank Mimicking and Prediction-guided Feature Imitation
  9 Dec 2021 0 repositories listed
• Mutual Adversarial Training: Learning together is better than going alone
  9 Dec 2021 0 repositories listed
• Boosting Contrastive Learning with Relation Knowledge Distillation
  8 Dec 2021 0 repositories listed
• Extracting knowledge from features with multilevel abstraction
  4 Dec 2021 0 repositories listed
• KDCTime: Knowledge Distillation with Calibration on InceptionTime for Time-series Classification
  4 Dec 2021 0 repositories listed
• FedRAD: Federated Robust Adaptive Distillation
  2 Dec 2021 0 repositories listed
• Analyzing the Confidentiality of Undistillable Teachers in Knowledge Distillation
  1 Dec 2021 0 repositories listed