Browse State-of-the-Art › Knowledge Distillation › Papers, page 33

Knowledge Distillation

Papers archive 2025-07-28

archive papers tagged: 4,240 · with a code link: 1,740 · where Syntology ran a sample: 451 (380 with a run with no instrument failure, 71 where every run was a failure of Syntology's instrument) Syntology

Show: all tagged papersonly where code ran (451 of 4,240 tagged: 380 with a run with no instrument failure, 71 where every run was a failure of Syntology's instrument)

Page 33 of 43: papers 3,201 to 3,300 of 4,240, in archive order: by repositories listed in the archive (most first), then newest first, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers that list no repository come after every paper that lists one.

Papers without a page here are shown as plain text. A Syntology line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the figure “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code); hover it for the repositories the samples that ran came from. Abstracts are on each paper's page.

• ADPS: Asymmetric Distillation Post-Segmentation for Image Anomaly Detection
  19 Oct 2022 0 repositories listed
• On effects of Knowledge Distillation on Transfer Learning
  18 Oct 2022 0 repositories listed
• Federated Learning with Privacy-Preserving Ensemble Attention Distillation
  16 Oct 2022 0 repositories listed
• RoS-KD: A Robust Stochastic Knowledge Distillation Approach for Noisy Medical Imaging
  15 Oct 2022 0 repositories listed
• Probabilistic Integration of Object Level Annotations in Chest X-ray Classification
  13 Oct 2022 0 repositories listed
• You Can Have Your Data and Balance It Too: Towards Balanced and Efficient Multilingual Models
  13 Oct 2022 0 repositories listed
• Boosting Graph Neural Networks via Adaptive Knowledge Distillation
  12 Oct 2022 0 repositories listed
• Comparison of Soft and Hard Target RNN-T Distillation for Large-scale ASR
  11 Oct 2022 0 repositories listed
• Linkless Link Prediction via Relational Distillation
  11 Oct 2022 0 repositories listed
• The Unreasonable Effectiveness of Fully-Connected Layers for Low-Data Regimes
  11 Oct 2022 0 repositories listed
• Asymmetric Temperature Scaling Makes Larger Networks Teach Well Again
  10 Oct 2022 0 repositories listed
• Knowledge Distillation Transfer Sets and their Impact on Downstream NLU Tasks
  10 Oct 2022 0 repositories listed
• Students taught by multimodal teachers are superior action recognizers
  9 Oct 2022 0 repositories listed
• Mutual Learning of Single- and Multi-Channel End-to-End Neural Diarization
  7 Oct 2022 0 repositories listed
• Automated Graph Self-supervised Learning via Multi-teacher Knowledge Distillation
  5 Oct 2022 0 repositories listed
• Meta-Ensemble Parameter Learning
  5 Oct 2022 0 repositories listed
• A Study on the Efficiency and Generalization of Light Hybrid Retrievers
  4 Oct 2022 0 repositories listed
• Domain Discrepancy Aware Distillation for Model Aggregation in Federated Learning
  4 Oct 2022 0 repositories listed
• Knowledge Distillation based Contextual Relevance Matching for E-commerce Product Search
  4 Oct 2022 0 repositories listed
• Robust Active Distillation
  3 Oct 2022 0 repositories listed
• Improving Zero-Shot Multilingual Text Generation via Iterative Distillation
  1 Oct 2022 0 repositories listed
• Knowledge Transfer with Visual Prompt in multi-modal Dialogue Understanding and Generation
  1 Oct 2022 0 repositories listed
• Multi-stage Progressive Compression of Conformer Transducer for On-device Speech Recognition
  1 Oct 2022 0 repositories listed
• Sentiment Interpretable Logic Tensor Network for Aspect-Term Sentiment Analysis
  1 Oct 2022 0 repositories listed
• Transferring Knowledge from Structure-aware Self-attention Language Model to Sequence-to-Sequence Semantic Parsing
  1 Oct 2022 0 repositories listed
• Designing and Training of Lightweight Neural Networks on Edge Devices using Early Halting in Knowledge Distillation
  30 Sep 2022 0 repositories listed
• Towards a Unified View of Affinity-Based Knowledge Distillation
  30 Sep 2022 0 repositories listed
• Using Knowledge Distillation to improve interpretable models in a retail banking context
  30 Sep 2022 0 repositories listed
• Label driven Knowledge Distillation for Federated Learning with non-IID Data
  29 Sep 2022 0 repositories listed
• Towards Explaining Autonomy with Verbalised Decision Tree States
  28 Sep 2022 0 repositories listed
• Knowledge Distillation to Ensemble Global and Interpretable Prototype-Based Mammogram Classification Models
  26 Sep 2022 0 repositories listed
• Joint Speech Activity and Overlap Detection with Multi-Exit Architecture
  24 Sep 2022 0 repositories listed
• DRKF: Distilled Rotated Kernel Fusion for Efficient Rotation Invariant Descriptors in Local Feature Matching
  22 Sep 2022 0 repositories listed
• Momentum Adversarial Distillation: Handling Large Distribution Shifts in Data-Free Knowledge Distillation
  21 Sep 2022 0 repositories listed
• Parameter-Efficient Conformers via Sharing Sparsely-Gated Experts for End-to-End Speech Recognition
  17 Sep 2022 0 repositories listed
• Continual Learning for Class- and Domain-Incremental Semantic Segmentation
  16 Sep 2022 0 repositories listed
• CES-KD: Curriculum-based Expert Selection for Guided Knowledge Distillation
  15 Sep 2022 0 repositories listed
• Layerwise Bregman Representation Learning with Applications to Knowledge Distillation
  15 Sep 2022 0 repositories listed
• PlaStIL: Plastic and Stable Memory-Free Class-Incremental Learning
  14 Sep 2022 0 repositories listed
• TASKED: Transformer-based Adversarial learning for human activity recognition using wearable sensors via Self-KnowledgE Distillation
  14 Sep 2022 0 repositories listed
• Online Continual Learning via the Meta-learning Update with Multi-scale Knowledge Distillation and Data Augmentation
  12 Sep 2022 0 repositories listed
• Preserving Privacy in Federated Learning with Ensemble Cross-Domain Knowledge Distillation
  10 Sep 2022 0 repositories listed
• In-situ animal behavior classification using knowledge distillation and fixed-point quantization
  9 Sep 2022 0 repositories listed
• Selecting Related Knowledge via Efficient Channel Attention for Online Continual Learning
  9 Sep 2022 0 repositories listed
• A Novel Self-Knowledge Distillation Approach with Siamese Representation Learning for Action Recognition
  3 Sep 2022 0 repositories listed
• Dynamics-Adaptive Continual Reinforcement Learning via Progressive Contextualization
  1 Sep 2022 0 repositories listed
• Knowledge Distillation for Sustainable Neural Machine Translation
  1 Sep 2022 0 repositories listed
• Removing Rain Streaks via Task Transfer Learning
  28 Aug 2022 0 repositories listed
• Dense Depth Distillation with Out-of-Distribution Simulated Images
  26 Aug 2022 0 repositories listed
• Debias the Black-box: A Fair Ranking Framework via Knowledge Distillation
  24 Aug 2022 0 repositories listed
• Lifelong Learning for Neural powered Mixed Integer Programming
  24 Aug 2022 0 repositories listed
• Multi-View Attention Transfer for Efficient Speech Enhancement
  22 Aug 2022 0 repositories listed
• Combining Compressions for Multiplicative Size Scaling on Natural Language Tasks
  20 Aug 2022 0 repositories listed
• Effectiveness of Function Matching in Driving Scene Recognition
  20 Aug 2022 0 repositories listed
• Quantifying the Knowledge in a DNN to Explain Knowledge Distillation for Classification
  18 Aug 2022 0 repositories listed
• Leukocyte Classification using Multimodal Architecture Enhanced by Knowledge Distillation
  17 Aug 2022 0 repositories listed
• Progressive Cross-modal Knowledge Distillation for Human Action Recognition
  17 Aug 2022 0 repositories listed
• RAWtoBit: A Fully End-to-end Camera ISP Network
  16 Aug 2022 0 repositories listed
• Unsupervised Domain Adaptation for Segmentation with Black-box Source Model
  16 Aug 2022 0 repositories listed
• A Knowledge Distillation-Based Backdoor Attack in Federated Learning
  12 Aug 2022 0 repositories listed
• Non-Autoregressive Sign Language Production via Knowledge Distillation
  12 Aug 2022 0 repositories listed
• Self-Knowledge Distillation via Dropout
  11 Aug 2022 0 repositories listed
• Label Semantic Knowledge Distillation for Unbiased Scene Graph Generation
  7 Aug 2022 0 repositories listed
• Study of Encoder-Decoder Architectures for Code-Mix Search Query Translation
  7 Aug 2022 0 repositories listed
• PGX: A Multi-level GNN Explanation Framework Based on Separate Knowledge Distillation Processes
  5 Aug 2022 0 repositories listed
• Task-Balanced Distillation for Object Detection
  5 Aug 2022 0 repositories listed
• Deep Semi-Supervised and Self-Supervised Learning for Diabetic Retinopathy Detection
  4 Aug 2022 0 repositories listed
• Pose Uncertainty Aware Movement Synchrony Estimation via Spatial-Temporal Graph Transformer
  1 Aug 2022 0 repositories listed
• SDBERT: SparseDistilBERT, a faster and smaller BERT model
  28 Jul 2022 0 repositories listed
• NICEST: Noisy Label Correction and Training for Robust Scene Graph Generation
  27 Jul 2022 0 repositories listed
• Few-Shot Object Detection by Knowledge Distillation Using Bag-of-Visual-Words Representations
  25 Jul 2022 0 repositories listed
• HIRE: Distilling High-order Relational Knowledge From Heterogeneous Graph Neural Networks
  25 Jul 2022 0 repositories listed
• Federated Semi-Supervised Domain Adaptation via Knowledge Transfer
  21 Jul 2022 0 repositories listed
• Aware of the History: Trajectory Forecasting with the Local Behavior Data
  20 Jul 2022 0 repositories listed
• Many-to-One Knowledge Distillation of Real-Time Epileptic Seizure Detection for Low-Power Wearable Internet of Things Systems
  20 Jul 2022 0 repositories listed
• Model Compression for Resource-Constrained Mobile Robots
  20 Jul 2022 0 repositories listed
• Knowledge distillation with a class-aware loss for endoscopic disease detection
  19 Jul 2022 0 repositories listed
• Learning Knowledge Representation with Meta Knowledge Distillation for Single Image Super-Resolution
  18 Jul 2022 0 repositories listed
• Subclass Knowledge Distillation with Known Subclass Labels
  17 Jul 2022 0 repositories listed
• SSMTL++: Revisiting Self-Supervised Multi-Task Learning for Video Anomaly Detection
  16 Jul 2022 0 repositories listed
• Deep versus Wide: An Analysis of Student Architectures for Task-Agnostic Knowledge Distillation of Self-Supervised Speech Models
  14 Jul 2022 0 repositories listed
• Rethinking Attention Mechanism in Time Series Classification
  14 Jul 2022 0 repositories listed
• DSPNet: Towards Slimmable Pretrained Networks based on Discriminative Self-supervised Learning
  13 Jul 2022 0 repositories listed
• Rich Feature Distillation with Feature Affinity Module for Efficient Image Dehazing
  13 Jul 2022 0 repositories listed
• SlimSeg: Slimmable Semantic Segmentation with Boundary Supervision
  13 Jul 2022 0 repositories listed
• Cross-Architecture Knowledge Distillation
  12 Jul 2022 0 repositories listed
• Normalized Feature Distillation for Semantic Segmentation
  12 Jul 2022 0 repositories listed
• 1st Place Solution to the EPIC-Kitchens Action Anticipation Challenge 2022
  10 Jul 2022 0 repositories listed
• Improving Streaming End-to-End ASR on Transformer-based Causal Models with Encoder States Revision Strategies
  6 Jul 2022 0 repositories listed
• Low-resource Low-footprint Wake-word Detection using Knowledge Distillation
  6 Jul 2022 0 repositories listed
• A Generative Framework for Personalized Learning and Estimation: Theory, Algorithms, and Privacy
  5 Jul 2022 0 repositories listed
• GLANCE: Global to Local Architecture-Neutral Concept-based Explanations
  5 Jul 2022 0 repositories listed
• VEM²L: A Plug-and-play Framework for Fusing Text and Structure Knowledge on Sparse Knowledge Graph Completion
  4 Jul 2022 0 repositories listed
• FasterAI: A Lightweight Library for Creating Sparse Neural Networks
  3 Jul 2022 0 repositories listed
• Speech Emotion: Investigating Model Representations, Multi-Task Learning and Knowledge Distillation
  2 Jul 2022 0 repositories listed
• Asynchronous Convergence in Multi-Task Learning via Knowledge Distillation from Converged Tasks
  1 Jul 2022 0 repositories listed
• End-to-End Simultaneous Speech Translation with Pretraining and Distillation: Huawei Noah’s System for AutoSimTranS 2022
  1 Jul 2022 0 repositories listed
• KroneckerBERT: Significant Compression of Pre-trained Language Models Through Kronecker Decomposition and Knowledge Distillation
  1 Jul 2022 0 repositories listed
• Lost in Distillation: A Case Study in Toxicity Modeling
  1 Jul 2022 0 repositories listed
• Why Knowledge Distillation Amplifies Gender Bias and How to Mitigate from the Perspective of DistilBERT
  1 Jul 2022 0 repositories listed