Browse State-of-the-Art › Knowledge Distillation › Papers, page 28

Knowledge Distillation

Papers archive 2025-07-28

archive papers tagged: 4,240 · with a code link: 1,740 · where Syntology ran a sample: 451 (380 with a run with no instrument failure, 71 where every run was a failure of Syntology's instrument) Syntology

Show: all tagged papersonly where code ran (451 of 4,240 tagged: 380 with a run with no instrument failure, 71 where every run was a failure of Syntology's instrument)

Page 28 of 43: papers 2,701 to 2,800 of 4,240, in archive order: by repositories listed in the archive (most first), then newest first, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers that list no repository come after every paper that lists one.

Papers without a page here are shown as plain text. A Syntology line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the figure “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code); hover it for the repositories the samples that ran came from. Abstracts are on each paper's page.

• A Knowledge Distillation Approach for Sepsis Outcome Prediction from Multivariate Clinical Time Series
  16 Nov 2023 0 repositories listed
• Batch Selection and Communication for Active Learning with Edge Labeling
  14 Nov 2023 0 repositories listed
• Unlock the Power: Competitive Distillation for Multi-Modal Large Language Models
  14 Nov 2023 0 repositories listed
• On Elastic Language Models
  13 Nov 2023 0 repositories listed
• Teach me with a Whisper: Enhancing Large Language Models for Analyzing Spoken Transcripts using Speech Embeddings
  13 Nov 2023 0 repositories listed
• DONUT-hole: DONUT Sparsification by Harnessing Knowledge and Optimizing Learning Efficiency
  9 Nov 2023 0 repositories listed
• Object-centric Cross-modal Feature Distillation for Event-based Object Detection
  9 Nov 2023 0 repositories listed
• Supervised domain adaptation for building extraction from off-nadir aerial images
  7 Nov 2023 0 repositories listed
• What is Lost in Knowledge Distillation?
  7 Nov 2023 0 repositories listed
• Asymmetric Masked Distillation for Pre-Training Small Foundation Models
  6 Nov 2023 0 repositories listed
• Co-training and Co-distillation for Quality Improvement and Compression of Language Models
  6 Nov 2023 0 repositories listed
• After-Stroke Arm Paresis Detection using Kinematic Data
  3 Nov 2023 0 repositories listed
• Data-Free Distillation of Language Model by Text-to-Text Transfer
  3 Nov 2023 0 repositories listed
• An Efficient Detection and Control System for Underwater Docking using Machine Learning and Realistic Simulation: A Comprehensive Approach
  2 Nov 2023 0 repositories listed
• Distilling Knowledge from CNN-Transformer Models for Enhanced Human Action Recognition
  2 Nov 2023 0 repositories listed
• Group Distributionally Robust Knowledge Distillation
  1 Nov 2023 0 repositories listed
• NEO-KD: Knowledge-Distillation-Based Adversarial Training for Robust Multi-Exit Neural Networks
  1 Nov 2023 0 repositories listed
• Interactive Multi-fidelity Learning for Cost-effective Adaptation of Language Model with Sparse Human Supervision
  31 Oct 2023 0 repositories listed
• MUST: A Multilingual Student-Teacher Learning approach for low-resource speech recognition
  29 Oct 2023 0 repositories listed
• RCKD: Response-Based Cross-Task Knowledge Distillation for Pathological Image Analysis
  29 Oct 2023 0 repositories listed
• Efficient Object Detection in Optical Remote Sensing Imagery via Attention-based Feature Distillation
  28 Oct 2023 0 repositories listed
• Multi-label Emotion Analysis in Conversation via Multimodal Knowledge Distillation
  27 Oct 2023 0 repositories listed
• SonoSAMTrack -- Segment and Track Anything on Ultrasound Images
  25 Oct 2023 0 repositories listed
• ABKD: Graph Neural Network Compression with Attention-Based Knowledge Distillation
  24 Oct 2023 0 repositories listed
• Wakening Past Concepts without Past Data: Class-Incremental Learning from Online Placebos
  24 Oct 2023 0 repositories listed
• Leveraging Complementary Attention maps in vision transformers for OCT image analysis
  21 Oct 2023 0 repositories listed
• Data-Free Knowledge Distillation Using Adversarially Perturbed OpenGL Shader Images
  20 Oct 2023 0 repositories listed
• Enhancing Abstractiveness of Summarization Models through Calibrated Distillation
  20 Oct 2023 0 repositories listed
• GenDistiller: Distilling Pre-trained Language Models based on Generative Models
  20 Oct 2023 0 repositories listed
• A Comparative Analysis of Task-Agnostic Distillation Methods for Compressing Transformer Language Models
  13 Oct 2023 0 repositories listed
• Revisiting Multi-modal 3D Semantic Segmentation in Real-world Autonomous Driving
  13 Oct 2023 0 repositories listed
• DistillSpec: Improving Speculative Decoding via Knowledge Distillation
  12 Oct 2023 0 repositories listed
• Distilling Efficient Vision Transformers from CNNs for Semantic Segmentation
  11 Oct 2023 0 repositories listed
• Knowledge Distillation for Anomaly Detection
  9 Oct 2023 0 repositories listed
• What do larger image classifiers memorise?
  9 Oct 2023 0 repositories listed
• Fair Feature Importance Scores for Interpreting Tree-Based Methods and Surrogates
  6 Oct 2023 0 repositories listed
• Heterogeneous Federated Learning Using Knowledge Codistillation
  4 Oct 2023 0 repositories listed
• I²KD-SLU: An Intra-Inter Knowledge Distillation Framework for Zero-Shot Cross-Lingual Spoken Language Understanding
  4 Oct 2023 0 repositories listed
• Improving Knowledge Distillation with Teacher's Explanation
  4 Oct 2023 0 repositories listed
• Talking Models: Distill Pre-trained Knowledge to Downstream Models via Interactive Communication
  4 Oct 2023 0 repositories listed
• Can a student Large Language Model perform as well as it's teacher?
  3 Oct 2023 0 repositories listed
• KGEx: Explaining Knowledge Graph Embeddings via Subgraph Sampling and Knowledge Distillation
  2 Oct 2023 0 repositories listed
• Learnable Cross-modal Knowledge Distillation for Multi-modal Learning with Missing Modality
  2 Oct 2023 0 repositories listed
• Towards Fixing Clever-Hans Predictors with Counterfactual Knowledge Distillation
  2 Oct 2023 0 repositories listed
• Towards LogiGLUE: A Brief Survey and A Benchmark for Analyzing Logical Reasoning Capabilities of Language Models
  2 Oct 2023 0 repositories listed
• Distilling Inductive Bias: Knowledge Distillation Beyond Model Compression
  30 Sep 2023 0 repositories listed
• Towards Few-Call Model Stealing via Active Self-Paced Knowledge Distillation and Diffusion-Based Image Generation
  29 Sep 2023 0 repositories listed
• An Enhanced Low-Resolution Image Recognition Method for Traffic Environments
  28 Sep 2023 0 repositories listed
• Distill to Delete: Unlearning in Graph Networks with Knowledge Distillation
  28 Sep 2023 0 repositories listed
• Distilling ODE Solvers of Diffusion Models into Smaller Steps
  28 Sep 2023 0 repositories listed
• Cold & Warm Net: Addressing Cold-Start Users in Recommender Systems
  27 Sep 2023 0 repositories listed
• DualVC 2: Dynamic Masked Convolution for Unified Streaming and Non-Streaming Voice Conversion
  27 Sep 2023 0 repositories listed
• Inherit with Distillation and Evolve with Contrast: Exploring Class Incremental Semantic Segmentation Without Exemplar Memory
  27 Sep 2023 0 repositories listed
• VideoAdviser: Video Knowledge Distillation for Multimodal Transfer Learning
  27 Sep 2023 0 repositories listed
• ADU-Depth: Attention-based Distillation with Uncertainty Modeling for Depth Estimation
  26 Sep 2023 0 repositories listed
• Contrastive Continual Multi-view Clustering with Filtered Structural Fusion
  26 Sep 2023 0 repositories listed
• DONNAv2 -- Lightweight Neural Architecture Search for Vision tasks
  26 Sep 2023 0 repositories listed
• Learning Using Generated Privileged Information by Text-to-Image Diffusion Models
  26 Sep 2023 0 repositories listed
• Noise-Tolerant Few-Shot Unsupervised Adapter for Vision-Language Models
  26 Sep 2023 0 repositories listed
• Unsupervised 3D Perception with 2D Vision-Language Distillation for Autonomous Driving
  25 Sep 2023 0 repositories listed
• DFRD: Data-Free Robustness Distillation for Heterogeneous Federated Learning
  24 Sep 2023 0 repositories listed
• Multivariate Prototype Representation for Domain-Generalized Incremental Learning
  24 Sep 2023 0 repositories listed
• Poster: Self-Supervised Quantization-Aware Knowledge Distillation
  22 Sep 2023 0 repositories listed
• Triple-View Knowledge Distillation for Semi-Supervised Semantic Segmentation
  22 Sep 2023 0 repositories listed
• VIC-KD: Variance-Invariance-Covariance Knowledge Distillation to Make Keyword Spotting More Robust Against Adversarial Attacks
  22 Sep 2023 0 repositories listed
• Defending against Data-Free Model Extraction by Distributionally Robust Defensive Training
  21 Sep 2023 0 repositories listed
• Defending against Data-Free Model Extraction by Distributionally Robust Defensive Training
  21 Sep 2023 0 repositories listed
• Language-Oriented Communication with Semantic Coding and Knowledge Distillation for Text-to-Image Generation
  20 Sep 2023 0 repositories listed
• Improving CLIP Robustness with Knowledge Distillation and Self-Training
  19 Sep 2023 0 repositories listed
• Incorporating Ultrasound Tongue Images for Audio-Visual Speech Enhancement
  19 Sep 2023 0 repositories listed
• Distilling HuBERT with LSTMs via Decoupled Knowledge Distillation
  18 Sep 2023 0 repositories listed
• Heterogeneous Generative Knowledge Distillation with Masked Image Modeling
  18 Sep 2023 0 repositories listed
• UNIDEAL: Curriculum Knowledge Distillation Federated Learning
  16 Sep 2023 0 repositories listed
• Cross-lingual Knowledge Distillation via Flow-based Voice Conversion for Robust Polyglot Text-To-Speech
  15 Sep 2023 0 repositories listed
• One-Class Knowledge Distillation for Spoofing Speech Detection
  15 Sep 2023 0 repositories listed
• Privacy-preserving Early Detection of Epileptic Seizures in Videos
  15 Sep 2023 0 repositories listed
• Two-Step Knowledge Distillation for Tiny Speech Enhancement
  15 Sep 2023 0 repositories listed
• A Novel Local-Global Feature Fusion Framework for Body-weight Exercise Recognition with Pressure Mapping Sensors
  14 Sep 2023 0 repositories listed
• CoLLD: Contrastive Layer-to-layer Distillation for Compressing Multilingual Pre-trained Speech Encoders
  14 Sep 2023 0 repositories listed
• ChromaDistill: Colorizing Monochrome Radiance Fields with Knowledge Distillation
  14 Sep 2023 0 repositories listed
• Continual Learning with Dirichlet Generative-based Rehearsal
  13 Sep 2023 0 repositories listed
• Self-Training and Multi-Task Learning for Limited Data: Evaluation Study on Object Detection
  12 Sep 2023 0 repositories listed
• KD-FixMatch: Knowledge Distillation Siamese Neural Networks
  11 Sep 2023 0 repositories listed
• DeViT: Decomposing Vision Transformers for Collaborative Inference in Edge Devices
  10 Sep 2023 0 repositories listed
• Speech Emotion Recognition with Distilled Prosodic and Linguistic Affect Representations
  9 Sep 2023 0 repositories listed
• 3D Denoisers are Good 2D Teachers: Molecular Pretraining via Denoising and Cross-Modal Distillation
  8 Sep 2023 0 repositories listed
• Knowledge Distillation-Empowered Digital Twin for Anomaly Detection
  8 Sep 2023 0 repositories listed
• Towards Comparable Knowledge Distillation in Semantic Image Segmentation
  7 Sep 2023 0 repositories listed
• A deep Natural Language Inference predictor without language-specific training data
  6 Sep 2023 0 repositories listed
• DMKD: Improving Feature-based Knowledge Distillation for Object Detection Via Dual Masking Augmentation
  6 Sep 2023 0 repositories listed
• Leveraging ASR Pretrained Conformers for Speaker Verification through Transfer Learning and Knowledge Distillation
  6 Sep 2023 0 repositories listed
• A survey on efficient vision transformers: algorithms, techniques, and performance benchmarking
  5 Sep 2023 0 repositories listed
• Fast and High-Performance Learned Image Compression With Improved Checkerboard Context Model, Deformable Residual Module, and Knowledge Distillation
  5 Sep 2023 0 repositories listed
• Probabilistic Self-supervised Learning via Scoring Rules Minimization
  5 Sep 2023 0 repositories listed
• TODM: Train Once Deploy Many Efficient Supernet-Based RNN-T Compression For On-device ASR Models
  5 Sep 2023 0 repositories listed
• On the Query Strategies for Efficient Online Active Distillation
  4 Sep 2023 0 repositories listed
• Prior Knowledge Guided Network for Video Anomaly Detection
  4 Sep 2023 0 repositories listed
• Adversarial Finetuning with Latent Representation Constraint to Mitigate Accuracy-Robustness Tradeoff
  31 Aug 2023 0 repositories listed
• Knowledge Distillation from Non-streaming to Streaming ASR Encoder using Auxiliary Non-streaming Layer
  31 Aug 2023 0 repositories listed
• Towards Long-Tailed Recognition for Graph Classification via Collaborative Experts
  31 Aug 2023 0 repositories listed