Browse State-of-the-Art › Knowledge Distillation › Papers, page 27

Knowledge Distillation

Papers archive 2025-07-28

archive papers tagged: 4,240 · with a code link: 1,740 · where Syntology ran a sample: 451 (380 with a run with no instrument failure, 71 where every run was a failure of Syntology's instrument) Syntology

Show: all tagged papersonly where code ran (451 of 4,240 tagged: 380 with a run with no instrument failure, 71 where every run was a failure of Syntology's instrument)

Page 27 of 43: papers 2,601 to 2,700 of 4,240, in archive order: by repositories listed in the archive (most first), then newest first, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers that list no repository come after every paper that lists one.

Papers without a page here are shown as plain text. A Syntology line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the figure “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code); hover it for the repositories the samples that ran came from. Abstracts are on each paper's page.

• Scavenging Hyena: Distilling Transformers into Long Convolution Models
  31 Jan 2024 0 repositories listed
• A Comprehensive Survey of Compression Algorithms for Language Models
  27 Jan 2024 0 repositories listed
• Distilling Privileged Multimodal Information for Expression Recognition using Optimal Transport
  27 Jan 2024 0 repositories listed
• Dynamic Transformer Architecture for Continual Learning of Multimodal Tasks
  27 Jan 2024 0 repositories listed
• Face to Cartoon Incremental Super-Resolution using Knowledge Distillation
  27 Jan 2024 0 repositories listed
• Large Language Model Guided Knowledge Distillation for Time Series Anomaly Detection
  26 Jan 2024 0 repositories listed
• Self-supervised Video Object Segmentation with Distillation Learning of Deformable Attention
  25 Jan 2024 0 repositories listed
• Towards Complementary Knowledge Distillation for Efficient Dense Image Prediction
  24 Jan 2024 0 repositories listed
• A Novel Garment Transfer Method Supervised by Distilled Knowledge of Virtual Try-on Model
  23 Jan 2024 0 repositories listed
• Knowledge Distillation from Language-Oriented to Emergent Communication for Multi-Agent Remote Control
  23 Jan 2024 0 repositories listed
• Keep Decoding Parallel with Effective Knowledge Distillation from Language Models to End-to-end Speech Recognisers
  22 Jan 2024 0 repositories listed
• Knowledge Distillation on Spatial-Temporal Graph Convolutional Network for Traffic Prediction
  22 Jan 2024 0 repositories listed
• Robustness to distribution shifts of compressed networks for edge devices
  22 Jan 2024 0 repositories listed
• Stereo-Matching Knowledge Distilled Monocular Depth Estimation Filtered by Multiple Disparity Consistency
  22 Jan 2024 0 repositories listed
• Zoom-shot: Fast and Efficient Unsupervised Zero-Shot Transfer of CLIP to Vision Encoders with Multimodal Loss
  22 Jan 2024 0 repositories listed
• Confidence Preservation Property in Knowledge Distillation Abstractions
  21 Jan 2024 0 repositories listed
• Enhancing Scalability in Recommender Systems through Lottery Ticket Hypothesis and Knowledge Distillation-based Neural Network Pruning
  19 Jan 2024 0 repositories listed
• Cross-Level Multi-Instance Distillation for Self-Supervised Fine-Grained Visual Categorization
  16 Jan 2024 0 repositories listed
• A Deep Hierarchical Feature Sparse Framework for Occluded Person Re-Identification
  15 Jan 2024 0 repositories listed
• Lightweight Modality Adaptation to Sequential Recommendation via Correlation Supervision
  14 Jan 2024 0 repositories listed
• EVOKE: Emotion Enabled Virtual Avatar Mapping Using Optimized Knowledge Distillation
  13 Jan 2024 0 repositories listed
• Knowledge Distillation of Black-Box Large Language Models
  13 Jan 2024 0 repositories listed
• An Empirical Investigation into the Effect of Parameter Choices in Knowledge Distillation
  12 Jan 2024 0 repositories listed
• Direct Distillation between Different Domains
  12 Jan 2024 0 repositories listed
• Exploring Self- and Cross-Triplet Correlations for Human-Object Interaction Detection
  11 Jan 2024 0 repositories listed
• Object-Centric Diffusion for Efficient Video Editing
  11 Jan 2024 0 repositories listed
• Hierarchical Knowledge Distillation on Text Graph for Data-limited Attribute Inference
  10 Jan 2024 0 repositories listed
• Logits Poisoning Attack in Federated Distillation
  8 Jan 2024 0 repositories listed
• Multi-Channel Multi-Domain based Knowledge Distillation Algorithm for Sleep Staging with Single-Channel EEG
  7 Jan 2024 0 repositories listed
• CTC Blank Triggered Dynamic Layer-Skipping for Efficient CTC-based Speech Recognition
  4 Jan 2024 0 repositories listed
• Distilling Temporal Knowledge with Masked Feature Reconstruction for 3D Object Detection
  3 Jan 2024 0 repositories listed
• Self-supervised Reflective Learning through Self-distillation and Online Clustering for Speaker Representation Learning
  3 Jan 2024 0 repositories listed
• Dual Teacher Knowledge Distillation with Domain Alignment for Face Anti-spoofing
  2 Jan 2024 0 repositories listed
• Query-Based Knowledge Sharing for Open-Vocabulary Multi-Label Classification
  2 Jan 2024 0 repositories listed
• Building Vision-Language Models on Solid Foundations with Masked Distillation
  1 Jan 2024 0 repositories listed
• C2KD: Bridging the Modality Gap for Cross-Modal Knowledge Distillation
  1 Jan 2024 0 repositories listed
• Distilling CLIP with Dual Guidance for Learning Discriminative Human Body Shape Representation
  1 Jan 2024 0 repositories listed
• IQ-VFI: Implicit Quadratic Motion Estimation for Video Frame Interpolation
  1 Jan 2024 0 repositories listed
• KD-DETR: Knowledge Distillation for Detection Transformer with Consistent Distillation Points Sampling
  1 Jan 2024 0 repositories listed
• Robust Distillation via Untargeted and Targeted Intermediate Adversarial Samples
  1 Jan 2024 0 repositories listed
• Scene-adaptive and Region-aware Multi-modal Prompt for Open Vocabulary Object Detection
  1 Jan 2024 0 repositories listed
• Uncertainty-Guided Never-Ending Learning to Drive
  1 Jan 2024 0 repositories listed
• Compressing Deep Image Super-resolution Models
  31 Dec 2023 0 repositories listed
• Explainability-Driven Leaf Disease Classification Using Adversarial Training and Knowledge Distillation
  30 Dec 2023 0 repositories listed
• ClST: A Convolutional Transformer Framework for Automatic Modulation Recognition by Knowledge Distillation
  29 Dec 2023 0 repositories listed
• FedSDD: Scalable and Diversity-enhanced Distillation for Model Aggregation in Federated Learning
  28 Dec 2023 0 repositories listed
• Layer Attack Unlearning: Fast and Accurate Machine Unlearning via Layer Level Attack and Knowledge Distillation
  28 Dec 2023 0 repositories listed
• Temporal Knowledge Distillation for Time-Sensitive Financial Services Applications
  28 Dec 2023 0 repositories listed
• X Modality Assisting RGBT Object Tracking
  27 Dec 2023 0 repositories listed
• AdapterDistillation: Non-Destructive Task Composition with Knowledge Distillation
  26 Dec 2023 0 repositories listed
• Cloud-Device Collaborative Learning for Multimodal Large Language Models
  26 Dec 2023 0 repositories listed
• Knowledge Distillation of LLM for Automatic Scoring of Science Education Assessments
  26 Dec 2023 0 repositories listed
• Compressing Image-to-Image Translation GANs Using Local Density Structures on Their Learned Manifold
  22 Dec 2023 0 repositories listed
• Less or More From Teacher: Exploiting Trilateral Geometry For Knowledge Distillation
  22 Dec 2023 0 repositories listed
• How to Prune Your Language Model: Recovering Accuracy on the "Sparsity May Cry'' Benchmark
  21 Dec 2023 0 repositories listed
• DSFormer: Effective Compression of Text-Transformers by Dense-Sparse Weight Factorization
  20 Dec 2023 0 repositories listed
• Expediting Contrastive Language-Image Pretraining via Self-distilled Encoders
  19 Dec 2023 0 repositories listed
• RadOcc: Learning Cross-Modality Occupancy Knowledge through Rendering Assisted Distillation
  19 Dec 2023 0 repositories listed
• Mixed Distillation Helps Smaller Language Model Better Reasoning
  17 Dec 2023 0 repositories listed
• FastSR-NeRF: Improving NeRF Efficiency on Consumer Devices with A Simple Super-Resolution Pipeline
  15 Dec 2023 0 repositories listed
• Student as an Inherent Denoiser of Noisy Teacher
  15 Dec 2023 0 repositories listed
• Efficient speech detection in environmental audio using acoustic recognition and knowledge distillation
  14 Dec 2023 0 repositories listed
• RankDVQA-mini: Knowledge Distillation-Driven Deep Video Quality Assessment
  14 Dec 2023 0 repositories listed
• RdimKD: Generic Distillation Paradigm by Dimensionality Reduction
  14 Dec 2023 0 repositories listed
• Unraveling Key Factors of Knowledge Distillation
  14 Dec 2023 0 repositories listed
• Cooperative Learning for Cost-Adaptive Inference
  13 Dec 2023 0 repositories listed
• Fast Sampling Through The Reuse Of Attention Maps In Diffusion Models
  13 Dec 2023 0 repositories listed
• A dynamic interactive learning framework for automated 3D medical image segmentation
  11 Dec 2023 0 repositories listed
• Fake It Till Make It: Federated Learning with Consensus-Oriented Generation
  10 Dec 2023 0 repositories listed
• IL-NeRF: Incremental Learning for Neural Radiance Fields with Camera Pose Alignment
  10 Dec 2023 0 repositories listed
• NovaCOMET: Open Commonsense Foundation Models with Symbolic Knowledge Distillation
  10 Dec 2023 0 repositories listed
• KOALA: Empirical Lessons Toward Memory-Efficient and Fast Diffusion Models for Text-to-Image Synthesis
  7 Dec 2023 0 repositories listed
• Synchronization is All You Need: Exocentric-to-Egocentric Transfer for Temporal Action Segmentation with Unlabeled Synchronized Video Pairs
  5 Dec 2023 0 repositories listed
• Contrastive Learning-Based Spectral Knowledge Distillation for Multi-Modality and Missing Modality Scenarios in Semantic Segmentation
  4 Dec 2023 0 repositories listed
• TriDeNT: Triple Deep Network Training for Privileged Knowledge Distillation in Histopathology
  4 Dec 2023 0 repositories listed
• OplixNet: Towards Area-Efficient Optical Split-Complex Networks with Real-to-Complex Data Assignment and Knowledge Distillation
  3 Dec 2023 0 repositories listed
• S2P3: Self-Supervised Polarimetric Pose Prediction
  2 Dec 2023 0 repositories listed
• Compression of end-to-end non-autoregressive image-to-speech system for low-resourced devices
  30 Nov 2023 0 repositories listed
• IAG: Induction-Augmented Generation Framework for Answering Reasoning Questions
  30 Nov 2023 0 repositories listed
• LayerCollapse: Adaptive compression of neural networks
  29 Nov 2023 0 repositories listed
• Propagate & Distill: Towards Effective Graph Learners Using Propagation-Embracing MLPs
  29 Nov 2023 0 repositories listed
• DiffusionTalker: Personalization and Acceleration for Speech-Driven 3D Face Diffuser
  28 Nov 2023 0 repositories listed
• FedAL: Black-Box Federated Knowledge Distillation Enabled by Adversarial Learning
  28 Nov 2023 0 repositories listed
• Double Reverse Regularization Network Based on Self-Knowledge Distillation for SAR Object Classification
  26 Nov 2023 0 repositories listed
• Unlearning via Sparse Representations
  26 Nov 2023 0 repositories listed
• Wired Perspectives: Multi-View Wire Art Embraces Generative AI
  26 Nov 2023 0 repositories listed
• Cosine Similarity Knowledge Distillation for Individual Class Information Transfer
  24 Nov 2023 0 repositories listed
• Efficient Open-world Reinforcement Learning via Knowledge Distillation and Autonomous Rule Discovery
  24 Nov 2023 0 repositories listed
• Maximizing Discrimination Capability of Knowledge Distillation with Energy Function
  24 Nov 2023 0 repositories listed
• Pseudo-label Correction for Instance-dependent Noise Using Teacher-student Framework
  24 Nov 2023 0 repositories listed
• Bridging Classical and Quantum Machine Learning: Knowledge Transfer From Classical to Quantum Neural Networks Using Knowledge Distillation
  23 Nov 2023 0 repositories listed
• Education distillation:getting student models to learn in shcools
  23 Nov 2023 0 repositories listed
• Knowledge Distillation Based Semantic Communications For Multiple Users
  23 Nov 2023 0 repositories listed
• Robustness-Reinforced Knowledge Distillation with Correlation Distance and Network Pruning
  23 Nov 2023 0 repositories listed
• Efficient Transformer Knowledge Distillation: A Performance Review
  22 Nov 2023 0 repositories listed
• EA-KD: Entropy-based Adaptive Knowledge Distillation
  22 Nov 2023 0 repositories listed
• Unveiling the Unseen Potential of Graph Learning through MLPs: Effective Graph Learners Using Propagation-Embracing MLPs
  20 Nov 2023 0 repositories listed
• LightBTSeg: A lightweight breast tumor segmentation model using ultrasound images via dual-path joint knowledge distillation
  18 Nov 2023 0 repositories listed
• Rethinking Attention: Exploring Shallow Feed-Forward Neural Networks as an Alternative to Attention Layers in Transformers
  17 Nov 2023 0 repositories listed
• Semi-supervised ViT knowledge distillation network with style transfer normalization for colorectal liver metastases survival prediction
  17 Nov 2023 0 repositories listed