Browse State-of-the-Art › Knowledge Distillation › Papers, page 23
Knowledge Distillation
Papers archive 2025-07-28
archive papers tagged: 4,240 · with a code link: 1,740 · where Syntology ran a sample: 451 (380 with a run with no instrument failure, 71 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (451 of 4,240 tagged: 380 with a run with no instrument failure, 71 where every run was a failure of Syntology's instrument)
Page 23 of 43: papers 2,201 to 2,300 of 4,240, in archive order: by repositories listed in the archive (most first), then newest first, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers that list no repository come after every paper that lists one.
Papers without a page here are shown as plain text. A Syntology line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the figure “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code); hover it for the repositories the samples that ran came from. Abstracts are on each paper's page.
-
ReasoningRank: Teaching Student Models to Rank through Reasoning-Based Knowledge Distillation7 Oct 2024 0 repositories listed
-
Accelerating Diffusion Models with One-to-Many Knowledge Distillation5 Oct 2024 0 repositories listed
-
DiDOTS: Knowledge Distillation from Large-Language-Models for Dementia Obfuscation in Transcribed Speech5 Oct 2024 0 repositories listed
-
Gap Preserving Distillation by Building Bidirectional Mappings with A Dynamic Teacher5 Oct 2024 0 repositories listed
-
DocKD: Knowledge Distillation from LLMs for Open-World Document Understanding Models4 Oct 2024 0 repositories listed
-
Self-Supervised Keypoint Detection with Distilled Depth Keypoint Representation4 Oct 2024 0 repositories listed
-
Advancing Medical Radiograph Representation Learning: A Hybrid Pre-training Paradigm with Multilevel Semantic Granularity1 Oct 2024 0 repositories listed
-
Compressing Recurrent Neural Networks for FPGA-accelerated Implementation in Fluorescence Lifetime Imaging1 Oct 2024 0 repositories listed
-
Efficient Technical Term Translation: A Knowledge Distillation Approach for Parenthetical Terminology Translation1 Oct 2024 0 repositories listed
-
Local-to-Global Self-Supervised Representation Learning for Diabetic Retinopathy Grading1 Oct 2024 0 repositories listed
-
Self-Updatable Large Language Models with Parameter Integration1 Oct 2024 0 repositories listed
-
Classroom-Inspired Multi-Mentor Distillation with Adaptive Learning Strategies30 Sep 2024 0 repositories listed
-
Enhancing Romanian Offensive Language Detection through Knowledge Distillation, Multi-Task Learning, and Data Augmentation30 Sep 2024 0 repositories listed
-
HYDRA-FL: Hybrid Knowledge Distillation for Robust and Accurate Federated Learning30 Sep 2024 0 repositories listed
-
Linear Projections of Teacher Embeddings for Few-Class Distillation30 Sep 2024 0 repositories listed
-
InfantCryNet: A Data-driven Framework for Intelligent Analysis of Infant Cries29 Sep 2024 0 repositories listed
-
Tailored Federated Learning: Leveraging Direction Regulation & Knowledge Distillation29 Sep 2024 0 repositories listed
-
Mind the Gap: Promoting Missing Modality Brain Tumor Segmentation with Alignment28 Sep 2024 0 repositories listed
-
Harmonizing knowledge Transfer in Neural Network with Unified Distillation27 Sep 2024 0 repositories listed
-
MiniVLN: Efficient Vision-and-Language Navigation by Progressive Knowledge Distillation27 Sep 2024 0 repositories listed
-
Multi-modal Cross-domain Self-supervised Pre-training for fMRI and EEG Fusion27 Sep 2024 0 repositories listed
-
Semi-Supervised Bone Marrow Lesion Detection from Knee MRI Segmentation Using Mask Inpainting Models27 Sep 2024 0 repositories listed
-
Student-Oriented Teacher Knowledge Refinement for Knowledge Distillation27 Sep 2024 0 repositories listed
-
Kendall's τ Coefficient for Logits Distillation26 Sep 2024 0 repositories listed
-
Weak-to-Strong Backdoor Attack for Large Language Models26 Sep 2024 0 repositories listed
-
Adverse Weather Optical Flow: Cumulative Homogeneous-Heterogeneous Adaptation25 Sep 2024 0 repositories listed
-
MT2KD: Towards A General-Purpose Encoder for Speech, Speaker, and Audio Events25 Sep 2024 0 repositories listed
-
SelectiveKD: A semi-supervised framework for cancer detection in DBT through Knowledge Distillation and Pseudo-labeling25 Sep 2024 0 repositories listed
-
Privacy Evaluation Benchmarks for NLP Models24 Sep 2024 0 repositories listed
-
Twin Network Augmentation: A Novel Training Strategy for Improved Spiking Neural Networks and Efficient Weight Quantization24 Sep 2024 0 repositories listed
-
Pre-trained Language Model and Knowledge Distillation for Lightweight Sequential Recommendation23 Sep 2024 0 repositories listed
-
TS-HTFA: Advancing Time Series Forecasting via Hierarchical Text-Free Alignment with Large Language Models23 Sep 2024 0 repositories listed
-
DilateQuant: Accurate and Efficient Diffusion Quantization via Weight Dilation22 Sep 2024 0 repositories listed
-
EchoAtt: Attend, Copy, then Adjust for More Efficient Large Language Models22 Sep 2024 0 repositories listed
-
Prior Knowledge Distillation Network for Face Super-Resolution22 Sep 2024 0 repositories listed
-
On Importance of Pruning and Distillation for Efficient Low Resource NLP21 Sep 2024 0 repositories listed
-
Generalization in birdsong classification: impact of transfer learning methods and dataset characteristics21 Sep 2024 0 repositories listed
-
Fast Streaming Transducer ASR Prototyping via Knowledge Distillation with Whisper20 Sep 2024 0 repositories listed
-
Simple Unsupervised Knowledge Distillation With Space Similarity20 Sep 2024 0 repositories listed
-
Bayesian-Optimized One-Step Diffusion Model with Knowledge Distillation for Real-Time 3D Human Motion Prediction19 Sep 2024 0 repositories listed
-
Efficient Knowledge Distillation: Empowering Small Language Models with Teacher Model Insights19 Sep 2024 0 repositories listed
-
Enhancing SLM via ChatGPT and Dataset Augmentation19 Sep 2024 0 repositories listed
-
Exploring and Enhancing the Transfer of Distribution in Knowledge Distillation for Autoregressive Language Models19 Sep 2024 0 repositories listed
-
Improving Cone-Beam CT Image Quality with Knowledge Distillation-Enhanced Diffusion Model in Imbalanced Data Settings19 Sep 2024 0 repositories listed
-
LLMR: Knowledge Distillation with a Large Language Model-Induced Reward19 Sep 2024 0 repositories listed
-
Small Language Models are Equation Reasoners19 Sep 2024 0 repositories listed
-
Applications of Knowledge Distillation in Remote Sensing: A Survey18 Sep 2024 0 repositories listed
-
Data Efficient Acoustic Scene Classification using Teacher-Informed Confusing Class Instruction18 Sep 2024 0 repositories listed
-
StableMamba: Distillation-free Scaling of Large SSMs for Images and Videos18 Sep 2024 0 repositories listed
-
EFCM: Efficient Fine-tuning on Compressed Models for deployment of large models in medical image analysis18 Sep 2024 0 repositories listed
-
Single-stage TTS with Masked Audio Token Modeling and Semantic Knowledge Distillation17 Sep 2024 0 repositories listed
-
Unleashing the Potential of Mamba: Boosting a LiDAR 3D Sparse Detector by Using Cross-Model Knowledge Distillation17 Sep 2024 0 repositories listed
-
Human Insights Driven Latent Space for Different Driving Perspectives: A Unified Encoder for Efficient Multi-Task Inference16 Sep 2024 0 repositories listed
-
Integrated Multi-Level Knowledge Distillation for Enhanced Speaker Verification14 Sep 2024 0 repositories listed
-
Joint Semantic Knowledge Distillation and Masked Acoustic Modeling for Full-band Speech Restoration with Improved Intelligibility14 Sep 2024 0 repositories listed
-
AWF: Adaptive Weight Fusion for Enhanced Class Incremental Semantic Segmentation13 Sep 2024 0 repositories listed
-
DiReDi: Distillation and Reverse Distillation for AIoT Applications12 Sep 2024 0 repositories listed
-
Learn from Balance: Rectifying Knowledge Transfer for Long-Tailed Scenarios12 Sep 2024 0 repositories listed
-
A Continual and Incremental Learning Approach for TinyML On-device Training Using Dataset Distillation and Model Size Adaption11 Sep 2024 0 repositories listed
-
DS-ViT: Dual-Stream Vision Transformer for Cross-Task Distillation in Alzheimer's Early Diagnosis11 Sep 2024 0 repositories listed
-
Enhancing CTC-Based Visual Speech Recognition11 Sep 2024 0 repositories listed
-
Privacy-Preserving Federated Learning with Consistency via Knowledge Distillation Using Conditional Generator11 Sep 2024 0 repositories listed
-
Applied Federated Model Personalisation in the Industrial Domain: A Comparative Study10 Sep 2024 0 repositories listed
-
Distilling Generative-Discriminative Representations for Very Low-Resolution Face Recognition10 Sep 2024 0 repositories listed
-
How Redundant Is the Transformer Stack in Speech Representation Models?10 Sep 2024 0 repositories listed
-
Knowledge Distillation via Query Selection for Detection Transformer10 Sep 2024 0 repositories listed
-
Complex Emotion Recognition System using basic emotions via Facial Expression, EEG, and ECG Signals: a review9 Sep 2024 0 repositories listed
-
Joint Input and Output Coordination for Class-Incremental Learning9 Sep 2024 0 repositories listed
-
Look One and More: Distilling Hybrid Order Relational Knowledge for Cross-Resolution Image Recognition9 Sep 2024 0 repositories listed
-
LoCa: Logit Calibration for Knowledge Distillation7 Sep 2024 0 repositories listed
-
SCARF: Scalable Continual Learning Framework for Memory-efficient Multiple Neural Radiance Fields6 Sep 2024 0 repositories listed
-
Data-free Distillation with Degradation-prompt Diffusion for Multi-weather Image Restoration5 Sep 2024 0 repositories listed
-
Experimentation in Content Moderation using RWKV5 Sep 2024 0 repositories listed
-
Collaborative Learning for Enhanced Unsupervised Domain Adaptation4 Sep 2024 0 repositories listed
-
Efficient Image Compression Using Advanced State Space Models4 Sep 2024 0 repositories listed
-
Low-Resolution Object Recognition with Cross-Resolution Relational Contrastive Distillation4 Sep 2024 0 repositories listed
-
Non-target Divergence Hypothesis: Toward Understanding Domain Gaps in Cross-Modal Knowledge Distillation4 Sep 2024 0 repositories listed
-
4 Sep 2024 0 repositories listed Syntology 4 ran (of which 3 constructed an object rather than computing a result; 4 with no instrument failure: 1 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 4 harvested samples) · 4 pointer-only (licence)
-
Adaptive Explicit Knowledge Transfer for Knowledge Distillation3 Sep 2024 0 repositories listed
-
Efficient Point Cloud Classification via Offline Distillation Framework and Negative-Weight Self-Distillation Technique3 Sep 2024 0 repositories listed
-
Improving Apple Object Detection with Occlusion-Enhanced Distillation3 Sep 2024 0 repositories listed
-
Low-Resolution Face Recognition via Adaptable Instance-Relation Distillation3 Sep 2024 0 repositories listed
-
Compressing VAE-Based Out-of-Distribution Detectors for Embedded Deployment2 Sep 2024 0 repositories listed
-
Smaller, Weaker, Yet Better: Training LLM Reasoners via Compute-Optimal Sampling29 Aug 2024 0 repositories listed
-
VLM-KD: Knowledge Distillation from VLM for Long-Tail Visual Recognition29 Aug 2024 0 repositories listed
-
Boosting Lossless Speculative Decoding via Feature Sampling and Partial Alignment Distillation28 Aug 2024 0 repositories listed
-
ModalityMirror: Improving Audio Classification in Modality Heterogeneity Federated Learning with Multimodal Distillation28 Aug 2024 0 repositories listed
-
Online pre-training with long-form videos28 Aug 2024 0 repositories listed
-
Bridging the Gap: Unpacking the Hidden Challenges in Knowledge Distillation for Online Ranking Systems26 Aug 2024 0 repositories listed
-
Let Video Teaches You More: Video-to-Image Knowledge Distillation using DEtection TRansformer for Medical Video Lesion Detection26 Aug 2024 0 repositories listed
-
TSAK: Two-Stage Semantic-Aware Knowledge Distillation for Efficient Wearable Modality and Model Optimization in Manufacturing Lines26 Aug 2024 0 repositories listed
-
Bring the Power of Diffusion Model to Defect Detection25 Aug 2024 0 repositories listed
-
Condensed Sample-Guided Model Inversion for Knowledge Distillation25 Aug 2024 0 repositories listed
-
Foundational Model for Electron Micrograph Analysis: Instruction-Tuning Small-Scale Language-and-Vision Assistant for Enterprise Adoption23 Aug 2024 0 repositories listed
-
Growing Deep Neural Network Considering with Similarity between Neurons23 Aug 2024 0 repositories listed
-
Interactive DualChecker for Mitigating Hallucinations in Distilling Large Language Models22 Aug 2024 0 repositories listed
-
Rebalancing Multi-Label Class-Incremental Learning22 Aug 2024 0 repositories listed
-
Vision-Based Detection of Uncooperative Targets and Components on Small Satellites22 Aug 2024 0 repositories listed
-
A Unified Framework for Continual Learning and Unlearning21 Aug 2024 0 repositories listed
-
Domain-invariant Progressive Knowledge Distillation for UAV-based Object Detection21 Aug 2024 0 repositories listed
Syntology lines on 1 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced; each line links to that paper's sample list. Syntology's record for this page has not changed since , the first build that kept a record date for it; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.