Methods › General › Knowledge Distillation › Knowledge Distillation › Papers, page 6
Knowledge Distillation
Papers archive 2025-07-28
archive papers tagged: 3,071 · with a code link: 1,258 · where Syntology ran a sample: 320 (276 with a run with no instrument failure, 44 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (320 of 3,071 tagged: 276 with a run with no instrument failure, 44 where every run was a failure of Syntology's instrument)
Page 6 of 31: papers 501 to 600 of 3,071, newest first by the archive's date (ties by slug), in archive order.
Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code, as “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. It is per sample and not a correctness claim. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from.
-
Domain Consistency Representation Learning for Lifelong Person Re-Identification 30 Sep 2024 · 1 repository · arXiv:2409.19954
-
Classroom-Inspired Multi-Mentor Distillation with Adaptive Learning Strategies 30 Sep 2024 · 0 repositories · arXiv:2409.20237
-
Enhancing Romanian Offensive Language Detection through Knowledge Distillation, Multi-Task Learning, and Data Augmentation 30 Sep 2024 · 0 repositories · arXiv:2409.20498
-
HYDRA-FL: Hybrid Knowledge Distillation for Robust and Accurate Federated Learning 30 Sep 2024 · 0 repositories · arXiv:2409.19912
-
InfantCryNet: A Data-driven Framework for Intelligent Analysis of Infant Cries 29 Sep 2024 · 0 repositories · arXiv:2409.19689
-
Tailored Federated Learning: Leveraging Direction Regulation & Knowledge Distillation 29 Sep 2024 · 0 repositories · arXiv:2409.19741
-
Mind the Gap: Promoting Missing Modality Brain Tumor Segmentation with Alignment 28 Sep 2024 · 0 repositories · arXiv:2409.19366
-
Harmonizing knowledge Transfer in Neural Network with Unified Distillation 27 Sep 2024 · 0 repositories · arXiv:2409.18565
-
MiniVLN: Efficient Vision-and-Language Navigation by Progressive Knowledge Distillation 27 Sep 2024 · 0 repositories · arXiv:2409.18800
-
Multi-modal Cross-domain Self-supervised Pre-training for fMRI and EEG Fusion 27 Sep 2024 · 0 repositories · arXiv:2409.19130
-
Semi-Supervised Bone Marrow Lesion Detection from Knee MRI Segmentation Using Mask Inpainting Models 27 Sep 2024 · 0 repositories · arXiv:2409.19185
-
Student-Oriented Teacher Knowledge Refinement for Knowledge Distillation 27 Sep 2024 · 0 repositories · arXiv:2409.18785
-
Towards Diverse Device Heterogeneous Federated Learning via Task Arithmetic Knowledge Integration 27 Sep 2024 · 1 repository · arXiv:2409.18461
-
Kendall's τ Coefficient for Logits Distillation 26 Sep 2024 · 0 repositories · arXiv:2409.17823
-
Shape-intensity knowledge distillation for robust medical image segmentation 26 Sep 2024 · 1 repository · arXiv:2409.17503
-
Weak-to-Strong Backdoor Attack for Large Language Models 26 Sep 2024 · 0 repositories · arXiv:2409.17946
-
MT2KD: Towards A General-Purpose Encoder for Speech, Speaker, and Audio Events 25 Sep 2024 · 0 repositories · arXiv:2409.17010
-
SelectiveKD: A semi-supervised framework for cancer detection in DBT through Knowledge Distillation and Pseudo-labeling 25 Sep 2024 · 0 repositories · arXiv:2409.16581
-
Privacy Evaluation Benchmarks for NLP Models 24 Sep 2024 · 0 repositories · arXiv:2409.15868
-
Twin Network Augmentation: A Novel Training Strategy for Improved Spiking Neural Networks and Efficient Weight Quantization 24 Sep 2024 · 0 repositories · arXiv:2409.15849
-
DSG-KD: Knowledge Distillation from Domain-Specific to General Language Models 23 Sep 2024 · 1 repository · arXiv:2409.14904
-
TS-HTFA: Advancing Time Series Forecasting via Hierarchical Text-Free Alignment with Large Language Models 23 Sep 2024 · 0 repositories · arXiv:2409.14978
-
DilateQuant: Accurate and Efficient Diffusion Quantization via Weight Dilation 22 Sep 2024 · 0 repositories · arXiv:2409.14307
-
EchoAtt: Attend, Copy, then Adjust for More Efficient Large Language Models 22 Sep 2024 · 0 repositories · arXiv:2409.14595
-
Prior Knowledge Distillation Network for Face Super-Resolution 22 Sep 2024 · 0 repositories · arXiv:2409.14385
-
On Importance of Pruning and Distillation for Efficient Low Resource NLP 21 Sep 2024 · 0 repositories · arXiv:2409.14162
-
Generalization in birdsong classification: impact of transfer learning methods and dataset characteristics 21 Sep 2024 · 0 repositories · arXiv:2409.15383
-
Neural-Symbolic Collaborative Distillation: Advancing Small Language Models for Complex Reasoning Tasks 20 Sep 2024 · 1 repository · arXiv:2409.13203Syntology official (archive's flag): 6 ran · 6 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 2 where Syntology's instrument failed) · 1 unverified (of 7 harvested samples) · 7 pointer-only (licence)
-
Simple Unsupervised Knowledge Distillation With Space Similarity 20 Sep 2024 · 0 repositories · arXiv:2409.13939
-
Bayesian-Optimized One-Step Diffusion Model with Knowledge Distillation for Real-Time 3D Human Motion Prediction 19 Sep 2024 · 0 repositories · arXiv:2409.12456
-
Efficient Knowledge Distillation: Empowering Small Language Models with Teacher Model Insights 19 Sep 2024 · 0 repositories · arXiv:2409.12586
-
Enhancing Knowledge Distillation of Large Language Models through Efficient Multi-Modal Distribution Alignment 19 Sep 2024 · 1 repository · arXiv:2409.12545
-
Enhancing SLM via ChatGPT and Dataset Augmentation 19 Sep 2024 · 0 repositories · arXiv:2409.12599
-
Enhancing TinyBERT for Financial Sentiment Analysis Using GPT-Augmented FinBERT Distillation 19 Sep 2024 · 1 repository · arXiv:2409.18999
-
Exploring and Enhancing the Transfer of Distribution in Knowledge Distillation for Autoregressive Language Models 19 Sep 2024 · 0 repositories · arXiv:2409.12512
-
LLMR: Knowledge Distillation with a Large Language Model-Induced Reward 19 Sep 2024 · 0 repositories · arXiv:2409.12500
-
Small Language Models are Equation Reasoners 19 Sep 2024 · 0 repositories · arXiv:2409.12393
-
Towards Low-latency Event-based Visual Recognition with Hybrid Step-wise Distillation Spiking Neural Networks 19 Sep 2024 · 1 repository · arXiv:2409.12507
-
Applications of Knowledge Distillation in Remote Sensing: A Survey 18 Sep 2024 · 0 repositories · arXiv:2409.12111
-
Data Efficient Acoustic Scene Classification using Teacher-Informed Confusing Class Instruction 18 Sep 2024 · 0 repositories · arXiv:2409.11964
-
EFCM: Efficient Fine-tuning on Compressed Models for deployment of large models in medical image analysis 18 Sep 2024 · 0 repositories · arXiv:2409.11817
-
Single-stage TTS with Masked Audio Token Modeling and Semantic Knowledge Distillation 17 Sep 2024 · 0 repositories · arXiv:2409.11003
-
Human Insights Driven Latent Space for Different Driving Perspectives: A Unified Encoder for Efficient Multi-Task Inference 16 Sep 2024 · 0 repositories · arXiv:2409.10095
-
Integrated Multi-Level Knowledge Distillation for Enhanced Speaker Verification 14 Sep 2024 · 0 repositories · arXiv:2409.09389
-
DiReDi: Distillation and Reverse Distillation for AIoT Applications 12 Sep 2024 · 0 repositories · arXiv:2409.08308
-
A Continual and Incremental Learning Approach for TinyML On-device Training Using Dataset Distillation and Model Size Adaption 11 Sep 2024 · 0 repositories · arXiv:2409.07114
-
DS-ViT: Dual-Stream Vision Transformer for Cross-Task Distillation in Alzheimer's Early Diagnosis 11 Sep 2024 · 0 repositories · arXiv:2409.07584
-
Enhancing CTC-Based Visual Speech Recognition 11 Sep 2024 · 0 repositories · arXiv:2409.07210
-
Privacy-Preserving Federated Learning with Consistency via Knowledge Distillation Using Conditional Generator 11 Sep 2024 · 0 repositories · arXiv:2409.06955
-
Applied Federated Model Personalisation in the Industrial Domain: A Comparative Study 10 Sep 2024 · 0 repositories · arXiv:2409.06904
-
EasyST: A Simple Framework for Spatio-Temporal Prediction 10 Sep 2024 · 1 repository · arXiv:2409.06748
-
How Redundant Is the Transformer Stack in Speech Representation Models? 10 Sep 2024 · 0 repositories · arXiv:2409.16302
-
Knowledge Distillation via Query Selection for Detection Transformer 10 Sep 2024 · 0 repositories · arXiv:2409.06443
-
Complex Emotion Recognition System using basic emotions via Facial Expression, EEG, and ECG Signals: a review 9 Sep 2024 · 0 repositories · arXiv:2409.07493
-
FedBrain-Distill: Communication-Efficient Federated Brain Tumor Classification Using Ensemble Knowledge Distillation on Non-IID Data 9 Sep 2024 · 1 repository · arXiv:2409.05359
-
Joint Input and Output Coordination for Class-Incremental Learning 9 Sep 2024 · 0 repositories · arXiv:2409.05620
-
LEROjD: Lidar Extended Radar-Only Object Detection 9 Sep 2024 · 1 repository · arXiv:2409.05564
-
SCARF: Scalable Continual Learning Framework for Memory-efficient Multiple Neural Radiance Fields 6 Sep 2024 · 0 repositories · arXiv:2409.04482
-
DKDM: Data-Free Knowledge Distillation for Diffusion Models with Any Architecture 5 Sep 2024 · 1 repository · arXiv:2409.03550
-
Collaborative Learning for Enhanced Unsupervised Domain Adaptation 4 Sep 2024 · 0 repositories · arXiv:2409.02699
-
Efficient Image Compression Using Advanced State Space Models 4 Sep 2024 · 0 repositories · arXiv:2409.02743
-
Low-Resolution Object Recognition with Cross-Resolution Relational Contrastive Distillation 4 Sep 2024 · 0 repositories · arXiv:2409.02555
-
Non-target Divergence Hypothesis: Toward Understanding Domain Gaps in Cross-Modal Knowledge Distillation 4 Sep 2024 · 0 repositories · arXiv:2409.02438
-
Sorbet: A Neuromorphic Hardware-Compatible Transformer-Based Spiking Language Model 4 Sep 2024 · 0 repositories · arXiv:2409.15298Syntology 4 ran (of which 3 constructed an object rather than computing a result; 4 with no instrument failure: 1 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 4 harvested samples) · 4 pointer-only (licence)
-
Adaptive Explicit Knowledge Transfer for Knowledge Distillation 3 Sep 2024 · 0 repositories · arXiv:2409.01679
-
Efficient Point Cloud Classification via Offline Distillation Framework and Negative-Weight Self-Distillation Technique 3 Sep 2024 · 0 repositories · arXiv:2409.02020
-
Improving Apple Object Detection with Occlusion-Enhanced Distillation 3 Sep 2024 · 0 repositories · arXiv:2409.01573
-
Low-Resolution Face Recognition via Adaptable Instance-Relation Distillation 3 Sep 2024 · 0 repositories · arXiv:2409.02049
-
How Knowledge Distillation Mitigates the Synthetic Gap in Fair Face Recognition 30 Aug 2024 · 1 repository · arXiv:2408.17399
-
MedDet: Generative Adversarial Distillation for Efficient Cervical Disc Herniation Detection 30 Aug 2024 · 1 repository · arXiv:2409.00204
-
VLM-KD: Knowledge Distillation from VLM for Long-Tail Visual Recognition 29 Aug 2024 · 0 repositories · arXiv:2408.16930
-
ModalityMirror: Improving Audio Classification in Modality Heterogeneity Federated Learning with Multimodal Distillation 28 Aug 2024 · 0 repositories · arXiv:2408.15803
-
Let Video Teaches You More: Video-to-Image Knowledge Distillation using DEtection TRansformer for Medical Video Lesion Detection 26 Aug 2024 · 0 repositories · arXiv:2408.14051
-
TSAK: Two-Stage Semantic-Aware Knowledge Distillation for Efficient Wearable Modality and Model Optimization in Manufacturing Lines 26 Aug 2024 · 0 repositories · arXiv:2408.14146
-
Bring the Power of Diffusion Model to Defect Detection 25 Aug 2024 · 0 repositories · arXiv:2408.13845
-
Aligning (Medical) LLMs for (Counterfactual) Fairness 22 Aug 2024 · 1 repository · arXiv:2408.12055
-
Interactive DualChecker for Mitigating Hallucinations in Distilling Large Language Models 22 Aug 2024 · 0 repositories · arXiv:2408.12326
-
Rebalancing Multi-Label Class-Incremental Learning 22 Aug 2024 · 0 repositories · arXiv:2408.12161
-
Vision-Based Detection of Uncooperative Targets and Components on Small Satellites 22 Aug 2024 · 0 repositories · arXiv:2408.12084
-
Domain-invariant Progressive Knowledge Distillation for UAV-based Object Detection 21 Aug 2024 · 0 repositories · arXiv:2408.11407
-
LAKD-Activation Mapping Distillation Based on Local Learning 21 Aug 2024 · 0 repositories · arXiv:2408.11478
-
SAM-COD: SAM-guided Unified Framework for Weakly-Supervised Camouflaged Object Detection 20 Aug 2024 · 0 repositories · arXiv:2408.10760
-
CLIP-CID: Efficient CLIP Distillation via Cluster-Instance Discrimination 18 Aug 2024 · 0 repositories · arXiv:2408.09441
-
MedMAP: Promoting Incomplete Multi-modal Brain Tumor Segmentation with Alignment 18 Aug 2024 · 0 repositories · arXiv:2408.09465
-
OVOSE: Open-Vocabulary Semantic Segmentation in Event-Based Cameras 18 Aug 2024 · 1 repository · arXiv:2408.09424
-
V2X-VLM: End-to-End V2X Cooperative Autonomous Driving Through Large Vision-Language Models 17 Aug 2024 · 0 repositories · arXiv:2408.09251
-
MIDAS: Multi-level Intent, Domain, And Slot Knowledge Distillation for Multi-turn NLU 15 Aug 2024 · 1 repository · arXiv:2408.08144
-
FedQUIT: On-Device Federated Unlearning via a Quasi-Competent Virtual Teacher 14 Aug 2024 · 0 repositories · arXiv:2408.07587
-
Knowledge Distillation with Refined Logits 14 Aug 2024 · 1 repository · arXiv:2408.07703
-
Towards Real-time Video Compressive Sensing on Mobile Devices 14 Aug 2024 · 1 repository · arXiv:2408.07530
-
Using Advanced LLMs to Enhance Smaller LLMs: An Interpretable Knowledge Distillation Approach 13 Aug 2024 · 0 repositories · arXiv:2408.07238
-
Optimizing Vision Transformers with Data-Free Knowledge Transfer 12 Aug 2024 · 0 repositories · arXiv:2408.05952
-
Low-Dimensional Federated Knowledge Graph Embedding via Knowledge Distillation 11 Aug 2024 · 0 repositories · arXiv:2408.05748
-
ComKD-CLIP: Comprehensive Knowledge Distillation for Contrastive Language-Image Pre-traning Model 8 Aug 2024 · 0 repositories · arXiv:2408.04145
-
LaDiMo: Layer-wise Distillation Inspired MoEfier 8 Aug 2024 · 0 repositories · arXiv:2408.04278
-
Real-time Event Recognition of Long-distance Distributed Vibration Sensing with Knowledge Distillation and Hardware Acceleration 7 Aug 2024 · 1 repository · arXiv:2408.03647
-
VizECGNet: Visual ECG Image Network for Cardiovascular Diseases Classification with Multi-Modal Training and Knowledge Distillation 6 Aug 2024 · 0 repositories · arXiv:2408.02888
-
Comb, Prune, Distill: Towards Unified Pruning for Vision Model Compression 6 Aug 2024 · 1 repository · arXiv:2408.03046
-
Leveraging Entity Information for Cross-Modality Correlation Learning: The Entity-Guided Multimodal Summarization 6 Aug 2024 · 1 repository · arXiv:2408.03149
-
EEGMobile: Enhancing Speed and Accuracy in EEG-Based Gaze Prediction with Advanced Mobile Architectures 6 Aug 2024 · 1 repository · arXiv:2408.03449