Methods › General › Knowledge Distillation › Knowledge Distillation › Papers, page 7
Knowledge Distillation
Papers archive 2025-07-28
archive papers tagged: 3,071 · with a code link: 1,258 · where Syntology ran a sample: 320 (276 with a run with no instrument failure, 44 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (320 of 3,071 tagged: 276 with a run with no instrument failure, 44 where every run was a failure of Syntology's instrument)
Page 7 of 31: papers 601 to 700 of 3,071, newest first by the archive's date (ties by slug), in archive order.
Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code, as “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. It is per sample and not a correctness claim. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from.
-
Unsupervised Domain Adaption Harnessing Vision-Language Pre-training 5 Aug 2024 · 1 repository · arXiv:2408.02192Syntology official (archive's flag): 6 ran · 6 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 3 where Syntology's instrument failed) · 7 unverified (of 13 harvested samples) · 5 pointer-only (licence)
-
Low-Cost Self-Ensembles Based on Multi-Branch Transformation and Grouped Convolution 5 Aug 2024 · 1 repository · arXiv:2408.02307
-
An approach to optimize inference of the DIART speaker diarization pipeline 5 Aug 2024 · 0 repositories · arXiv:2408.02341
-
Do You Remember . . . the Future? Weak-to-Strong generalization in 3D Object Detection 3 Aug 2024 · 1 repository
-
Exploiting the Semantic Knowledge of Pre-trained Text-Encoders for Continual Learning 2 Aug 2024 · 1 repository · arXiv:2408.01076Syntology official: harvested, nothing ran · 0 ran · 1 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
Sentence-wise Speech Summarization: Task, Datasets, and End-to-End Modeling with LM Knowledge Distillation 1 Aug 2024 · 0 repositories · arXiv:2408.00205
-
Clover-2: Accurate Inference for Regressive Lightweight Speculative Decoding 1 Aug 2024 · 1 repository · arXiv:2408.00264Syntology 15 ran (of which 0 constructed an object rather than computing a result; 7 with no instrument failure: 0 honoured, 0 violated, 7 with no contract checked; 8 where Syntology's instrument failed) · 2 unverified (of 17 harvested samples) · 7 pointer-only (licence)
-
VIPeR: Visual Incremental Place Recognition with Adaptive Mining and Continual Learning 31 Jul 2024 · 0 repositories · arXiv:2407.21416
-
Learning Effective Representations for Retrieval Using Self-Distillation with Adaptive Relevance Margins 31 Jul 2024 · 0 repositories · arXiv:2407.21515
-
Dynamic Object Queries for Transformer-based Incremental Object Detection 31 Jul 2024 · 0 repositories · arXiv:2407.21687
-
Gemma 2: Improving Open Language Models at a Practical Size 31 Jul 2024 · 0 repositories · arXiv:2408.00118
-
StyleRF-VolVis: Style Transfer of Neural Radiance Fields for Expressive Volume Visualization 31 Jul 2024 · 0 repositories · arXiv:2408.00150
-
Lifelong Person Search 31 Jul 2024 · 0 repositories · arXiv:2407.21252
-
Pruning Large Language Models with Semi-Structural Adaptive Sparse Training 30 Jul 2024 · 1 repository · arXiv:2407.20584Syntology official (archive's flag): 6 ran · 6 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 8 harvested samples)
-
LLAVADI: What Matters For Multimodal Large Language Models Distillation 28 Jul 2024 · 0 repositories · arXiv:2407.19409
-
Logic Distillation: Learning from Code Function by Function for Planning and Decision-making 28 Jul 2024 · 0 repositories · arXiv:2407.19405
-
Mixture of Modular Experts: Distilling Knowledge from a Multilingual Teacher into Specialized Modular Language Models 28 Jul 2024 · 1 repository · arXiv:2407.19610
-
Overcoming Uncertain Incompleteness for Robust Multimodal Sequential Diagnosis Prediction via Curriculum Data Erasing Guided Knowledge Distillation 28 Jul 2024 · 1 repository · arXiv:2407.19540
-
Sewer Image Super-Resolution with Depth Priors and Its Lightweight Network 27 Jul 2024 · 0 repositories · arXiv:2407.19271
-
Boosting Cross-Domain Point Classification via Distilling Relational Priors from 2D Transformers 26 Jul 2024 · 1 repository · arXiv:2407.18534
-
FedUD: Exploiting Unaligned Data for Cross-Platform Federated Click-Through Rate Prediction 26 Jul 2024 · 0 repositories · arXiv:2407.18472
-
Modality-Balanced Learning for Multimedia Recommendation 26 Jul 2024 · 1 repository · arXiv:2408.06360
-
Towards A Generalizable Pathology Foundation Model via Unified Knowledge Distillation 26 Jul 2024 · 1 repository · arXiv:2407.18449Syntology 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
How to Train the Teacher Model for Effective Knowledge Distillation 25 Jul 2024 · 1 repository · arXiv:2407.18041Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
Peak-Controlled Logits Poisoning Attack in Federated Distillation 25 Jul 2024 · 0 repositories · arXiv:2407.18039
-
Self-Training with Direct Preference Optimization Improves Chain-of-Thought Reasoning 25 Jul 2024 · 1 repository · arXiv:2407.18248Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples)
-
Separating Novel Features for Logical Anomaly Detection: A Straightforward yet Effective Approach 25 Jul 2024 · 0 repositories · arXiv:2407.17909
-
CoMoTo: Unpaired Cross-Modal Lesion Distillation Improves Breast Lesion Detection in Tomosynthesis 24 Jul 2024 · 1 repository · arXiv:2407.17620
-
DDK: Distilling Domain Knowledge for Efficient Large Language Models 23 Jul 2024 · 0 repositories · arXiv:2407.16154
-
OriGen:Enhancing RTL Code Generation with Code-to-Code Augmentation and Self-Reflection 23 Jul 2024 · 1 repository · arXiv:2407.16237Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 3 harvested samples) · 3 pointer-only (licence)
-
Strike a Balance in Continual Panoptic Segmentation 23 Jul 2024 · 1 repository · arXiv:2407.16354
-
Comprehensive Study on Performance Evaluation and Optimization of Model Compression: Bridging Traditional Deep Learning and Large Language Models 22 Jul 2024 · 0 repositories · arXiv:2407.15904
-
Disentangling spatio-temporal knowledge for weakly supervised object detection and segmentation in surgical video 22 Jul 2024 · 1 repository · arXiv:2407.15794
-
Synthetic Image Learning: Preserving Performance and Preventing Membership Inference Attacks 22 Jul 2024 · 0 repositories · arXiv:2407.15526
-
Distilling Vision-Language Foundation Models: A Data-Free Approach via Prompt Diversification 21 Jul 2024 · 0 repositories · arXiv:2407.15155
-
SeqMIA: Sequential-Metric Based Membership Inference Attack 21 Jul 2024 · 1 repository · arXiv:2407.15098Syntology official (archive's flag): 9 ran · 9 ran (of which 0 constructed an object rather than computing a result; 9 with no instrument failure: 0 honoured, 0 violated, 9 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 10 harvested samples) · 10 pointer-only (licence)
-
Teach Harder, Learn Poorer: Rethinking Hard Sample Distillation for GNN-to-MLP Knowledge Distillation 20 Jul 2024 · 1 repository · arXiv:2407.14768
-
Continual Panoptic Perception: Towards Multi-modal Incremental Interpretation of Remote Sensing Images 19 Jul 2024 · 1 repository · arXiv:2407.14242
-
ESP-MedSAM: Efficient Self-Prompting SAM for Universal Domain-Generalized Medical Image Segmentation 19 Jul 2024 · 1 repository · arXiv:2407.14153
-
Knowledge Distillation Approaches for Accurate and Efficient Recommender System 19 Jul 2024 · 1 repository · arXiv:2407.13952
-
Continual Distillation Learning: Knowledge Distillation in Prompt-based Continual Learning 18 Jul 2024 · 0 repositories · arXiv:2407.13911
-
DFMSD: Dual Feature Masking Stage-wise Knowledge Distillation for Object Detection 18 Jul 2024 · 0 repositories · arXiv:2407.13147
-
Make a Strong Teacher with Label Assistance: A Novel Knowledge Distillation Approach for Semantic Segmentation 18 Jul 2024 · 1 repository · arXiv:2407.13254
-
QuIIL at T3 challenge: Towards Automation in Life-Saving Intervention Procedures from First-Person View 18 Jul 2024 · 1 repository · arXiv:2407.13216
-
Exploring Deeper! Segment Anything Model with Depth Perception for Camouflaged Object Detection 17 Jul 2024 · 1 repository · arXiv:2407.12339
-
Bridge Past and Future: Overcoming Information Asymmetry in Incremental Object Detection 16 Jul 2024 · 1 repository · arXiv:2407.11499Syntology official (archive's flag): 6 ran · 6 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified (of 9 harvested samples) · 3 pointer-only (licence)
-
Discriminative and Consistent Representation Distillation 16 Jul 2024 · 1 repository · arXiv:2407.11802
-
Learning Modality-agnostic Representation for Semantic Segmentation from Any Modalities 16 Jul 2024 · 0 repositories · arXiv:2407.11351
-
MapDistill: Boosting Efficient Camera-based HD Map Construction via Camera-LiDAR Fusion Model Distillation 16 Jul 2024 · 0 repositories · arXiv:2407.11682
-
Mitigating Background Shift in Class-Incremental Semantic Segmentation 16 Jul 2024 · 1 repository · arXiv:2407.11859
-
Relational Representation Distillation 16 Jul 2024 · 1 repository · arXiv:2407.12073
-
Accessing Vision Foundation Models at ImageNet-level Costs 15 Jul 2024 · 1 repository · arXiv:2407.10366Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 1 honoured, 0 violated, 2 with no contract checked; 1 where Syntology's instrument failed) · 6 unverified (of 10 harvested samples)
-
Don't Throw Away Data: Better Sequence Knowledge Distillation 15 Jul 2024 · 0 repositories · arXiv:2407.10456
-
Leave No Knowledge Behind During Knowledge Distillation: Towards Practical and Effective Knowledge Distillation for Code-Switching ASR Using Realistic Data 15 Jul 2024 · 0 repositories · arXiv:2407.10603
-
LabelDistill: Label-guided Cross-modal Knowledge Distillation for Camera-based 3D Object Detection 14 Jul 2024 · 1 repository · arXiv:2407.10164
-
Background Adaptation with Residual Modeling for Exemplar-Free Class-Incremental Semantic Segmentation 13 Jul 2024 · 0 repositories · arXiv:2407.09838
-
3M-Health: Multimodal Multi-Teacher Knowledge Distillation for Mental Health Detection 12 Jul 2024 · 1 repository · arXiv:2407.09020
-
A Survey on Symbolic Knowledge Distillation of Large Language Models 12 Jul 2024 · 0 repositories · arXiv:2408.10210
-
BKDSNN: Enhancing the Performance of Learning-based Spiking Neural Networks Training with Blurred Knowledge Distillation 12 Jul 2024 · 1 repository · arXiv:2407.09083Syntology official: harvested, nothing ran · 0 ran · 1 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
From Easy to Hard: Learning Curricular Shape-aware Features for Robust Panoptic Scene Graph Generation 12 Jul 2024 · 0 repositories · arXiv:2407.09191
-
SlideGCD: Slide-based Graph Collaborative Training with Knowledge Distillation for Whole Slide Image Classification 12 Jul 2024 · 1 repository · arXiv:2407.08968
-
Uplifting Range-View-based 3D Semantic Segmentation in Real-Time with Multi-Sensor Fusion 12 Jul 2024 · 0 repositories · arXiv:2407.09697
-
Knowledge distillation to effectively attain both region-of-interest and global semantics from an image where multiple objects appear 11 Jul 2024 · 1 repository · arXiv:2407.08257
-
HDKD: Hybrid Data-Efficient Knowledge Distillation Network for Medical Image Classification 10 Jul 2024 · 1 repository · arXiv:2407.07516
-
LokiLM: Technical Report 10 Jul 2024 · 0 repositories · arXiv:2407.07370
-
A Guide To Effectively Leveraging LLMs for Low-Resource Text Summarization: Data Augmentation and Semi-supervised Approaches 10 Jul 2024 · 0 repositories · arXiv:2407.07341
-
Enhancing Low-Resource NMT with a Multilingual Encoder and Knowledge Distillation: A Case Study 9 Jul 2024 · 0 repositories · arXiv:2407.06538
-
Less is More: Efficient Brain-Inspired Learning for Autonomous Driving Trajectory Prediction 9 Jul 2024 · 0 repositories · arXiv:2407.07020
-
Reprogramming Distillation for Medical Foundation Models 9 Jul 2024 · 1 repository · arXiv:2407.06504Syntology official (archive's flag): 6 ran · 6 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 4 where Syntology's instrument failed) · 2 unverified (of 8 harvested samples) · 8 pointer-only (licence)
-
DεpS: Delayed ε-Shrinking for Faster Once-For-All Training 8 Jul 2024 · 0 repositories · arXiv:2407.06167
-
Federated Knowledge Transfer Fine-tuning Large Server Model with Resource-Constrained IoT Clients 7 Jul 2024 · 0 repositories · arXiv:2407.05268
-
Leveraging Topological Guidance for Improved Knowledge Distillation 7 Jul 2024 · 1 repository · arXiv:2407.05316Syntology official (archive's flag): 14 ran · 14 ran (of which 0 constructed an object rather than computing a result; 11 with no instrument failure: 2 honoured, 2 violated, 7 with no contract checked; 3 where Syntology's instrument failed) · 2 unverified (of 16 harvested samples) · 16 pointer-only (licence)
-
Mind the Interference: Retaining Pre-trained Knowledge in Parameter Efficient Continual Learning of Vision-Language Models 7 Jul 2024 · 1 repository · arXiv:2407.05342Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 5 harvested samples) · 5 pointer-only (licence)
-
AMD: Automatic Multi-step Distillation of Large-scale Vision Models 5 Jul 2024 · 0 repositories · arXiv:2407.04208
-
Understanding the Gains from Repeated Self-Distillation 5 Jul 2024 · 0 repositories · arXiv:2407.04600
-
DASS: Distilled Audio State Space Models Are Stronger and More Duration-Scalable Learners 4 Jul 2024 · 1 repository · arXiv:2407.04082Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
DSMix: Distortion-Induced Sensitivity Map Based Pre-training for No-Reference Image Quality Assessment 4 Jul 2024 · 1 repository · arXiv:2407.03886
-
Fully Fine-tuned CLIP Models are Efficient Few-Shot Learners 4 Jul 2024 · 0 repositories · arXiv:2407.04003
-
Relative Difficulty Distillation for Semantic Segmentation 4 Jul 2024 · 1 repository · arXiv:2407.03719
-
A Unified Framework for 3D Scene Understanding 3 Jul 2024 · 1 repository · arXiv:2407.03263Syntology official (archive's flag): 7 ran · 7 ran (of which 0 constructed an object rather than computing a result; 7 with no instrument failure: 0 honoured, 0 violated, 7 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 7 harvested samples)
-
Edge AI-Enabled Chicken Health Detection Based on Enhanced FCOS-Lite and Knowledge Distillation 3 Jul 2024 · 0 repositories · arXiv:2407.09562
-
Improving Zero-shot Generalization of Learned Prompts via Unsupervised Knowledge Distillation 3 Jul 2024 · 1 repository · arXiv:2407.03056Syntology official (archive's flag): 6 ran · 6 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 3 where Syntology's instrument failed) · 2 unverified (of 8 harvested samples) · 8 pointer-only (licence)
-
MLKD-BERT: Multi-level Knowledge Distillation for Pre-trained Language Models 3 Jul 2024 · 0 repositories · arXiv:2407.02775
-
Supporting Cross-language Cross-project Bug Localization Using Pre-trained Language Models 3 Jul 2024 · 0 repositories · arXiv:2407.02732
-
Adaptive Modality Balanced Online Knowledge Distillation for Brain-Eye-Computer based Dim Object Detection 2 Jul 2024 · 1 repository · arXiv:2407.01894
-
Advancing Compressed Video Action Recognition through Progressive Knowledge Distillation 2 Jul 2024 · 1 repository · arXiv:2407.02713
-
ECAT: A Entire space Continual and Adaptive Transfer Learning Framework for Cross-Domain Recommendation 2 Jul 2024 · 0 repositories · arXiv:2407.02542
-
Self-Cooperation Knowledge Distillation for Novel Class Discovery 2 Jul 2024 · 0 repositories · arXiv:2407.01930
-
Survey on Knowledge Distillation for Large Language Models: Methods, Evaluation, and Application 2 Jul 2024 · 0 repositories · arXiv:2407.01885
-
Enhancing Accuracy and Parameter-Efficiency of Neural Representations for Network Parameterization 29 Jun 2024 · 0 repositories · arXiv:2407.00356
-
FANFOLD: Graph Normalizing Flows-driven Asymmetric Network for Unsupervised Graph-Level Anomaly Detection 29 Jun 2024 · 1 repository · arXiv:2407.00383
-
CSAKD: Knowledge Distillation with Cross Self-Attention for Hyperspectral and Multispectral Image Fusion 28 Jun 2024 · 1 repository · arXiv:2406.19666
-
Direct Preference Knowledge Distillation for Large Language Models 28 Jun 2024 · 0 repositories · arXiv:2406.19774
-
MuGSI: Distilling GNNs with Multi-Granularity Structural Information for Graph Classification 28 Jun 2024 · 1 repository · arXiv:2406.19832
-
Aligning Teacher with Student Preferences for Tailored Training Data Generation 27 Jun 2024 · 0 repositories · arXiv:2406.19227
-
On Reducing Activity with Distillation and Regularization for Energy Efficient Spiking Neural Networks 26 Jun 2024 · 0 repositories · arXiv:2406.18350
-
Dual-Space Knowledge Distillation for Large Language Models 25 Jun 2024 · 1 repository · arXiv:2406.17328Syntology official (archive's flag): 2 ran · 2 ran (of which 2 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified; every one of the 2 samples that ran constructed an object rather than computing a result (of 3 harvested samples) · 3 pointer-only (licence)
-
Highly Constrained Coded Aperture Imaging Systems Design Via a Knowledge Distillation Approach 25 Jun 2024 · 0 repositories · arXiv:2406.17970
-
InFiConD: Interactive No-code Fine-tuning with Concept-based Knowledge Distillation 25 Jun 2024 · 0 repositories · arXiv:2406.17838
-
MAGIC: Meta-Ability Guided Interactive Chain-of-Distillation for Effective-and-Efficient Vision-and-Language Navigation 25 Jun 2024 · 1 repository · arXiv:2406.17960