Methods › General › Knowledge Distillation › Knowledge Distillation › Papers, page 4
Knowledge Distillation
Papers archive 2025-07-28
archive papers tagged: 3,071 · with a code link: 1,258 · where Syntology ran a sample: 320 (276 with a run with no instrument failure, 44 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (320 of 3,071 tagged: 276 with a run with no instrument failure, 44 where every run was a failure of Syntology's instrument)
Page 4 of 31: papers 301 to 400 of 3,071, newest first by the archive's date (ties by slug), in archive order.
Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code, as “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. It is per sample and not a correctness claim. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from.
-
A Diffusion Model and Knowledge Distillation Framework for Robust Coral Detection in Complex Underwater Environments 6 Jan 2025 · 1 repository
-
Comprehensive Pathological Image Segmentation via Teacher Aggregation for Tumor Microenvironment Analysis 6 Jan 2025 · 0 repositories · arXiv:2501.02909
-
Knowledge Distillation with Adapted Weight 6 Jan 2025 · 0 repositories · arXiv:2501.02705
-
LightGNN: Simple Graph Neural Network for Recommendation 6 Jan 2025 · 1 repository · arXiv:2501.03228
-
Strategic Fusion Optimizes Transformer Compression 5 Jan 2025 · 0 repositories · arXiv:2501.03273
-
Distillation-Enhanced Physical Adversarial Attacks 4 Jan 2025 · 0 repositories · arXiv:2501.02232
-
V2X-DGPE: Addressing Domain Gaps and Pose Errors for Robust Collaborative 3D Object Detection 4 Jan 2025 · 1 repository · arXiv:2501.02363
-
MoVE-KD: Knowledge Distillation for VLMs with Mixture of Visual Encoders 3 Jan 2025 · 0 repositories · arXiv:2501.01709Syntology 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples)
-
ADU: Adaptive Detection of Unknown Categories in Black-Box Domain Adaptation 1 Jan 2025 · 0 repositories
-
Align-KD: Distilling Cross-Modal Alignment Knowledge for Mobile Vision-Language Large Model Enhancement 1 Jan 2025 · 1 repository
-
AVQACL: A Novel Benchmark for Audio-Visual Question Answering Continual Learning 1 Jan 2025 · 1 repository
-
BiM-VFI: Bidirectional Motion Field-Guided Frame Interpolation for Video with Non-uniform Motions 1 Jan 2025 · 0 repositories
-
Closest Neighbors are Harmful for Lightweight Masked Auto-encoders 1 Jan 2025 · 1 repository
-
CoMBO: Conflict Mitigation via Branched Optimization for Class Incremental Segmentation 1 Jan 2025 · 0 repositories
-
Distilling Monocular Foundation Model for Fine-grained Depth Completion 1 Jan 2025 · 0 repositories
-
Distilling Spatially-Heterogeneous Distortion Perception for Blind Image Quality Assessment 1 Jan 2025 · 0 repositories
-
Simplification Is All You Need against Out-of-Distribution Overconfidence 1 Jan 2025 · 0 repositories
-
Targeted Forgetting of Image Subgroups in CLIP Models 1 Jan 2025 · 0 repositories
-
VL2Lite: Task-Specific Knowledge Distillation from Large Vision-Language Models to Lightweight Networks 1 Jan 2025 · 0 repositories
-
Pan-infection Foundation Framework Enables Multiple Pathogen Prediction 31 Dec 2024 · 0 repositories · arXiv:2501.01462
-
ECG-guided individual identification via PPG 30 Dec 2024 · 0 repositories · arXiv:2501.01983
-
Improving Acoustic Scene Classification in Low-Resource Conditions 30 Dec 2024 · 0 repositories · arXiv:2412.20722
-
Temporal reasoning for timeline summarisation in social media 30 Dec 2024 · 0 repositories · arXiv:2501.00152
-
Injecting Explainability and Lightweight Design into Weakly Supervised Video Anomaly Detection Systems 28 Dec 2024 · 0 repositories · arXiv:2412.20201
-
Invariant debiasing learning for recommendation via biased imputation 28 Dec 2024 · 1 repository · arXiv:2412.20036
-
Learning an Adaptive and View-Invariant Vision Transformer for Real-Time UAV Tracking 28 Dec 2024 · 1 repository · arXiv:2412.20002
-
Asymmetrical Reciprocity-based Federated Learning for Resolving Disparities in Medical Diagnosis 27 Dec 2024 · 1 repository · arXiv:2412.19654
-
Feature Alignment-Based Knowledge Distillation for Efficient Compression of Large Language Models 27 Dec 2024 · 0 repositories · arXiv:2412.19449
-
SpectralKD: A Unified Framework for Interpreting and Distilling Vision Transformers via Spectral Analysis 26 Dec 2024 · 1 repository · arXiv:2412.19055
-
HTR-JAND: Handwritten Text Recognition with Joint Attention Network and Knowledge Distillation 24 Dec 2024 · 0 repositories · arXiv:2412.18524
-
Better Knowledge Enhancement for Privacy-Preserving Cross-Project Defect Prediction 23 Dec 2024 · 0 repositories · arXiv:2412.17317
-
Exploiting Label Skewness for Spiking Neural Networks in Federated Learning 23 Dec 2024 · 0 repositories · arXiv:2412.17305
-
CBNN: 3-Party Secure Framework for Customized Binary Neural Networks Inference 21 Dec 2024 · 0 repositories · arXiv:2412.16449
-
STKDRec: Spatial-Temporal Knowledge Distillation for Takeaway Recommendation 21 Dec 2024 · 1 repository · arXiv:2412.16502
-
A New Method to Capturing Compositional Knowledge in Linguistic Space 20 Dec 2024 · 0 repositories · arXiv:2412.15632
-
LiRCDepth: Lightweight Radar-Camera Depth Estimation via Knowledge Distillation and Uncertainty Guidance 20 Dec 2024 · 1 repository · arXiv:2412.16380
-
Efficient Fine-Tuning and Concept Suppression for Pruned Diffusion Models 19 Dec 2024 · 1 repository · arXiv:2412.15341
-
SCKD: Semi-Supervised Cross-Modality Knowledge Distillation for 4D Radar Object Detection 19 Dec 2024 · 0 repositories · arXiv:2412.14571
-
Uncertainty-Guided Cross Attention Ensemble Mean Teacher for Semi-supervised Medical Image Segmentation 19 Dec 2024 · 0 repositories · arXiv:2412.15380
-
Enhancing Knowledge Distillation for LLMs with Response-Priming Prompting 18 Dec 2024 · 1 repository · arXiv:2412.17846
-
Hybrid Data-Free Knowledge Distillation 18 Dec 2024 · 1 repository · arXiv:2412.13525
-
Learnable Prompting SAM-induced Knowledge Distillation for Semi-supervised Medical Image Segmentation 18 Dec 2024 · 1 repository · arXiv:2412.13742
-
Scaling of Search and Learning: A Roadmap to Reproduce o1 from Reinforcement Learning Perspective 18 Dec 2024 · 1 repository · arXiv:2412.14135
-
Efficient Speech Command Recognition Leveraging Spiking Neural Network and Curriculum Learning-based Knowledge Distillation 17 Dec 2024 · 0 repositories · arXiv:2412.12858
-
Entire-Space Variational Information Exploitation for Post-Click Conversion Rate Prediction 17 Dec 2024 · 0 repositories · arXiv:2502.15687
-
In-Context Learning Distillation for Efficient Few-Shot Fine-Tuning 17 Dec 2024 · 0 repositories · arXiv:2412.13243
-
Modality-Inconsistent Continual Learning of Multimodal Large Language Models 17 Dec 2024 · 0 repositories · arXiv:2412.13050
-
PromptDet: A Lightweight 3D Object Detection Framework with LiDAR Prompts 17 Dec 2024 · 0 repositories · arXiv:2412.12460
-
Split Knowledge Distillation for Large Models in IoT: Architecture, Challenges, and Solutions 17 Dec 2024 · 0 repositories · arXiv:2501.17164
-
BiM-VFI: directional Motion Field-Guided Frame Interpolation for Video with Non-uniform Motions 16 Dec 2024 · 1 repository · arXiv:2412.11365
-
Neural Collapse Inspired Knowledge Distillation 16 Dec 2024 · 0 repositories · arXiv:2412.11788
-
Relation-Guided Adversarial Learning for Data-free Knowledge Transfer 16 Dec 2024 · 1 repository · arXiv:2412.11380
-
Active Large Language Model-based Knowledge Distillation for Session-based Recommendation 15 Dec 2024 · 0 repositories · arXiv:2502.15685
-
Knowledge Migration Framework for Smart Contract Vulnerability Detection 15 Dec 2024 · 0 repositories · arXiv:2412.11175
-
Leveraging Large Language Models for Active Merchant Non-player Characters 15 Dec 2024 · 1 repository · arXiv:2412.11189Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 3 harvested samples) · 3 pointer-only (licence)
-
On Distilling the Displacement Knowledge for Few-Shot Class-Incremental Learning 15 Dec 2024 · 0 repositories · arXiv:2412.11017
-
Redefining Normal: A Novel Object-Level Approach for Multi-Object Novelty Detection 15 Dec 2024 · 1 repository · arXiv:2412.11148
-
LLM Distillation for Efficient Few-Shot Multiple Choice Question Answering 13 Dec 2024 · 0 repositories · arXiv:2412.09807
-
DASK: Distribution Rehearsing via Adaptive Style Kernel Learning for Exemplar-Free Lifelong Person Re-Identification 12 Dec 2024 · 1 repository · arXiv:2412.09224Syntology official: harvested, nothing ran · 0 ran · 3 unverified (of 3 harvested samples) · 3 pointer-only (licence)
-
Dynamic Contrastive Knowledge Distillation for Efficient Image Restoration 12 Dec 2024 · 1 repository · arXiv:2412.08939
-
SnapGen: Taming High-Resolution Text-to-Image Models for Mobile Devices with Efficient Architectures and Training 12 Dec 2024 · 0 repositories · arXiv:2412.09619
-
DAKD: Data Augmentation and Knowledge Distillation using Diffusion Models for SAR Oil Spill Segmentation 11 Dec 2024 · 0 repositories · arXiv:2412.08116
-
Efficient Gravitational Wave Parameter Estimation via Knowledge Distillation: A ResNet1D-IAF Approach 11 Dec 2024 · 0 repositories · arXiv:2412.08672
-
Wasserstein Distance Rivals Kullback-Leibler Divergence for Knowledge Distillation 11 Dec 2024 · 1 repository · arXiv:2412.08139Syntology 6 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 5 where Syntology's instrument failed) · 1 unverified (of 7 harvested samples) · 7 pointer-only (licence)
-
TT-MPD: Test Time Model Pruning and Distillation 10 Dec 2024 · 0 repositories · arXiv:2412.07114
-
U-Know-DiffPAN: An Uncertainty-aware Knowledge Distillation Diffusion Framework with Details Enhancement for PAN-Sharpening 9 Dec 2024 · 0 repositories · arXiv:2412.06243
-
Domain-Specific Translation with Open-Source Large Language Models: Resource-Oriented Analysis 8 Dec 2024 · 0 repositories · arXiv:2412.05862
-
Neighborhood Commonality-aware Evolution Network for Continuous Generalized Category Discovery 7 Dec 2024 · 0 repositories · arXiv:2412.05573
-
BEExformer: A Fast Inferencing Transformer Architecture via Binarization with Multiple Early Exits 6 Dec 2024 · 0 repositories · arXiv:2412.05225
-
CCS: Continuous Learning for Customized Incremental Wireless Sensing Services 6 Dec 2024 · 0 repositories · arXiv:2412.04821
-
One-shot Federated Learning via Synthetic Distiller-Distillate Communication 6 Dec 2024 · 1 repository · arXiv:2412.05186Syntology official (archive's flag): 10 ran · 10 ran (of which 0 constructed an object rather than computing a result; 9 with no instrument failure: 1 honoured, 1 violated, 7 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 11 harvested samples)
-
CLIP-PING: Boosting Lightweight Vision-Language Models with Proximus Intrinsic Neighbors Guidance 5 Dec 2024 · 0 repositories · arXiv:2412.03871
-
Expanding Deep Learning-based Sensing Systems with Multi-Source Knowledge Transfer 5 Dec 2024 · 0 repositories · arXiv:2412.04060
-
FedDW: Distilling Weights through Consistency Optimization in Heterogeneous Federated Learning 5 Dec 2024 · 1 repository · arXiv:2412.04521
-
Distillation of Diffusion Features for Semantic Correspondence 4 Dec 2024 · 0 repositories · arXiv:2412.03512
-
Enhancing CLIP Conceptual Embedding through Knowledge Distillation 4 Dec 2024 · 0 repositories · arXiv:2412.03513
-
Multi-Branch Mutual-Distillation Transformer for EEG-Based Seizure Subtype Classification 4 Dec 2024 · 0 repositories · arXiv:2412.15224
-
Align-KD: Distilling Cross-Modal Alignment Knowledge for Mobile Vision-Language Model 2 Dec 2024 · 1 repository · arXiv:2412.01282Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 4 harvested samples) · 4 pointer-only (licence)
-
Mutli-View 3D Reconstruction using Knowledge Distillation 2 Dec 2024 · 1 repository · arXiv:2412.02039
-
QABISAR: Query-Article Bipartite Interactions for Statutory Article Retrieval 1 Dec 2024 · 0 repositories · arXiv:2412.00934
-
Continuous Concepts Removal in Text-to-image Diffusion Models 30 Nov 2024 · 0 repositories · arXiv:2412.00580
-
Reverse Thinking Makes LLMs Stronger Reasoners 29 Nov 2024 · 0 repositories · arXiv:2411.19865
-
Headache to Overstock? Promoting Long-tail Items through Debiased Product Bundling 28 Nov 2024 · 0 repositories · arXiv:2411.19107
-
Pre-Training Graph Contrastive Masked Autoencoders are Strong Distillers for EEG 28 Nov 2024 · 0 repositories · arXiv:2411.19230
-
Puzzle: Distillation-Based NAS for Inference-Optimized LLMs 28 Nov 2024 · 0 repositories · arXiv:2411.19146
-
Zero-shot Slot Filling in the Age of LLMs for Dialogue Systems 28 Nov 2024 · 0 repositories · arXiv:2411.18980
-
Vision Mamba Distillation for Low-resolution Fine-grained Image Classification 27 Nov 2024 · 1 repository · arXiv:2411.17980
-
Large-Scale Data-Free Knowledge Distillation for ImageNet via Multi-Resolution Data Generation 26 Nov 2024 · 0 repositories · arXiv:2411.17046
-
Words Matter: Leveraging Individual Text Embeddings for Code Generation in CLIP Test-Time Adaptation 26 Nov 2024 · 1 repository · arXiv:2411.17002
-
Beyond Task Vectors: Selective Task Arithmetic Based on Importance Metrics 25 Nov 2024 · 0 repositories · arXiv:2411.16139
-
Ensemble Learning via Knowledge Transfer for CTR Prediction 25 Nov 2024 · 1 repository · arXiv:2411.16122
-
Learn from Foundation Model: Fruit Detection Model without Manual Annotation 25 Nov 2024 · 1 repository · arXiv:2411.16196
-
Leveraging Foundation Models To learn the shape of semi-fluid deformable objects 25 Nov 2024 · 0 repositories · arXiv:2411.16802
-
O1 Replication Journey -- Part 2: Surpassing O1-preview through Simple Distillation, Big Progress or Bitter Lesson? 25 Nov 2024 · 1 repository · arXiv:2411.16489
-
When Babies Teach Babies: Can student knowledge sharing outperform Teacher-Guided Distillation on small datasets? 25 Nov 2024 · 1 repository · arXiv:2411.16487
-
Efficient Ternary Weight Embedding Model: Bridging Scalability and Performance 23 Nov 2024 · 1 repository · arXiv:2411.15438
-
Partial Knowledge Distillation for Alleviating the Inherent Inter-Class Discrepancy in Federated Learning 23 Nov 2024 · 0 repositories · arXiv:2411.15403
-
Adaptive Group Robust Ensemble Knowledge Distillation 22 Nov 2024 · 0 repositories · arXiv:2411.14984
-
Adversarial Prompt Distillation for Vision-Language Models 22 Nov 2024 · 0 repositories · arXiv:2411.15244
-
BanglaEmbed: Efficient Sentence Embedding Models for a Low-Resource Language Using Cross-Lingual Distillation Techniques 22 Nov 2024 · 0 repositories · arXiv:2411.15270