Browse State-of-the-Art › Knowledge Distillation › Papers, page 24
Knowledge Distillation
Papers archive 2025-07-28
archive papers tagged: 4,240 · with a code link: 1,740 · where Syntology ran a sample: 451 (380 with a run with no instrument failure, 71 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (451 of 4,240 tagged: 380 with a run with no instrument failure, 71 where every run was a failure of Syntology's instrument)
Page 24 of 43: papers 2,301 to 2,400 of 4,240, in archive order: by repositories listed in the archive (most first), then newest first, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers that list no repository come after every paper that lists one.
Papers without a page here are shown as plain text. A Syntology line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the figure “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code); hover it for the repositories the samples that ran came from. Abstracts are on each paper's page.
-
LAKD-Activation Mapping Distillation Based on Local Learning21 Aug 2024 0 repositories listed
-
Adaptive Knowledge Distillation for Classification of Hand Images using Explainable Vision Transformers20 Aug 2024 0 repositories listed
-
Generating Synthetic Fair Syntax-agnostic Data by Learning and Distilling Fair Representation20 Aug 2024 0 repositories listed
-
SAM-COD: SAM-guided Unified Framework for Weakly-Supervised Camouflaged Object Detection20 Aug 2024 0 repositories listed
-
CLIP-CID: Efficient CLIP Distillation via Cluster-Instance Discrimination18 Aug 2024 0 repositories listed
-
MedMAP: Promoting Incomplete Multi-modal Brain Tumor Segmentation with Alignment18 Aug 2024 0 repositories listed
-
V2X-VLM: End-to-End V2X Cooperative Autonomous Driving Through Large Vision-Language Models17 Aug 2024 0 repositories listed
-
FedQUIT: On-Device Federated Unlearning via a Quasi-Competent Virtual Teacher14 Aug 2024 0 repositories listed
-
Using Advanced LLMs to Enhance Smaller LLMs: An Interpretable Knowledge Distillation Approach13 Aug 2024 0 repositories listed
-
Optimizing Vision Transformers with Data-Free Knowledge Transfer12 Aug 2024 0 repositories listed
-
Low-Dimensional Federated Knowledge Graph Embedding via Knowledge Distillation11 Aug 2024 0 repositories listed
-
ComKD-CLIP: Comprehensive Knowledge Distillation for Contrastive Language-Image Pre-traning Model8 Aug 2024 0 repositories listed
-
LaDiMo: Layer-wise Distillation Inspired MoEfier8 Aug 2024 0 repositories listed
-
7 Aug 2024 0 repositories listed
-
VizECGNet: Visual ECG Image Network for Cardiovascular Diseases Classification with Multi-Modal Training and Knowledge Distillation6 Aug 2024 0 repositories listed
-
Inference Optimizations for Large Language Models: Effects, Challenges, and Practical Considerations6 Aug 2024 0 repositories listed
-
An approach to optimize inference of the DIART speaker diarization pipeline5 Aug 2024 0 repositories listed
-
Sentence-wise Speech Summarization: Task, Datasets, and End-to-End Modeling with LM Knowledge Distillation1 Aug 2024 0 repositories listed
-
DistillGrasp: Integrating Features Correlation with Knowledge Distillation for Depth Completion of Transparent Objects1 Aug 2024 0 repositories listed
-
VIPeR: Visual Incremental Place Recognition with Adaptive Mining and Continual Learning31 Jul 2024 0 repositories listed
-
Learning Effective Representations for Retrieval Using Self-Distillation with Adaptive Relevance Margins31 Jul 2024 0 repositories listed
-
Dynamic Object Queries for Transformer-based Incremental Object Detection31 Jul 2024 0 repositories listed
-
Gemma 2: Improving Open Language Models at a Practical Size31 Jul 2024 0 repositories listed
-
StyleRF-VolVis: Style Transfer of Neural Radiance Fields for Expressive Volume Visualization31 Jul 2024 0 repositories listed
-
Lifelong Person Search31 Jul 2024 0 repositories listed
-
ActivityCLIP: Enhancing Group Activity Recognition by Mining Complementary Information from Text to Supplement Image Modality29 Jul 2024 0 repositories listed
-
LLAVADI: What Matters For Multimodal Large Language Models Distillation28 Jul 2024 0 repositories listed
-
Logic Distillation: Learning from Code Function by Function for Planning and Decision-making28 Jul 2024 0 repositories listed
-
Sewer Image Super-Resolution with Depth Priors and Its Lightweight Network27 Jul 2024 0 repositories listed
-
FedUD: Exploiting Unaligned Data for Cross-Platform Federated Click-Through Rate Prediction26 Jul 2024 0 repositories listed
-
Peak-Controlled Logits Poisoning Attack in Federated Distillation25 Jul 2024 0 repositories listed
-
Separating Novel Features for Logical Anomaly Detection: A Straightforward yet Effective Approach25 Jul 2024 0 repositories listed
-
DDK: Distilling Domain Knowledge for Efficient Large Language Models23 Jul 2024 0 repositories listed
-
Comprehensive Study on Performance Evaluation and Optimization of Model Compression: Bridging Traditional Deep Learning and Large Language Models22 Jul 2024 0 repositories listed
-
Synthetic Image Learning: Preserving Performance and Preventing Membership Inference Attacks22 Jul 2024 0 repositories listed
-
Distilling Vision-Language Foundation Models: A Data-Free Approach via Prompt Diversification21 Jul 2024 0 repositories listed
-
Continual Distillation Learning: Knowledge Distillation in Prompt-based Continual Learning18 Jul 2024 0 repositories listed
-
DFMSD: Dual Feature Masking Stage-wise Knowledge Distillation for Object Detection18 Jul 2024 0 repositories listed
-
18 Jul 2024 0 repositories listed Syntology 7 ran (of which 0 constructed an object rather than computing a result; 7 with no instrument failure: 0 honoured, 0 violated, 7 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 9 harvested samples) · 9 pointer-only (licence)
-
Discovery of novel antimicrobial peptides with notable antibacterial potency by a LLM-based foundation model17 Jul 2024 0 repositories listed
-
Learning Modality-agnostic Representation for Semantic Segmentation from Any Modalities16 Jul 2024 0 repositories listed
-
MapDistill: Boosting Efficient Camera-based HD Map Construction via Camera-LiDAR Fusion Model Distillation16 Jul 2024 0 repositories listed
-
Don't Throw Away Data: Better Sequence Knowledge Distillation15 Jul 2024 0 repositories listed
-
Leave No Knowledge Behind During Knowledge Distillation: Towards Practical and Effective Knowledge Distillation for Code-Switching ASR Using Realistic Data15 Jul 2024 0 repositories listed
-
Multi-Granularity Semantic Revision for Large Language Model Distillation14 Jul 2024 0 repositories listed
-
Background Adaptation with Residual Modeling for Exemplar-Free Class-Incremental Semantic Segmentation13 Jul 2024 0 repositories listed
-
A Survey on Symbolic Knowledge Distillation of Large Language Models12 Jul 2024 0 repositories listed
-
From Easy to Hard: Learning Curricular Shape-aware Features for Robust Panoptic Scene Graph Generation12 Jul 2024 0 repositories listed
-
Uplifting Range-View-based 3D Semantic Segmentation in Real-Time with Multi-Sensor Fusion12 Jul 2024 0 repositories listed
-
Adaptive Deep Iris Feature Extractor at Arbitrary Resolutions11 Jul 2024 0 repositories listed
-
LokiLM: Technical Report10 Jul 2024 0 repositories listed
-
A Guide To Effectively Leveraging LLMs for Low-Resource Text Summarization: Data Augmentation and Semi-supervised Approaches10 Jul 2024 0 repositories listed
-
Enhancing Low-Resource NMT with a Multilingual Encoder and Knowledge Distillation: A Case Study9 Jul 2024 0 repositories listed
-
Less is More: Efficient Brain-Inspired Learning for Autonomous Driving Trajectory Prediction9 Jul 2024 0 repositories listed
-
DεpS: Delayed ε-Shrinking for Faster Once-For-All Training8 Jul 2024 0 repositories listed
-
Federated Knowledge Transfer Fine-tuning Large Server Model with Resource-Constrained IoT Clients7 Jul 2024 0 repositories listed
-
Topological Persistence Guided Knowledge Distillation for Wearable Sensor Data7 Jul 2024 0 repositories listed
-
AMD: Automatic Multi-step Distillation of Large-scale Vision Models5 Jul 2024 0 repositories listed
-
Improving Knowledge Distillation in Transfer Learning with Layer-wise Learning Rates5 Jul 2024 0 repositories listed
-
Understanding the Gains from Repeated Self-Distillation5 Jul 2024 0 repositories listed
-
Fully Fine-tuned CLIP Models are Efficient Few-Shot Learners4 Jul 2024 0 repositories listed
-
Edge AI-Enabled Chicken Health Detection Based on Enhanced FCOS-Lite and Knowledge Distillation3 Jul 2024 0 repositories listed
-
Improving Conversational Abilities of Quantized Large Language Models via Direct Preference Alignment3 Jul 2024 0 repositories listed
-
MLKD-BERT: Multi-level Knowledge Distillation for Pre-trained Language Models3 Jul 2024 0 repositories listed
-
Supporting Cross-language Cross-project Bug Localization Using Pre-trained Language Models3 Jul 2024 0 repositories listed
-
Unified Anomaly Detection methods on Edge Device using Knowledge Distillation and Quantization3 Jul 2024 0 repositories listed
-
ECAT: A Entire space Continual and Adaptive Transfer Learning Framework for Cross-Domain Recommendation2 Jul 2024 0 repositories listed
-
Self-Cooperation Knowledge Distillation for Novel Class Discovery2 Jul 2024 0 repositories listed
-
Survey on Knowledge Distillation for Large Language Models: Methods, Evaluation, and Application2 Jul 2024 0 repositories listed
-
BAPO: Base-Anchored Preference Optimization for Overcoming Forgetting in Large Language Models Personalization30 Jun 2024 0 repositories listed
-
Enhancing Accuracy and Parameter-Efficiency of Neural Representations for Network Parameterization29 Jun 2024 0 repositories listed
-
Direct Preference Knowledge Distillation for Large Language Models28 Jun 2024 0 repositories listed
-
Aligning Teacher with Student Preferences for Tailored Training Data Generation27 Jun 2024 0 repositories listed
-
On Reducing Activity with Distillation and Regularization for Energy Efficient Spiking Neural Networks26 Jun 2024 0 repositories listed
-
Highly Constrained Coded Aperture Imaging Systems Design Via a Knowledge Distillation Approach25 Jun 2024 0 repositories listed
-
InFiConD: Interactive No-code Fine-tuning with Concept-based Knowledge Distillation25 Jun 2024 0 repositories listed
-
Knowledge Distillation in Automated Annotation: Supervised Text Classification with LLM-Generated Training Labels25 Jun 2024 0 repositories listed
-
Preserving Node Distinctness in Graph Autoencoders via Similarity Distillation25 Jun 2024 0 repositories listed
-
Sequential Editing for Lifelong Training of Speech Recognition Models25 Jun 2024 0 repositories listed
-
Towards Optimal Trade-offs in Knowledge Distillation for CNNs and Vision Transformers at the Edge25 Jun 2024 0 repositories listed
-
WAVE: Weight Template for Adaptive Initialization of Variable-sized Models25 Jun 2024 0 repositories listed
-
Exploring compressibility of transformer based text-to-music (TTM) models24 Jun 2024 0 repositories listed
-
Leveraging Knowledge Distillation for Lightweight Skin Cancer Classification: Balancing Accuracy and Computational Efficiency24 Jun 2024 0 repositories listed
-
The Privileged Students: On the Value of Initialization in Multilingual Knowledge Distillation24 Jun 2024 0 repositories listed
-
Continual Learning with Diffusion-based Generative Replay for Industrial Streaming Data22 Jun 2024 0 repositories listed
-
Fair Text to Medical Image Diffusion Model with Subgroup Distribution Aligned Tuning21 Jun 2024 0 repositories listed
-
Apprenticeship-Inspired Elegance: Synergistic Knowledge Distillation Empowers Spiking Neural Networks for Efficient Single-Eye Emotion Recognition20 Jun 2024 0 repositories listed
-
Factual Dialogue Summarization via Learning from Large Language Models20 Jun 2024 0 repositories listed
-
Failure-Resilient Distributed Inference with Model Compression over Heterogeneous Edge Devices20 Jun 2024 0 repositories listed
-
SeCoKD: Aligning Large Language Models for In-Context Learning with Fewer Shots20 Jun 2024 0 repositories listed
-
Can Low-Rank Knowledge Distillation in LLMs be Useful for Microelectronic Reasoning?19 Jun 2024 0 repositories listed
-
Enhancing Single-Slice Segmentation with 3D-to-2D Unpaired Scan Distillation18 Jun 2024 0 repositories listed
-
Intermediate Distillation: Data-Efficient Distillation from Black-Box LLMs for Information Retrieval18 Jun 2024 0 repositories listed
-
Vernacular? I Barely Know Her: Challenges with Style Control and Stereotyping18 Jun 2024 0 repositories listed
-
Mutual Learning for Finetuning Click-Through Rate Prediction Models17 Jun 2024 0 repositories listed
-
NLDF: Neural Light Dynamic Fields for Efficient 3D Talking Head Generation17 Jun 2024 0 repositories listed
-
STEVE Series: Step-by-Step Construction of Agent Systems in Minecraft17 Jun 2024 0 repositories listed
-
Knowledge Distillation in Federated Learning: a Survey on Long Lasting Challenges and New Solutions16 Jun 2024 0 repositories listed
-
Self-Knowledge Distillation for Learning Ambiguity14 Jun 2024 0 repositories listed
-
Contextual Distillation Model for Diversified Recommendation13 Jun 2024 0 repositories listed
Syntology lines on 1 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced; each line links to that paper's sample list. Syntology's record for this page has not changed since , the first build that kept a record date for it; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.