Browse State-of-the-Art › Knowledge Distillation › Papers, page 22
Knowledge Distillation
Papers archive 2025-07-28
archive papers tagged: 4,240 · with a code link: 1,740 · where Syntology ran a sample: 451 (380 with a run with no instrument failure, 71 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (451 of 4,240 tagged: 380 with a run with no instrument failure, 71 where every run was a failure of Syntology's instrument)
Page 22 of 43: papers 2,101 to 2,200 of 4,240, in archive order: by repositories listed in the archive (most first), then newest first, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers that list no repository come after every paper that lists one.
Papers without a page here are shown as plain text. A Syntology line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the figure “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code); hover it for the repositories the samples that ran came from. Abstracts are on each paper's page.
-
Headache to Overstock? Promoting Long-tail Items through Debiased Product Bundling28 Nov 2024 0 repositories listed
-
Pre-Training Graph Contrastive Masked Autoencoders are Strong Distillers for EEG28 Nov 2024 0 repositories listed
-
Puzzle: Distillation-Based NAS for Inference-Optimized LLMs28 Nov 2024 0 repositories listed
-
Zero-shot Slot Filling in the Age of LLMs for Dialogue Systems28 Nov 2024 0 repositories listed
-
Active Data Curation Effectively Distills Large-Scale Multimodal Models27 Nov 2024 0 repositories listed
-
Improved implicit diffusion model with knowledge distillation to estimate the spatial distribution density of carbon stock in remote sensing imagery27 Nov 2024 0 repositories listed
-
Large-Scale Data-Free Knowledge Distillation for ImageNet via Multi-Resolution Data Generation26 Nov 2024 0 repositories listed
-
Beyond Task Vectors: Selective Task Arithmetic Based on Importance Metrics25 Nov 2024 0 repositories listed
-
Dynamic Self-Distillation via Previous Mini-batches for Fine-tuning Small Language Models25 Nov 2024 0 repositories listed
-
Leveraging Foundation Models To learn the shape of semi-fluid deformable objects25 Nov 2024 0 repositories listed
-
TransFair: Transferring Fairness from Ocular Disease Classification to Progression Prediction24 Nov 2024 0 repositories listed
-
Partial Knowledge Distillation for Alleviating the Inherent Inter-Class Discrepancy in Federated Learning23 Nov 2024 0 repositories listed
-
Adaptive Group Robust Ensemble Knowledge Distillation22 Nov 2024 0 repositories listed
-
Adversarial Prompt Distillation for Vision-Language Models22 Nov 2024 0 repositories listed
-
BanglaEmbed: Efficient Sentence Embedding Models for a Low-Resource Language Using Cross-Lingual Distillation Techniques22 Nov 2024 0 repositories listed
-
Improving Mathematical Reasoning Capabilities of Small Language Models via Feedback-Driven Distillation22 Nov 2024 0 repositories listed
-
Information Extraction from Heterogeneous Documents without Ground Truth Labels using Synthetic Label Generation and Knowledge Distillation22 Nov 2024 0 repositories listed
-
RankByGene: Gene-Guided Histopathology Representation Learning Through Cross-Modal Ranking Consistency22 Nov 2024 0 repositories listed
-
Simplifying CLIP: Unleashing the Power of Large-Scale Models on Consumer-level Computers22 Nov 2024 0 repositories listed
-
CLFace: A Scalable and Resource-Efficient Continual Learning Framework for Lifelong Face Recognition21 Nov 2024 0 repositories listed
-
Explainable LLM-driven Multi-dimensional Distillation for E-Commerce Relevance Learning20 Nov 2024 0 repositories listed
-
RTSR: A Real-Time Super-Resolution Model for AV1 Compressed Content20 Nov 2024 0 repositories listed
-
Just KIDDIN: Knowledge Infusion and Distillation for Detection of INdecent Memes19 Nov 2024 0 repositories listed
-
KDC-MAE: Knowledge Distilled Contrastive Mask Auto-Encoder19 Nov 2024 0 repositories listed
-
Reward Modeling with Ordinal Feedback: Wisdom of the Crowd19 Nov 2024 0 repositories listed
-
What Makes a Good Dataset for Knowledge Distillation?19 Nov 2024 0 repositories listed
-
Map-Free Trajectory Prediction with Map Distillation and Hierarchical Encoding17 Nov 2024 0 repositories listed
-
Multi-perspective Contrastive Logit Distillation16 Nov 2024 0 repositories listed
-
Evidential Federated Learning for Skin Lesion Image Classification15 Nov 2024 0 repositories listed
-
Mono2Stereo: Monocular Knowledge Transfer for Enhanced Stereo Matching14 Nov 2024 0 repositories listed
-
VPBSD:Vessel-Pattern-Based Semi-Supervised Distillation for Efficient 3D Microscopic Cerebrovascular Segmentation14 Nov 2024 0 repositories listed
-
Dual-Head Knowledge Distillation: Enhancing Logits Utilization with an Auxiliary Head13 Nov 2024 0 repositories listed
-
Federated Graph Learning with Graphless Clients13 Nov 2024 0 repositories listed
-
UIFormer: A Unified Transformer-based Framework for Incremental Few-Shot Object Detection and Instance Segmentation13 Nov 2024 0 repositories listed
-
Feature Interaction Fusion Self-Distillation Network For CTR Prediction12 Nov 2024 0 repositories listed
-
Joint Diffusion models in Continual Learning12 Nov 2024 0 repositories listed
-
Learning with Less: Knowledge Distillation from Large Language Models via Unlabeled Data12 Nov 2024 0 repositories listed
-
Quantifying Knowledge Distillation Using Partial Information Decomposition12 Nov 2024 0 repositories listed
-
Query Optimization for Parametric Knowledge Refinement in Retrieval-Augmented Large Language Models12 Nov 2024 0 repositories listed
-
CULL-MT: Compression Using Language and Layer pruning for Machine Translation10 Nov 2024 0 repositories listed
-
Dynamic Textual Prompt For Rehearsal-free Lifelong Person Re-identification9 Nov 2024 0 repositories listed
-
Asterisk*: Keep it Simple8 Nov 2024 0 repositories listed
-
Knowledge Distillation Neural Network for Predicting Car-following Behaviour of Human-driven and Autonomous Vehicles8 Nov 2024 0 repositories listed
-
Mitigating Hallucination with ZeroG: An Advanced Knowledge Management Engine8 Nov 2024 0 repositories listed
-
Multi-Document Financial Question Answering using LLMs8 Nov 2024 0 repositories listed
-
Towards Lifelong Few-Shot Customization of Text-to-Image Diffusion8 Nov 2024 0 repositories listed
-
GazeGen: Gaze-Driven User Interaction for Visual Content Generation7 Nov 2024 0 repositories listed
-
Performance-Guided LLM Knowledge Distillation for Efficient Text Classification at Scale7 Nov 2024 0 repositories listed
-
Towards Personalized Federated Learning via Comprehensive Knowledge Distillation6 Nov 2024 0 repositories listed
-
Centerness-based Instance-aware Knowledge Distillation with Task-wise Mutual Lifting for Object Detection on Drone Imagery5 Nov 2024 0 repositories listed
-
Multimodal Commonsense Knowledge Distillation for Visual Question Answering5 Nov 2024 0 repositories listed
-
Transformer-Based Fault-Tolerant Control for Fixed-Wing UAVs Using Knowledge Distillation and In-Context Adaptation5 Nov 2024 0 repositories listed
-
Decoupling Dark Knowledge via Block-wise Logit Distillation for Feature-level Alignment3 Nov 2024 0 repositories listed
-
Adapting While Learning: Grounding LLMs for Scientific Problems with Intelligent Tool Usage Adaptation1 Nov 2024 0 repositories listed
-
On the Impact of White-box Deployment Strategies for Edge AI on Latency and Model Performance1 Nov 2024 0 repositories listed
-
Towards Building Secure UAV Navigation with FHE-aware Knowledge Distillation1 Nov 2024 0 repositories listed
-
IP-MOT: Instance Prompt Learning for Cross-Domain Multi-Object Tracking30 Oct 2024 0 repositories listed
-
The Graph's Apprentice: Teaching an LLM Low Level Knowledge for Circuit Quality Estimation30 Oct 2024 0 repositories listed
-
Deep Learning for Medical Text Processing: BERT Model Fine-Tuning and Comparative Study28 Oct 2024 0 repositories listed
-
Knowledge Distillation for Real-Time Classification of Early Media in Voice Communications28 Oct 2024 0 repositories listed
-
Relaxed Recursive Transformers: Effective Parameter Sharing with Layer-wise LoRA28 Oct 2024 0 repositories listed
-
Unveiling Context-Aware Criteria in Self-Assessing LLMs28 Oct 2024 0 repositories listed
-
SWITCH: Studying with Teacher for Knowledge Distillation of Large Language Models25 Oct 2024 0 repositories listed
-
AlignCap: Aligning Speech Emotion Captioning to Human Preferences24 Oct 2024 0 repositories listed
-
High-dimensional Analysis of Knowledge Distillation: Weak-to-Strong Generalization and Scaling Laws24 Oct 2024 0 repositories listed
-
Knowledge Distillation Using Frontier Open-source LLMs: Generalizability and the Role of Synthetic Data24 Oct 2024 0 repositories listed
-
ELAICHI: Enhancing Low-resource TTS by Addressing Infrequent and Low-frequency Character Bigrams23 Oct 2024 0 repositories listed
-
Towards Active Participant-Centric Vertical Federated Learning: Some Representations May Be All You Need23 Oct 2024 0 repositories listed
-
Towards Effective Data-Free Knowledge Distillation via Diverse Diffusion Augmentation23 Oct 2024 0 repositories listed
-
CK4Gen: A Knowledge Distillation Framework for Generating High-Utility Synthetic Survival Datasets in Healthcare22 Oct 2024 0 repositories listed
-
SafetyAnalyst: Interpretable, Transparent, and Steerable Safety Moderation for AI Behavior22 Oct 2024 0 repositories listed
-
Model Mimic Attack: Knowledge Distillation for Provably Transferable Adversarial Examples21 Oct 2024 0 repositories listed
-
Pre-training Distillation for Large Language Models: A Design Space Exploration21 Oct 2024 0 repositories listed
-
Improving Pronunciation and Accent Conversion through Knowledge Distillation And Synthetic Ground-Truth from Native TTS19 Oct 2024 0 repositories listed
-
LLaVA-Ultra: Large Chinese Language and Vision Assistant for Ultrasound19 Oct 2024 0 repositories listed
-
Preview-based Category Contrastive Learning for Knowledge Distillation18 Oct 2024 0 repositories listed
-
An Active Learning Framework for Inclusive Generation by Large Language Models17 Oct 2024 0 repositories listed
-
CAKD: A Correlation-Aware Knowledge Distillation Framework Based on Decoupling Kullback-Leibler Divergence17 Oct 2024 0 repositories listed
-
FTSmartAudit: A Knowledge Distillation-Enhanced Framework for Automated Smart Contract Auditing Using Fine-Tuned LLMs17 Oct 2024 0 repositories listed
-
Towards Satellite Non-IID Imagery: A Spectral Clustering-Assisted Federated Learning Approach17 Oct 2024 0 repositories listed
-
Optimizing YOLOv5s Object Detection through Knowledge Distillation algorithm16 Oct 2024 0 repositories listed
-
Proactive Detection and Calibration of Seasonal Advertisements with Multimodal Large Language Models16 Oct 2024 0 repositories listed
-
SAM-Guided Masked Token Prediction for 3D Scene Understanding16 Oct 2024 0 repositories listed
-
TAS: Distilling Arbitrary Teacher and Student via a Hybrid Assistant16 Oct 2024 0 repositories listed
-
Learning from Imperfect Data: Towards Efficient Knowledge Distillation of Autoregressive Language Models for Text-to-SQL15 Oct 2024 0 repositories listed
-
MoE-Pruner: Pruning Mixture-of-Experts Large Language Model using the Hints from Its Router15 Oct 2024 0 repositories listed
-
Speculative Knowledge Distillation: Bridging the Teacher-Student Gap Through Interleaved Sampling15 Oct 2024 0 repositories listed
-
Temperature-Centric Investigation of Speculative Decoding with Knowledge Distillation14 Oct 2024 0 repositories listed
-
Large Model for Small Data: Foundation Model for Cross-Modal RF Human Activity Recognition13 Oct 2024 0 repositories listed
-
Distilling Invariant Representations with Dual Augmentation12 Oct 2024 0 repositories listed
-
GAI-Enabled Explainable Personalized Federated Semi-Supervised Learning11 Oct 2024 0 repositories listed
-
Simultaneous Reward Distillation and Preference Learning: Get You a Language Model Who Can Do Both11 Oct 2024 0 repositories listed
-
Transforming In-Vehicle Network Intrusion Detection: VAE-based Knowledge Distillation Meets Explainable AI11 Oct 2024 0 repositories listed
-
A Lightweight Target-Driven Network of Stereo Matching for Inland Waterways10 Oct 2024 0 repositories listed
-
What is Left After Distillation? How Knowledge Transfer Impacts Fairness and Bias10 Oct 2024 0 repositories listed
-
Efficient and Robust Knowledge Distillation from A Stronger Teacher Based on Correlation Matching9 Oct 2024 0 repositories listed
-
9 Oct 2024 0 repositories listed Syntology 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
Structure-Centric Robust Monocular Depth Estimation via Knowledge Distillation9 Oct 2024 0 repositories listed
-
Unlocking Real-Time Fluorescence Lifetime Imaging: Multi-Pixel Parallelism for FPGA-Accelerated Processing9 Oct 2024 0 repositories listed
-
Progressive distillation induces an implicit curriculum7 Oct 2024 0 repositories listed
Syntology lines on 1 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced; each line links to that paper's sample list. Syntology's record for this page has not changed since , the first build that kept a record date for it; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.