Methods › General › Knowledge Distillation › Knowledge Distillation › Papers, page 5
Knowledge Distillation
Papers archive 2025-07-28
archive papers tagged: 3,071 · with a code link: 1,258 · where Syntology ran a sample: 320 (276 with a run with no instrument failure, 44 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (320 of 3,071 tagged: 276 with a run with no instrument failure, 44 where every run was a failure of Syntology's instrument)
Page 5 of 31: papers 401 to 500 of 3,071, newest first by the archive's date (ties by slug), in archive order.
Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code, as “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. It is per sample and not a correctness claim. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from.
-
Faithful Label-free Knowledge Distillation 22 Nov 2024 · 1 repository · arXiv:2411.15239
-
Information Extraction from Heterogeneous Documents without Ground Truth Labels using Synthetic Label Generation and Knowledge Distillation 22 Nov 2024 · 0 repositories · arXiv:2411.14957
-
RankByGene: Gene-Guided Histopathology Representation Learning Through Cross-Modal Ranking Consistency 22 Nov 2024 · 0 repositories · arXiv:2411.15076
-
Simplifying CLIP: Unleashing the Power of Large-Scale Models on Consumer-level Computers 22 Nov 2024 · 0 repositories · arXiv:2411.14789
-
BiomedCoOp: Learning to Prompt for Biomedical Vision-Language Models 21 Nov 2024 · 1 repository · arXiv:2411.15232
-
CLFace: A Scalable and Resource-Efficient Continual Learning Framework for Lifelong Face Recognition 21 Nov 2024 · 0 repositories · arXiv:2411.13886
-
Teaching MLPs to Master Heterogeneous Graph-Structured Knowledge for Efficient and Accurate Inference 21 Nov 2024 · 1 repository · arXiv:2411.14035
-
Explainable LLM-driven Multi-dimensional Distillation for E-Commerce Relevance Learning 20 Nov 2024 · 0 repositories · arXiv:2411.13045
-
RTSR: A Real-Time Super-Resolution Model for AV1 Compressed Content 20 Nov 2024 · 0 repositories · arXiv:2411.13362
-
Just KIDDIN: Knowledge Infusion and Distillation for Detection of INdecent Memes 19 Nov 2024 · 0 repositories · arXiv:2411.12174
-
Reward Modeling with Ordinal Feedback: Wisdom of the Crowd 19 Nov 2024 · 0 repositories · arXiv:2411.12843
-
Federated Incremental Named Entity Recognition 18 Nov 2024 · 1 repository · arXiv:2411.11623
-
Exploring Feature-based Knowledge Distillation for Recommender System: A Frequency Perspective 16 Nov 2024 · 1 repository · arXiv:2411.10676Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 6 harvested samples)
-
Hybrid Attention Model Using Feature Decomposition and Knowledge Distillation for Glucose Forecasting 16 Nov 2024 · 1 repository · arXiv:2411.10703
-
Multi-perspective Contrastive Logit Distillation 16 Nov 2024 · 0 repositories · arXiv:2411.10693
-
Evidential Federated Learning for Skin Lesion Image Classification 15 Nov 2024 · 0 repositories · arXiv:2411.10071
-
Mono2Stereo: Monocular Knowledge Transfer for Enhanced Stereo Matching 14 Nov 2024 · 0 repositories · arXiv:2411.09151
-
VPBSD:Vessel-Pattern-Based Semi-Supervised Distillation for Efficient 3D Microscopic Cerebrovascular Segmentation 14 Nov 2024 · 0 repositories · arXiv:2411.09567
-
Dual-Head Knowledge Distillation: Enhancing Logits Utilization with an Auxiliary Head 13 Nov 2024 · 0 repositories · arXiv:2411.08937
-
UIFormer: A Unified Transformer-based Framework for Incremental Few-Shot Object Detection and Instance Segmentation 13 Nov 2024 · 0 repositories · arXiv:2411.08569
-
Feature Interaction Fusion Self-Distillation Network For CTR Prediction 12 Nov 2024 · 0 repositories · arXiv:2411.07508
-
Joint Diffusion models in Continual Learning 12 Nov 2024 · 0 repositories · arXiv:2411.08224
-
Learning with Less: Knowledge Distillation from Large Language Models via Unlabeled Data 12 Nov 2024 · 0 repositories · arXiv:2411.08028
-
Query Optimization for Parametric Knowledge Refinement in Retrieval-Augmented Large Language Models 12 Nov 2024 · 0 repositories · arXiv:2411.07820
-
An Efficient Memory Module for Graph Few-Shot Class-Incremental Learning 11 Nov 2024 · 1 repository · arXiv:2411.06659
-
LLM-Neo: Parameter Efficient Knowledge Distillation for Large Language Models 11 Nov 2024 · 2 repositories · arXiv:2411.06839Syntology 12 ran (of which 0 constructed an object rather than computing a result; 10 with no instrument failure: 0 honoured, 0 violated, 10 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 12 harvested samples) · 1 pointer-only (licence)
-
ScaleKD: Strong Vision Transformers Could Be Excellent Teachers 11 Nov 2024 · 1 repository · arXiv:2411.06786
-
CULL-MT: Compression Using Language and Layer pruning for Machine Translation 10 Nov 2024 · 0 repositories · arXiv:2411.06506
-
Over-parameterized Student Model via Tensor Decomposition Boosted Knowledge Distillation 10 Nov 2024 · 1 repository · arXiv:2411.06448Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 3 where Syntology's instrument failed) · 3 unverified (of 7 harvested samples)
-
Dynamic Textual Prompt For Rehearsal-free Lifelong Person Re-identification 9 Nov 2024 · 0 repositories · arXiv:2411.06023
-
Asterisk*: Keep it Simple 8 Nov 2024 · 0 repositories · arXiv:2411.05691
-
Knowledge Distillation Neural Network for Predicting Car-following Behaviour of Human-driven and Autonomous Vehicles 8 Nov 2024 · 0 repositories · arXiv:2411.05618
-
Mitigating Hallucination with ZeroG: An Advanced Knowledge Management Engine 8 Nov 2024 · 0 repositories · arXiv:2411.05936
-
Multi-Document Financial Question Answering using LLMs 8 Nov 2024 · 0 repositories · arXiv:2411.07264
-
Towards Lifelong Few-Shot Customization of Text-to-Image Diffusion 8 Nov 2024 · 0 repositories · arXiv:2411.05544
-
GazeGen: Gaze-Driven User Interaction for Visual Content Generation 7 Nov 2024 · 0 repositories · arXiv:2411.04335
-
Performance-Guided LLM Knowledge Distillation for Efficient Text Classification at Scale 7 Nov 2024 · 0 repositories · arXiv:2411.05045
-
Towards Competitive Search Relevance For Inference-Free Learned Sparse Retrievers 7 Nov 2024 · 1 repository · arXiv:2411.04403
-
Centerness-based Instance-aware Knowledge Distillation with Task-wise Mutual Lifting for Object Detection on Drone Imagery 5 Nov 2024 · 0 repositories · arXiv:2411.02861
-
Multimodal Commonsense Knowledge Distillation for Visual Question Answering 5 Nov 2024 · 0 repositories · arXiv:2411.02722
-
Transformer-Based Fault-Tolerant Control for Fixed-Wing UAVs Using Knowledge Distillation and In-Context Adaptation 5 Nov 2024 · 0 repositories · arXiv:2411.02975
-
Training on the Test Model: Contamination in Ranking Distillation 4 Nov 2024 · 1 repository · arXiv:2411.02284Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 4 unverified (of 8 harvested samples)
-
Adapting While Learning: Grounding LLMs for Scientific Problems with Intelligent Tool Usage Adaptation 1 Nov 2024 · 0 repositories · arXiv:2411.00412
-
Towards Building Secure UAV Navigation with FHE-aware Knowledge Distillation 1 Nov 2024 · 0 repositories · arXiv:2411.00403
-
Semantic Knowledge Distillation for Onboard Satellite Earth Observation Image Classification 31 Oct 2024 · 1 repository · arXiv:2411.00209
-
The Graph's Apprentice: Teaching an LLM Low Level Knowledge for Circuit Quality Estimation 30 Oct 2024 · 0 repositories · arXiv:2411.00843
-
Deep Learning for Medical Text Processing: BERT Model Fine-Tuning and Comparative Study 28 Oct 2024 · 0 repositories · arXiv:2410.20792
-
KD-LoRA: A Hybrid Approach to Efficient Fine-Tuning with LoRA and Knowledge Distillation 28 Oct 2024 · 1 repository · arXiv:2410.20777
-
Knowledge Distillation for Real-Time Classification of Early Media in Voice Communications 28 Oct 2024 · 0 repositories · arXiv:2410.21478
-
Relaxed Recursive Transformers: Effective Parameter Sharing with Layer-wise LoRA 28 Oct 2024 · 0 repositories · arXiv:2410.20672
-
Unveiling Context-Aware Criteria in Self-Assessing LLMs 28 Oct 2024 · 0 repositories · arXiv:2410.21545
-
SWITCH: Studying with Teacher for Knowledge Distillation of Large Language Models 25 Oct 2024 · 0 repositories · arXiv:2410.19503
-
AlignCap: Aligning Speech Emotion Captioning to Human Preferences 24 Oct 2024 · 0 repositories · arXiv:2410.19134
-
High-dimensional Analysis of Knowledge Distillation: Weak-to-Strong Generalization and Scaling Laws 24 Oct 2024 · 0 repositories · arXiv:2410.18837
-
Knowledge Distillation Using Frontier Open-source LLMs: Generalizability and the Role of Synthetic Data 24 Oct 2024 · 0 repositories · arXiv:2410.18588
-
SIKeD: Self-guided Iterative Knowledge Distillation for mathematical reasoning 24 Oct 2024 · 1 repository · arXiv:2410.18574
-
ELAICHI: Enhancing Low-resource TTS by Addressing Infrequent and Low-frequency Character Bigrams 23 Oct 2024 · 0 repositories · arXiv:2410.17901
-
Towards Active Participant-Centric Vertical Federated Learning: Some Representations May Be All You Need 23 Oct 2024 · 0 repositories · arXiv:2410.17648
-
Towards Effective Data-Free Knowledge Distillation via Diverse Diffusion Augmentation 23 Oct 2024 · 0 repositories · arXiv:2410.17606
-
AttriPrompter: Auto-Prompting with Attribute Semantics for Zero-shot Nuclei Detection via Visual-Language Pre-trained Models 22 Oct 2024 · 1 repository · arXiv:2410.16820
-
CK4Gen: A Knowledge Distillation Framework for Generating High-Utility Synthetic Survival Datasets in Healthcare 22 Oct 2024 · 0 repositories · arXiv:2410.16872
-
Model Mimic Attack: Knowledge Distillation for Provably Transferable Adversarial Examples 21 Oct 2024 · 0 repositories · arXiv:2410.15889
-
GSSF: Generalized Structural Sparse Function for Deep Cross-modal Metric Learning 20 Oct 2024 · 1 repository · arXiv:2410.15266
-
LLaVA-Ultra: Large Chinese Language and Vision Assistant for Ultrasound 19 Oct 2024 · 0 repositories · arXiv:2410.15074
-
Preview-based Category Contrastive Learning for Knowledge Distillation 18 Oct 2024 · 0 repositories · arXiv:2410.14143
-
An Active Learning Framework for Inclusive Generation by Large Language Models 17 Oct 2024 · 0 repositories · arXiv:2410.13641
-
CAKD: A Correlation-Aware Knowledge Distillation Framework Based on Decoupling Kullback-Leibler Divergence 17 Oct 2024 · 0 repositories · arXiv:2410.14741
-
FTSmartAudit: A Knowledge Distillation-Enhanced Framework for Automated Smart Contract Auditing Using Fine-Tuned LLMs 17 Oct 2024 · 0 repositories · arXiv:2410.13918
-
Optimizing YOLOv5s Object Detection through Knowledge Distillation algorithm 16 Oct 2024 · 0 repositories · arXiv:2410.12259
-
SAM-Guided Masked Token Prediction for 3D Scene Understanding 16 Oct 2024 · 0 repositories · arXiv:2410.12158
-
TAS: Distilling Arbitrary Teacher and Student via a Hybrid Assistant 16 Oct 2024 · 0 repositories · arXiv:2410.12342
-
Breaking Modality Gap in RGBT Tracking: Coupled Knowledge Distillation 15 Oct 2024 · 1 repository · arXiv:2410.11586
-
Learning from Imperfect Data: Towards Efficient Knowledge Distillation of Autoregressive Language Models for Text-to-SQL 15 Oct 2024 · 0 repositories · arXiv:2410.11371
-
Speculative Knowledge Distillation: Bridging the Teacher-Student Gap Through Interleaved Sampling 15 Oct 2024 · 0 repositories · arXiv:2410.11325
-
REHRSeg: Unleashing the Power of Self-Supervised Super-Resolution for Resource-Efficient 3D MRI Segmentation 14 Oct 2024 · 1 repository · arXiv:2410.10097
-
ROSAR: An Adversarial Re-Training Framework for Robust Side-Scan Sonar Object Detection 14 Oct 2024 · 1 repository · arXiv:2410.10554
-
Temperature-Centric Investigation of Speculative Decoding with Knowledge Distillation 14 Oct 2024 · 0 repositories · arXiv:2410.10141
-
Large Model for Small Data: Foundation Model for Cross-Modal RF Human Activity Recognition 13 Oct 2024 · 0 repositories · arXiv:2410.19766
-
Declarative Knowledge Distillation from Large Language Models for Visual Question Answering Datasets 12 Oct 2024 · 1 repository · arXiv:2410.09428
-
Mentor-KD: Making Small Language Models Better Multi-step Reasoners 11 Oct 2024 · 1 repository · arXiv:2410.09037Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)
-
Transforming In-Vehicle Network Intrusion Detection: VAE-based Knowledge Distillation Meets Explainable AI 11 Oct 2024 · 0 repositories · arXiv:2410.09043
-
A Lightweight Target-Driven Network of Stereo Matching for Inland Waterways 10 Oct 2024 · 0 repositories · arXiv:2410.07915
-
Relational Diffusion Distillation for Efficient Image Generation 10 Oct 2024 · 1 repository · arXiv:2410.07679Syntology official (archive's flag): 6 ran · 6 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 5 where Syntology's instrument failed) · 0 unverified (of 6 harvested samples) · 2 pointer-only (licence)
-
SNN-PAR: Energy Efficient Pedestrian Attribute Recognition via Spiking Neural Networks 10 Oct 2024 · 1 repository · arXiv:2410.07857
-
What is Left After Distillation? How Knowledge Transfer Impacts Fairness and Bias 10 Oct 2024 · 0 repositories · arXiv:2410.08407
-
Efficient and Robust Knowledge Distillation from A Stronger Teacher Based on Correlation Matching 9 Oct 2024 · 0 repositories · arXiv:2410.06561
-
Accelerating Diffusion Models with One-to-Many Knowledge Distillation 5 Oct 2024 · 0 repositories · arXiv:2410.04191
-
DocKD: Knowledge Distillation from LLMs for Open-World Document Understanding Models 4 Oct 2024 · 0 repositories · arXiv:2410.03061
-
Learning from Committee: Reasoning Distillation from a Mixture of Teachers with Peer-Review 4 Oct 2024 · 1 repository · arXiv:2410.03663
-
Self-Supervised Keypoint Detection with Distilled Depth Keypoint Representation 4 Oct 2024 · 0 repositories · arXiv:2410.14700
-
Dataset Distillation via Knowledge Distillation: Towards Efficient Self-Supervised Pre-Training of Deep Networks 3 Oct 2024 · 1 repository · arXiv:2410.02116Syntology official (archive's flag): 14 ran · 14 ran (of which 4 constructed an object rather than computing a result; 12 with no instrument failure: 1 honoured, 0 violated, 11 with no contract checked; 2 where Syntology's instrument failed) · 3 unverified (of 17 harvested samples) · 17 pointer-only (licence)
-
"No Matter What You Do": Purifying GNN Models via Backdoor Unlearning 2 Oct 2024 · 1 repository · arXiv:2410.01272
-
PairDistill: Pairwise Relevance Distillation for Dense Retrieval 2 Oct 2024 · 1 repository · arXiv:2410.01383Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples) · 3 pointer-only (licence)
-
PHI-S: Distribution Balancing for Label-Free Multi-Teacher Distillation 2 Oct 2024 · 1 repository · arXiv:2410.01680
-
Advancing Medical Radiograph Representation Learning: A Hybrid Pre-training Paradigm with Multilevel Semantic Granularity 1 Oct 2024 · 0 repositories · arXiv:2410.00448
-
AMR-Evol: Adaptive Modular Response Evolution Elicits Better Knowledge Distillation for Large Language Models in Code Generation 1 Oct 2024 · 1 repository · arXiv:2410.00558
-
Compressing Recurrent Neural Networks for FPGA-accelerated Implementation in Fluorescence Lifetime Imaging 1 Oct 2024 · 0 repositories · arXiv:2410.00948
-
Efficient Technical Term Translation: A Knowledge Distillation Approach for Parenthetical Terminology Translation 1 Oct 2024 · 0 repositories · arXiv:2410.00683
-
Local-to-Global Self-Supervised Representation Learning for Diabetic Retinopathy Grading 1 Oct 2024 · 0 repositories · arXiv:2410.00779
-
Self-Updatable Large Language Models with Parameter Integration 1 Oct 2024 · 0 repositories · arXiv:2410.00487