Methods › General › Knowledge Distillation › Knowledge Distillation › Papers, page 8
Knowledge Distillation
Papers archive 2025-07-28
archive papers tagged: 3,071 · with a code link: 1,258 · where Syntology ran a sample: 320 (276 with a run with no instrument failure, 44 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (320 of 3,071 tagged: 276 with a run with no instrument failure, 44 where every run was a failure of Syntology's instrument)
Page 8 of 31: papers 701 to 800 of 3,071, newest first by the archive's date (ties by slug), in archive order.
Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code, as “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. It is per sample and not a correctness claim. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from.
-
Preserving Node Distinctness in Graph Autoencoders via Similarity Distillation 25 Jun 2024 · 0 repositories · arXiv:2406.17517
-
Sequential Editing for Lifelong Training of Speech Recognition Models 25 Jun 2024 · 0 repositories · arXiv:2406.17935
-
Towards Optimal Trade-offs in Knowledge Distillation for CNNs and Vision Transformers at the Edge 25 Jun 2024 · 0 repositories · arXiv:2407.12808
-
Exploring compressibility of transformer based text-to-music (TTM) models 24 Jun 2024 · 0 repositories · arXiv:2406.17159
-
Leveraging Knowledge Distillation for Lightweight Skin Cancer Classification: Balancing Accuracy and Computational Efficiency 24 Jun 2024 · 0 repositories · arXiv:2406.17051
-
Enhancing OOD Detection Using Latent Diffusion 24 Jun 2024 · 1 repository · arXiv:2406.16525
-
Continual Learning with Diffusion-based Generative Replay for Industrial Streaming Data 22 Jun 2024 · 0 repositories · arXiv:2406.15766
-
Fair Text to Medical Image Diffusion Model with Subgroup Distribution Aligned Tuning 21 Jun 2024 · 0 repositories · arXiv:2406.14847
-
Reinforced Knowledge Distillation for Time Series Regression 21 Jun 2024 · 1 repository
-
Apprenticeship-Inspired Elegance: Synergistic Knowledge Distillation Empowers Spiking Neural Networks for Efficient Single-Eye Emotion Recognition 20 Jun 2024 · 0 repositories · arXiv:2407.09521
-
Factual Dialogue Summarization via Learning from Large Language Models 20 Jun 2024 · 0 repositories · arXiv:2406.14709
-
Failure-Resilient Distributed Inference with Model Compression over Heterogeneous Edge Devices 20 Jun 2024 · 0 repositories · arXiv:2406.14185
-
Learning to Plan for Retrieval-Augmented Large Language Models from Knowledge Graphs 20 Jun 2024 · 1 repository · arXiv:2406.14282Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
BiLD: Bi-directional Logits Difference Loss for Large Language Model Distillation 19 Jun 2024 · 1 repository · arXiv:2406.13555
-
Can Low-Rank Knowledge Distillation in LLMs be Useful for Microelectronic Reasoning? 19 Jun 2024 · 0 repositories · arXiv:2406.13808
-
Multi-Stage Balanced Distillation: Addressing Long-Tail Challenges in Sequence-Level Knowledge Distillation 19 Jun 2024 · 1 repository · arXiv:2406.13114
-
WaterMono: Teacher-Guided Anomaly Masking and Enhancement Boosting for Robust Underwater Self-Supervised Monocular Depth Estimation 19 Jun 2024 · 1 repository · arXiv:2406.13344
-
Enhancing Single-Slice Segmentation with 3D-to-2D Unpaired Scan Distillation 18 Jun 2024 · 0 repositories · arXiv:2406.12254
-
Federated Learning with a Single Shared Image 18 Jun 2024 · 1 repository · arXiv:2406.12658
-
From Instance Training to Instruction Learning: Task Adapters Generation from Instructions 18 Jun 2024 · 2 repositories · arXiv:2406.12382Syntology official (archive's flag): 6 ran · 8 ran (of which 2 constructed an object rather than computing a result; 8 with no instrument failure: 0 honoured, 0 violated, 8 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 10 harvested samples)
-
Intermediate Distillation: Data-Efficient Distillation from Black-Box LLMs for Information Retrieval 18 Jun 2024 · 0 repositories · arXiv:2406.12169
-
Graph Knowledge Distillation to Mixture of Experts 17 Jun 2024 · 1 repository · arXiv:2406.11919
-
Mutual Learning for Finetuning Click-Through Rate Prediction Models 17 Jun 2024 · 0 repositories · arXiv:2406.12087
-
NLDF: Neural Light Dynamic Fields for Efficient 3D Talking Head Generation 17 Jun 2024 · 0 repositories · arXiv:2406.11259
-
Knowledge Distillation in Federated Learning: a Survey on Long Lasting Challenges and New Solutions 16 Jun 2024 · 0 repositories · arXiv:2406.10861
-
Contextual Distillation Model for Diversified Recommendation 13 Jun 2024 · 0 repositories · arXiv:2406.09021
-
DistilDoc: Knowledge Distillation for Visually-Rich Document Applications 12 Jun 2024 · 0 repositories · arXiv:2406.08226
-
GenDistiller: Distilling Pre-trained Language Models based on an Autoregressive Generative Model 12 Jun 2024 · 0 repositories · arXiv:2406.09444
-
Guiding Frame-Level CTC Alignments Using Self-knowledge Distillation 12 Jun 2024 · 1 repository · arXiv:2406.07909
-
Self-Distillation Learning Based on Temporal-Spatial Consistency for Spiking Neural Networks 12 Jun 2024 · 0 repositories · arXiv:2406.07862
-
Small Scale Data-Free Knowledge Distillation 12 Jun 2024 · 1 repository · arXiv:2406.07876
-
Unveiling Incomplete Modality Brain Tumor Segmentation: Leveraging Masked Predicted Auto-Encoder and Divergence Learning 12 Jun 2024 · 0 repositories · arXiv:2406.08634
-
FastAST: Accelerating Audio Spectrogram Transformer via Token Merging and Cross-Model Knowledge Distillation 11 Jun 2024 · 1 repository · arXiv:2406.07676
-
Hydra-MDP: End-to-end Multimodal Planning with Multi-target Hydra-Distillation 11 Jun 2024 · 3 repositories · arXiv:2406.06978
-
TernaryLLM: Ternarized Large Language Model 11 Jun 2024 · 0 repositories · arXiv:2406.07177
-
BS-PLCNet 2: Two-stage Band-split Packet Loss Concealment Network with Intra-model Knowledge Distillation 10 Jun 2024 · 0 repositories · arXiv:2406.05961
-
DKDL-Net: A Lightweight Bearing Fault Detection Model via Decoupled Knowledge Distillation and Low-Rank Adaptation Fine-tuning 10 Jun 2024 · 1 repository · arXiv:2406.06653
-
Weighted KL-Divergence for Document Ranking Model Refinement 10 Jun 2024 · 0 repositories · arXiv:2406.05977
-
IOR: Inversed Objects Replay for Incremental Object Detection 7 Jun 2024 · 0 repositories · arXiv:2406.04829
-
LenslessFace: An End-to-End Optimized Lensless System for Privacy-Preserving Face Verification 6 Jun 2024 · 1 repository · arXiv:2406.04129
-
Step Out and Seek Around: On Warm-Start Training with Incremental Data 6 Jun 2024 · 0 repositories · arXiv:2406.04484
-
Multi-Task Multi-Scale Contrastive Knowledge Distillation for Efficient Medical Image Segmentation 5 Jun 2024 · 1 repository · arXiv:2406.03173
-
Mutual Information Guided Backdoor Mitigation for Pre-trained Encoders 5 Jun 2024 · 0 repositories · arXiv:2406.03508
-
PLaD: Preference-based Large Language Model Distillation with Pseudo-Preference Pairs 5 Jun 2024 · 0 repositories · arXiv:2406.02886
-
DL-KDD: Dual-Light Knowledge Distillation for Action Recognition in the Dark 4 Jun 2024 · 0 repositories · arXiv:2406.02468
-
Optimal Transport Guided Correlation Assignment for Multimodal Entity Linking 4 Jun 2024 · 1 repository · arXiv:2406.01934
-
Decoupled Alignment for Robust Plug-and-Play Adaptation 3 Jun 2024 · 0 repositories · arXiv:2406.01514
-
Learning Background Prompts to Discover Implicit Knowledge for Open Vocabulary Object Detection 1 Jun 2024 · 0 repositories · arXiv:2406.00510
-
Robust Knowledge Distillation Based on Feature Variance Against Backdoored Teacher Model 1 Jun 2024 · 1 repository · arXiv:2406.03409
-
Distribution Aligned Semantics Adaption for Lifelong Person Re-Identification 30 May 2024 · 1 repository · arXiv:2405.19695
-
Estimating Human Poses Across Datasets: A Unified Skeleton and Multi-Teacher Distillation Approach 30 May 2024 · 0 repositories · arXiv:2405.20084
-
Improving the Training of Rectified Flows 30 May 2024 · 1 repository · arXiv:2405.20320Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
Relation Modeling and Distillation for Learning with Noisy Labels 30 May 2024 · 0 repositories · arXiv:2405.19606
-
Scalable Detection of Salient Entities in News Articles 30 May 2024 · 0 repositories · arXiv:2405.20461
-
BLSP-KD: Bootstrapping Language-Speech Pre-training via Knowledge Distillation 29 May 2024 · 0 repositories · arXiv:2405.19041
-
Forward-Backward Knowledge Distillation for Continual Clustering 29 May 2024 · 0 repositories · arXiv:2405.19234
-
Aligning in a Compact Space: Contrastive Knowledge Distillation between Heterogeneous Architectures 28 May 2024 · 0 repositories · arXiv:2405.18524
-
SLMRec: Distilling Large Language Models into Small for Sequential Recommendation 28 May 2024 · 1 repository · arXiv:2405.17890Syntology official: harvested, nothing ran · 0 ran · 3 unverified (of 3 harvested samples) · 3 pointer-only (licence)
-
LoReTrack: Efficient and Accurate Low-Resolution Transformer Tracking 27 May 2024 · 1 repository · arXiv:2405.17660
-
P4: Towards private, personalized, and Peer-to-Peer learning 27 May 2024 · 0 repositories · arXiv:2405.17697
-
TIMA: Text-Image Mutual Awareness for Balancing Zero-Shot Adversarial Robustness and Generalization Ability 27 May 2024 · 0 repositories · arXiv:2405.17678
-
UniCompress: Enhancing Multi-Data Medical Image Compression with Knowledge Distillation 27 May 2024 · 0 repositories · arXiv:2405.16850
-
Noisy Data Meets Privacy: Training Local Models with Post-Processed Remote Queries 25 May 2024 · 0 repositories · arXiv:2405.16361
-
Rethinking Early-Fusion Strategies for Improved Multispectral Object Detection 25 May 2024 · 1 repository · arXiv:2405.16038
-
Harnessing Increased Client Participation with Cohort-Parallel Federated Learning 24 May 2024 · 0 repositories · arXiv:2405.15644
-
Leveraging knowledge distillation for partial multi-task learning from multiple remote sensing datasets 24 May 2024 · 1 repository · arXiv:2405.15394
-
AdaGMLP: AdaBoosting GNN-to-MLP Knowledge Distillation 23 May 2024 · 1 repository · arXiv:2405.14307
-
Efficient Multitask Dense Predictor via Binarization 23 May 2024 · 0 repositories · arXiv:2405.14136
-
JiuZhang3.0: Efficiently Improving Mathematical Reasoning by Training Small Data Synthesis Models 23 May 2024 · 1 repository · arXiv:2405.14365Syntology official (archive's flag): 9 ran · 9 ran (of which 0 constructed an object rather than computing a result; 9 with no instrument failure: 0 honoured, 0 violated, 9 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified (of 12 harvested samples) · 12 pointer-only (licence)
-
Recurrent Early Exits for Federated Learning with Heterogeneous Clients 23 May 2024 · 1 repository · arXiv:2405.14791Syntology official (archive's flag): 9 ran · 9 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 4 where Syntology's instrument failed) · 11 unverified (of 20 harvested samples)
-
Data-Free Federated Class Incremental Learning with Diffusion-Based Generative Memory 22 May 2024 · 0 repositories · arXiv:2405.17457
-
HoverFast: an accurate, high-throughput, clinically deployable nuclear segmentation tool for brightfield digital pathology images 22 May 2024 · 0 repositories · arXiv:2405.14028
-
Joint Optimization of Streaming and Non-Streaming Automatic Speech Recognition with Multi-Decoder and Knowledge Distillation 22 May 2024 · 0 repositories · arXiv:2405.13514
-
Why Not Transform Chat Large Language Models to Non-English? 22 May 2024 · 1 repository · arXiv:2405.13923
-
Active Object Detection with Knowledge Aggregation and Distillation from Large Models 21 May 2024 · 1 repository · arXiv:2405.12509Syntology official: harvested, nothing ran · 0 ran · 1 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
AMFD: Distillation via Adaptive Multimodal Fusion for Multispectral Pedestrian Detection 21 May 2024 · 1 repository · arXiv:2405.12944Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
Distill-then-prune: An Efficient Compression Framework for Real-time Stereo Matching Network on Edge Devices 20 May 2024 · 0 repositories · arXiv:2405.11809
-
Evolving Storytelling: Benchmarks and Methods for New Character Customization with Diffusion Models 20 May 2024 · 0 repositories · arXiv:2405.11852
-
Federated Learning for Time-Series Healthcare Sensing with Incomplete Modalities 20 May 2024 · 1 repository · arXiv:2405.11828
-
GeoMask3D: Geometrically Informed Mask Selection for Self-Supervised Point Cloud Learning in 3D 20 May 2024 · 0 repositories · arXiv:2405.12419
-
Stereo-Knowledge Distillation from dpMV to Dual Pixels for Light Field Video Reconstruction 20 May 2024 · 0 repositories · arXiv:2405.11823
-
TinyM²Net-V3: Memory-Aware Compressed Multimodal Deep Neural Networks for Sustainable Edge Deployment 20 May 2024 · 0 repositories · arXiv:2405.12353
-
Cross-Domain Knowledge Distillation for Low-Resolution Human Pose Estimation 19 May 2024 · 0 repositories · arXiv:2405.11448
-
Hierarchical Selective Classification 19 May 2024 · 0 repositories · arXiv:2405.11533
-
Overcoming Data and Model Heterogeneities in Decentralized Federated Learning via Synthetic Anchors 19 May 2024 · 1 repository · arXiv:2405.11525Syntology 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 2 harvested samples) · 2 pointer-only (licence)
-
INDUS: Effective and Efficient Language Models for Scientific Applications 17 May 2024 · 0 repositories · arXiv:2405.10725
-
Densely Distilling Cumulative Knowledge for Continual Learning 16 May 2024 · 0 repositories · arXiv:2405.09820
-
Distilling Implicit Multimodal Knowledge into Large Language Models for Zero-Resource Dialogue Generation 16 May 2024 · 1 repository · arXiv:2405.10121
-
GLiRA: Black-Box Membership Inference Attack via Knowledge Distillation 13 May 2024 · 1 repository · arXiv:2405.07562
-
Meta-Learned Modality-Weighted Knowledge Distillation for Robust Multi-Modal Learning with Missing Data 12 May 2024 · 1 repository · arXiv:2405.07155
-
AdaKD: Dynamic Knowledge Distillation of ASR models using Adaptive Loss Weighting 11 May 2024 · 0 repositories · arXiv:2405.08019
-
For the Misgendered Chinese in Gender Bias Research: Multi-Task Learning with Knowledge Distillation for Pinyin Name-Gender Prediction 10 May 2024 · 0 repositories · arXiv:2405.06221
-
MH-pFLID: Model Heterogeneous personalized Federated Learning via Injection and Distillation for Medical Data Analysis 10 May 2024 · 0 repositories · arXiv:2405.06822
-
Less-supervised learning with knowledge distillation for sperm morphology analysis 8 May 2024 · 1 repository
-
Markowitz Meets Bellman: Knowledge-distilled Reinforcement Learning for Portfolio Management 8 May 2024 · 0 repositories · arXiv:2405.05449
-
ELiTe: Efficient Image-to-LiDAR Knowledge Transfer for Semantic Segmentation 7 May 2024 · 0 repositories · arXiv:2405.04121
-
GOVERN: Gradient Orientation Vote Ensemble for Multi-Teacher Reinforced Distillation 6 May 2024 · 0 repositories · arXiv:2405.03764
-
Exploring Extreme Quantization in Spiking Language Models 4 May 2024 · 0 repositories · arXiv:2405.02543
-
Sub-goal Distillation: A Method to Improve Small Language Agents 4 May 2024 · 1 repository · arXiv:2405.02749
-
Advancing Pre-trained Teacher: Towards Robust Feature Discrepancy for Anomaly Detection 3 May 2024 · 1 repository · arXiv:2405.02068