Browse State-of-the-Art › Knowledge Distillation › Papers, page 25
Knowledge Distillation
Papers archive 2025-07-28
archive papers tagged: 4,240 · with a code link: 1,740 · where Syntology ran a sample: 451 (380 with a run with no instrument failure, 71 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (451 of 4,240 tagged: 380 with a run with no instrument failure, 71 where every run was a failure of Syntology's instrument)
Page 25 of 43: papers 2,401 to 2,500 of 4,240, in archive order: by repositories listed in the archive (most first), then newest first, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers that list no repository come after every paper that lists one.
Papers without a page here are shown as plain text. A Syntology line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the figure “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code); hover it for the repositories the samples that ran came from. Abstracts are on each paper's page.
-
PC-LoRA: Low-Rank Adaptation for Progressive Model Compression with Knowledge Distillation13 Jun 2024 0 repositories listed
-
DistilDoc: Knowledge Distillation for Visually-Rich Document Applications12 Jun 2024 0 repositories listed
-
GenDistiller: Distilling Pre-trained Language Models based on an Autoregressive Generative Model12 Jun 2024 0 repositories listed
-
Self-Distillation Learning Based on Temporal-Spatial Consistency for Spiking Neural Networks12 Jun 2024 0 repositories listed
-
Unveiling Incomplete Modality Brain Tumor Segmentation: Leveraging Masked Predicted Auto-Encoder and Divergence Learning12 Jun 2024 0 repositories listed
-
Teaching with Uncertainty: Unleashing the Potential of Knowledge Distillation in Object Detection11 Jun 2024 0 repositories listed
-
TernaryLLM: Ternarized Large Language Model11 Jun 2024 0 repositories listed
-
BS-PLCNet 2: Two-stage Band-split Packet Loss Concealment Network with Intra-model Knowledge Distillation10 Jun 2024 0 repositories listed
-
Weighted KL-Divergence for Document Ranking Model Refinement10 Jun 2024 0 repositories listed
-
Online Policy Distillation with Decision-Attention8 Jun 2024 0 repositories listed
-
Teaching-Assistant-in-the-Loop: Improving Knowledge Distillation from Imperfect Teacher Models in Low-Budget Scenarios8 Jun 2024 0 repositories listed
-
IOR: Inversed Objects Replay for Incremental Object Detection7 Jun 2024 0 repositories listed
-
Step Out and Seek Around: On Warm-Start Training with Incremental Data6 Jun 2024 0 repositories listed
-
Decision Boundary-aware Knowledge Consolidation Generates Better Instance-Incremental Learner5 Jun 2024 0 repositories listed
-
Mutual Information Guided Backdoor Mitigation for Pre-trained Encoders5 Jun 2024 0 repositories listed
-
PLaD: Preference-based Large Language Model Distillation with Pseudo-Preference Pairs5 Jun 2024 0 repositories listed
-
DL-KDD: Dual-Light Knowledge Distillation for Action Recognition in the Dark4 Jun 2024 0 repositories listed
-
RKLD: Reverse KL-Divergence-based Knowledge Distillation for Unlearning Personal Information in Large Language Models4 Jun 2024 0 repositories listed
-
Decoupled Alignment for Robust Plug-and-Play Adaptation3 Jun 2024 0 repositories listed
-
Toward Efficient Deep Spiking Neuron Networks:A Survey On Compression3 Jun 2024 0 repositories listed
-
Learning Background Prompts to Discover Implicit Knowledge for Open Vocabulary Object Detection1 Jun 2024 0 repositories listed
-
Multi-label Class Incremental Emotion Decoding with Augmented Emotional Semantics Learning31 May 2024 0 repositories listed
-
Estimating Human Poses Across Datasets: A Unified Skeleton and Multi-Teacher Distillation Approach30 May 2024 0 repositories listed
-
Relation Modeling and Distillation for Learning with Noisy Labels30 May 2024 0 repositories listed
-
Scalable Detection of Salient Entities in News Articles30 May 2024 0 repositories listed
-
BLSP-KD: Bootstrapping Language-Speech Pre-training via Knowledge Distillation29 May 2024 0 repositories listed
-
Forward-Backward Knowledge Distillation for Continual Clustering29 May 2024 0 repositories listed
-
Aligning in a Compact Space: Contrastive Knowledge Distillation between Heterogeneous Architectures28 May 2024 0 repositories listed
-
P4: Towards private, personalized, and Peer-to-Peer learning27 May 2024 0 repositories listed
-
TIMA: Text-Image Mutual Awareness for Balancing Zero-Shot Adversarial Robustness and Generalization Ability27 May 2024 0 repositories listed
-
UniCompress: Enhancing Multi-Data Medical Image Compression with Knowledge Distillation27 May 2024 0 repositories listed
-
A Classifier-Free Incremental Learning Framework for Scalable Medical Image Segmentation25 May 2024 0 repositories listed
-
Noisy Data Meets Privacy: Training Local Models with Post-Processed Remote Queries25 May 2024 0 repositories listed
-
Harnessing Increased Client Participation with Cohort-Parallel Federated Learning24 May 2024 0 repositories listed
-
Efficient Multitask Dense Predictor via Binarization23 May 2024 0 repositories listed
-
Pre-Trained Vision-Language Models as Partial Annotators23 May 2024 0 repositories listed
-
Data-Free Federated Class Incremental Learning with Diffusion-Based Generative Memory22 May 2024 0 repositories listed
-
HoverFast: an accurate, high-throughput, clinically deployable nuclear segmentation tool for brightfield digital pathology images22 May 2024 0 repositories listed
-
Joint Optimization of Streaming and Non-Streaming Automatic Speech Recognition with Multi-Decoder and Knowledge Distillation22 May 2024 0 repositories listed
-
Low-Resolution Chest X-ray Classification via Knowledge Distillation and Multi-task Learning22 May 2024 0 repositories listed
-
Exploring Dark Knowledge under Various Teacher Capacities and Addressing Capacity Mismatch21 May 2024 0 repositories listed
-
Distill-then-prune: An Efficient Compression Framework for Real-time Stereo Matching Network on Edge Devices20 May 2024 0 repositories listed
-
Efficiency optimization of large-scale language models based on deep learning in natural language processing tasks20 May 2024 0 repositories listed
-
Evolving Storytelling: Benchmarks and Methods for New Character Customization with Diffusion Models20 May 2024 0 repositories listed
-
GeoMask3D: Geometrically Informed Mask Selection for Self-Supervised Point Cloud Learning in 3D20 May 2024 0 repositories listed
-
Stereo-Knowledge Distillation from dpMV to Dual Pixels for Light Field Video Reconstruction20 May 2024 0 repositories listed
-
TinyM²Net-V3: Memory-Aware Compressed Multimodal Deep Neural Networks for Sustainable Edge Deployment20 May 2024 0 repositories listed
-
Cross-Domain Knowledge Distillation for Low-Resolution Human Pose Estimation19 May 2024 0 repositories listed
-
Hierarchical Selective Classification19 May 2024 0 repositories listed
-
Nickel and Diming Your GAN: A Dual-Method Approach to Enhancing GAN Efficiency via Knowledge Distillation19 May 2024 0 repositories listed
-
INDUS: Effective and Efficient Language Models for Scientific Applications17 May 2024 0 repositories listed
-
Densely Distilling Cumulative Knowledge for Continual Learning16 May 2024 0 repositories listed
-
QCRD: Quality-guided Contrastive Rationale Distillation for Large Language Models14 May 2024 0 repositories listed
-
AdaKD: Dynamic Knowledge Distillation of ASR models using Adaptive Loss Weighting11 May 2024 0 repositories listed
-
For the Misgendered Chinese in Gender Bias Research: Multi-Task Learning with Knowledge Distillation for Pinyin Name-Gender Prediction10 May 2024 0 repositories listed
-
MH-pFLID: Model Heterogeneous personalized Federated Learning via Injection and Distillation for Medical Data Analysis10 May 2024 0 repositories listed
-
From Algorithm to Hardware: A Survey on Efficient and Safe Deployment of Deep Neural Networks9 May 2024 0 repositories listed
-
A Review on Discriminative Self-supervised Learning Methods in Computer Vision8 May 2024 0 repositories listed
-
CourseGPT-zh: an Educational Large Language Model Based on Knowledge Distillation Incorporating Prompt Optimization8 May 2024 0 repositories listed
-
Markowitz Meets Bellman: Knowledge-distilled Reinforcement Learning for Portfolio Management8 May 2024 0 repositories listed
-
ELiTe: Efficient Image-to-LiDAR Knowledge Transfer for Semantic Segmentation7 May 2024 0 repositories listed
-
GOVERN: Gradient Orientation Vote Ensemble for Multi-Teacher Reinforced Distillation6 May 2024 0 repositories listed
-
Mind the Gap Between Synthetic and Real: Utilizing Transfer Learning to Probe the Boundaries of Stable Diffusion Generated Data6 May 2024 0 repositories listed
-
Exploring Extreme Quantization in Spiking Language Models4 May 2024 0 repositories listed
-
Semantic Objective Functions: A distribution-aware method for adding logical constraints in deep learning3 May 2024 0 repositories listed
-
Efficient Compression of Multitask Multilingual Speech Models2 May 2024 0 repositories listed
-
Error Exponent in Agnostic PAC Learning1 May 2024 0 repositories listed
-
Wake Vision: A Tailored Dataset and Benchmark Suite for TinyML Computer Vision Applications1 May 2024 0 repositories listed
-
Knowledge Distillation vs. Pretraining from Scratch under a Fixed (Computation) Budget30 Apr 2024 0 repositories listed
-
Control Policy Correction Framework for Reinforcement Learning-based Energy Arbitrage Strategies29 Apr 2024 0 repositories listed
-
Enhancing Action Recognition from Low-Quality Skeleton Data via Part-Level Knowledge Distillation28 Apr 2024 0 repositories listed
-
Revealing the Two Sides of Data Augmentation: An Asymmetric Distillation-based Win-Win Solution for Open-Set Recognition28 Apr 2024 0 repositories listed
-
A Novel Spike Transformer Network for Depth Estimation from Event Cameras via Cross-modality Knowledge Distillation26 Apr 2024 0 repositories listed
-
Correlation-Decoupled Knowledge Distillation for Multimodal Sentiment Analysis with Incomplete Modalities25 Apr 2024 0 repositories listed
-
Promoting CNNs with Cross-Architecture Knowledge Distillation for Efficient Monocular Depth Estimation25 Apr 2024 0 repositories listed
-
BeSound: Bluetooth-Based Position Estimation Enhancing with Cross-Modality Distillation24 Apr 2024 0 repositories listed
-
Compressed Meta-Optical Encoder for Image Classification23 Apr 2024 0 repositories listed
-
Sentence-Level or Token-Level? A Comprehensive Study on Knowledge Distillation23 Apr 2024 0 repositories listed
-
Distributed Learning for Wi-Fi AP Load Prediction22 Apr 2024 0 repositories listed
-
FedTAD: Topology-aware Data-free Knowledge Distillation for Subgraph Federated Learning22 Apr 2024 0 repositories listed
-
From LLM to NMT: Advancing Low-Resource Machine Translation with Claude22 Apr 2024 0 repositories listed
-
EncodeNet: A Framework for Boosting DNN Accuracy with Entropy-driven Generalized Converting Autoencoder21 Apr 2024 0 repositories listed
-
MergeNet: Knowledge Migration across Heterogeneous Models, Tasks, and Modalities20 Apr 2024 0 repositories listed
-
Parameter Efficient Diverse Paraphrase Generation Using Sequence-Level Knowledge Distillation19 Apr 2024 0 repositories listed
-
EdgeFusion: On-Device Text-to-Image Generation18 Apr 2024 0 repositories listed
-
KDk: A Defense Mechanism Against Label Inference Attacks in Vertical Federated Learning18 Apr 2024 0 repositories listed
-
A Progressive Framework of Vision-language Knowledge Distillation and Alignment for Multilingual Scene17 Apr 2024 0 repositories listed
-
LAPTOP-Diff: Layer Pruning and Normalized Distillation for Compressing Diffusion Models17 Apr 2024 0 repositories listed
-
Comprehensive Survey of Model Compression and Speed up for Vision Transformers16 Apr 2024 0 repositories listed
-
MK-SGN: A Spiking Graph Convolutional Network with Multimodal Fusion and Knowledge Distillation for Skeleton-based Action Recognition16 Apr 2024 0 repositories listed
-
MTKD: Multi-Teacher Knowledge Distillation for Image Super-Resolution15 Apr 2024 0 repositories listed
-
Adversarial Robustness of Distilled and Pruned Deep Learning-based Wireless Classifiers11 Apr 2024 0 repositories listed
-
Boosting Self-Supervision for Single-View Scene Completion via Knowledge Distillation11 Apr 2024 0 repositories listed
-
Edge-Efficient Deep Learning Models for Automatic Modulation Classification: A Performance Analysis11 Apr 2024 0 repositories listed
-
Remembering Transformer for Continual Learning11 Apr 2024 0 repositories listed
-
A predictive machine learning force field framework for liquid electrolyte development10 Apr 2024 0 repositories listed
-
Improving Facial Landmark Detection Accuracy and Efficiency with Knowledge Distillation9 Apr 2024 0 repositories listed
-
Robust feature knowledge distillation for enhanced performance of lightweight crack segmentation models9 Apr 2024 0 repositories listed
-
GHOST: Grounded Human Motion Generation with Open Vocabulary Scene-and-Text Contexts8 Apr 2024 0 repositories listed
-
Bootstrapping Chest CT Image Understanding by Distilling Knowledge from X-ray Expert Models7 Apr 2024 0 repositories listed