Browse State-of-the-Art › Knowledge Distillation › Papers, page 26
Knowledge Distillation
Papers archive 2025-07-28
archive papers tagged: 4,240 · with a code link: 1,740 · where Syntology ran a sample: 451 (380 with a run with no instrument failure, 71 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (451 of 4,240 tagged: 380 with a run with no instrument failure, 71 where every run was a failure of Syntology's instrument)
Page 26 of 43: papers 2,501 to 2,600 of 4,240, in archive order: by repositories listed in the archive (most first), then newest first, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers that list no repository come after every paper that lists one.
Papers without a page here are shown as plain text. A Syntology line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the figure “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code); hover it for the repositories the samples that ran came from. Abstracts are on each paper's page.
-
Do We Really Need a Complex Agent System? Distill Embodied Agent into a Single Model6 Apr 2024 0 repositories listed
-
What Happens When Small Is Made Smaller? Exploring the Impact of Compression on Small Data Pretrained Language Models6 Apr 2024 0 repositories listed
-
Can Small Language Models Help Large Language Models Reason Better?: LM-Guided Chain-of-Thought4 Apr 2024 0 repositories listed
-
Adaptive Affinity-Based Generalization For MRI Imaging Segmentation Across Resource-Limited Settings3 Apr 2024 0 repositories listed
-
Improve Knowledge Distillation via Label Revision and Data Selection3 Apr 2024 0 repositories listed
-
Knowledge Distillation with Multi-granularity Mixture of Priors for Image Super-Resolution3 Apr 2024 0 repositories listed
-
Class-Incremental Few-Shot Event Detection2 Apr 2024 0 repositories listed
-
Federated Distillation: A Survey2 Apr 2024 0 repositories listed
-
Task Integration Distillation for Object Detectors2 Apr 2024 0 repositories listed
-
Towards Scalable & Efficient Interaction-Aware Planning in Autonomous Vehicles using Knowledge Distillation2 Apr 2024 0 repositories listed
-
A Comprehensive Review of Knowledge Distillation in Computer Vision1 Apr 2024 0 repositories listed
-
LLM-RadJudge: Achieving Radiologist-Level Evaluation for X-Ray Report Generation1 Apr 2024 0 repositories listed
-
SUGAR: Pre-training 3D Visual Representations for Robotics1 Apr 2024 0 repositories listed
-
CRKD: Enhanced Camera-Radar Object Detection with Cross-modality Knowledge Distillation28 Mar 2024 0 repositories listed
-
De-confounded Data-free Knowledge Distillation for Handling Distribution Shifts28 Mar 2024 0 repositories listed
-
28 Mar 2024 0 repositories listed
-
I2CKD : Intra- and Inter-Class Knowledge Distillation for Semantic Segmentation27 Mar 2024 0 repositories listed
-
Enhancing Metaphor Detection through Soft Labels and Target Word Prediction27 Mar 2024 0 repositories listed
-
Order of Compression: A Systematic and Optimal Sequence to Combinationally Compress CNN26 Mar 2024 0 repositories listed
-
Oh! We Freeze: Improving Quantized Knowledge Distillation via Signal Propagation Analysis for Large Language Models26 Mar 2024 0 repositories listed
-
25 Mar 2024 0 repositories listed
-
Configurable Holography: Towards Display and Scene Adaptation24 Mar 2024 0 repositories listed
-
Learning to Project for Cross-Task Knowledge Distillation21 Mar 2024 0 repositories listed
-
TransformMix: Learning Transformation and Mixing Strategies from Data19 Mar 2024 0 repositories listed
-
KnFu: Effective Knowledge Fusion18 Mar 2024 0 repositories listed
-
TTT-KD: Test-Time Training for 3D Semantic Segmentation through Knowledge Distillation from Foundation Models18 Mar 2024 0 repositories listed
-
FlyKD: Graph Knowledge Distillation on the Fly with Curriculum Learning16 Mar 2024 0 repositories listed
-
LookALike: Human Mimicry based collaborative decision making16 Mar 2024 0 repositories listed
-
Group-Mix SAM: Lightweight Solution for Industrial Assembly Line Applications15 Mar 2024 0 repositories listed
-
Adapting OC20-trained EquiformerV2 Models for High-Entropy Materials14 Mar 2024 0 repositories listed
-
Open-Vocabulary Object Detection with Meta Prompt Representation and Instance Contrastive Optimization14 Mar 2024 0 repositories listed
-
Select and Distill: Selective Dual-Teacher Knowledge Transfer for Continual Learning on Vision-Language Models14 Mar 2024 0 repositories listed
-
CoroNetGAN: Controlled Pruning of GANs via Hypernetworks13 Mar 2024 0 repositories listed
-
Distilling Named Entity Recognition Models for Endangered Species from Large Language Models13 Mar 2024 0 repositories listed
-
LIX: Implicitly Infusing Spatial Geometric Prior Knowledge into Visual Semantic Segmentation for Autonomous Driving13 Mar 2024 0 repositories listed
-
Training Self-localization Models for Unseen Unfamiliar Places via Teacher-to-Student Data-Free Knowledge Transfer13 Mar 2024 0 repositories listed
-
Distilling the Knowledge in Data Pruning12 Mar 2024 0 repositories listed
-
Enhanced Sparsification via Stimulative Training11 Mar 2024 0 repositories listed
-
Enhancing Adversarial Training with Prior Knowledge Distillation for Robust Image Compression11 Mar 2024 0 repositories listed
-
Evolving Knowledge Distillation with Large Language Models and Active Learning11 Mar 2024 0 repositories listed
-
One Category One Prompt: Dataset Distillation using Diffusion Models11 Mar 2024 0 repositories listed
-
Attention is all you need for boosting graph convolutional neural network10 Mar 2024 0 repositories listed
-
Knowledge Distillation of Convolutional Neural Networks through Feature Map Transformation using Decision Trees10 Mar 2024 0 repositories listed
-
Adversarial Sparse Teacher: Defense Against Distillation-Based Model Stealing Attacks Using Adversarial Examples8 Mar 2024 0 repositories listed
-
Attention-guided Feature Distillation for Semantic Segmentation8 Mar 2024 0 repositories listed
-
Fine-tuning a Multiple Instance Learning Feature Extractor with Masked Context Modelling and Knowledge Distillation8 Mar 2024 0 repositories listed
-
Scene Graph Aided Radiology Report Generation8 Mar 2024 0 repositories listed
-
Can Small Language Models be Good Reasoners for Sequential Recommendation?7 Mar 2024 0 repositories listed
-
MKF-ADS: Multi-Knowledge Fusion Based Self-supervised Anomaly Detection System for Control Area Network7 Mar 2024 0 repositories listed
-
Privacy-preserving Fine-tuning of Large Language Models through Flatness7 Mar 2024 0 repositories listed
-
Distilled ChatGPT Topic & Sentiment Modeling with Applications in Finance4 Mar 2024 0 repositories listed
-
JEP-KD: Joint-Embedding Predictive Architecture Based Knowledge Distillation for Visual Speech Recognition4 Mar 2024 0 repositories listed
-
UB-FineNet: Urban Building Fine-grained Classification Network for Open-access Satellite Images4 Mar 2024 0 repositories listed
-
A Closer Look at Wav2Vec2 Embeddings for On-Device Single-Channel Speech Enhancement3 Mar 2024 0 repositories listed
-
Hyperspectral Image Analysis in Single-Modal and Multimodal setting using Deep Learning Techniques3 Mar 2024 0 repositories listed
-
Distilling Text Style Transfer With Self-Explanation From LLMs2 Mar 2024 0 repositories listed
-
Teaching MLP More Graph Information: A Three-stage Multitask Knowledge Distillation Framework2 Mar 2024 0 repositories listed
-
Data-efficient Event Camera Pre-training via Disentangled Masked Modeling1 Mar 2024 0 repositories listed
-
Direct Alignment of Draft Model for Speculative Decoding with Chat-Fine-Tuned LLMs29 Feb 2024 0 repositories listed
-
Weakly Supervised Monocular 3D Detection with a Single-View Image29 Feb 2024 0 repositories listed
-
A Lightweight Low-Light Image Enhancement Network via Channel Prior and Gamma Correction28 Feb 2024 0 repositories listed
-
Gradient Reweighting: Towards Imbalanced Class-Incremental Learning28 Feb 2024 0 repositories listed
-
MIKO: Multimodal Intention Knowledge Distillation from Large Language Models for Social-Media Commonsense Discovery28 Feb 2024 0 repositories listed
-
MCF-VC: Mitigate Catastrophic Forgetting in Class-Incremental Learning for Multimodal Video Captioning27 Feb 2024 0 repositories listed
-
SDDGR: Stable Diffusion-based Deep Generative Replay for Class Incremental Object Detection27 Feb 2024 0 repositories listed
-
Structural Teacher-Student Normality Learning for Multi-Class Anomaly Detection and Localization27 Feb 2024 0 repositories listed
-
DTCM: Deep Transformer Capsule Mutual Distillation for Multivariate Time Series Classification26 Feb 2024 0 repositories listed
-
LLM-based Privacy Data Augmentation Guided by Knowledge Distillation with a Distribution Tutor for Medical Text Classification26 Feb 2024 0 repositories listed
-
SKILL: Similarity-aware Knowledge distILLation for Speech Self-Supervised Learning26 Feb 2024 0 repositories listed
-
Distilling Adversarial Robustness Using Heterogeneous Teachers23 Feb 2024 0 repositories listed
-
Enhancing Systematic Decompositional Natural Language Inference Using Informal Logic22 Feb 2024 0 repositories listed
-
Practical Insights into Knowledge Distillation for Pre-Trained Models22 Feb 2024 0 repositories listed
-
Rethinking Invariance Regularization in Adversarial Training to Improve Robustness-Accuracy Trade-off22 Feb 2024 0 repositories listed
-
In-Distribution Consistency Regularization Improves the Generalization of Quantization-Aware Training21 Feb 2024 0 repositories listed
-
Unsupervised Text Style Transfer via LLMs and Attention Masking with Multi-way Interactions21 Feb 2024 0 repositories listed
-
Wisdom of Committee: Distilling from Foundation Model to Specialized Application Model21 Feb 2024 0 repositories listed
-
ELAD: Explanation-Guided Large Language Models Active Distillation20 Feb 2024 0 repositories listed
-
FGAD: Self-boosted Knowledge Distillation for An Effective Federated Graph Anomaly Detection Framework20 Feb 2024 0 repositories listed
-
PIRB: A Comprehensive Benchmark of Polish Dense and Hybrid Text Retrieval Methods20 Feb 2024 0 repositories listed
-
On Good Practices for Task-Specific Distillation of Large Pretrained Visual Models17 Feb 2024 0 repositories listed
-
FedD2S: Personalized Data-Free Federated Knowledge Distillation16 Feb 2024 0 repositories listed
-
Cultural Commonsense Knowledge for Intercultural Dialogues16 Feb 2024 0 repositories listed
-
Model Compression and Efficient Inference for Large Language Models: A Survey15 Feb 2024 0 repositories listed
-
Walsh-domain Neural Network for Power Amplifier Behavioral Modelling and Digital Predistortion15 Feb 2024 0 repositories listed
-
Integrating ChatGPT into Secure Hospital Networks: A Case Study on Improving Radiology Report Analysis14 Feb 2024 0 repositories listed
-
Leveraging Large Language Models for Enhanced NLP Task Performance through Knowledge Distillation and Optimized Training Strategies14 Feb 2024 0 repositories listed
-
APALU: A Trainable, Adaptive Activation Function for Deep Learning Networks13 Feb 2024 0 repositories listed
-
Two-Stage Multi-task Self-Supervised Learning for Medical Image Segmentation11 Feb 2024 0 repositories listed
-
Embedding Compression for Teacher-to-Student Knowledge Transfer9 Feb 2024 0 repositories listed
-
Large Language Model Meets Graph Neural Network in Knowledge Distillation8 Feb 2024 0 repositories listed
-
Knowledge Distillation for Road Detection based on cross-model Semi-Supervised Learning7 Feb 2024 0 repositories listed
-
A Survey on Transformer Compression5 Feb 2024 0 repositories listed
-
5 Feb 2024 0 repositories listed
-
Bi-CryptoNets: Leveraging Different-Level Privacy for Encrypted Inference2 Feb 2024 0 repositories listed
-
Faster Inference of Integer SWIN Transformer by Removing the GELU Activation2 Feb 2024 0 repositories listed
-
Spiking CenterNet: A Distillation-boosted Spiking Neural Network for Object Detection2 Feb 2024 0 repositories listed
-
Addressing Bias Through Ensemble Learning and Regularized Fine-Tuning1 Feb 2024 0 repositories listed
-
Augmenting Offline Reinforcement Learning with State-only Interactions1 Feb 2024 0 repositories listed
-
Dual-Student Knowledge Distillation Networks for Unsupervised Anomaly Detection1 Feb 2024 0 repositories listed
-
EPSD: Early Pruning with Self-Distillation for Efficient Model Compression31 Jan 2024 0 repositories listed