Methods › General › Knowledge Distillation › Knowledge Distillation › Papers, page 13
Knowledge Distillation
Papers archive 2025-07-28
archive papers tagged: 3,071 · with a code link: 1,258 · where Syntology ran a sample: 320 (276 with a run with no instrument failure, 44 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (320 of 3,071 tagged: 276 with a run with no instrument failure, 44 where every run was a failure of Syntology's instrument)
Page 13 of 31: papers 1,201 to 1,300 of 3,071, newest first by the archive's date (ties by slug), in archive order.
Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code, as “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. It is per sample and not a correctness claim. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from.
-
Towards LogiGLUE: A Brief Survey and A Benchmark for Analyzing Logical Reasoning Capabilities of Language Models 2 Oct 2023 · 0 repositories · arXiv:2310.00836
-
Adaptive Decoupled Pose Knowledge Distillation 1 Oct 2023 · 1 repository
-
NAYER: Noisy Layer Data Generation for Efficient and Effective Data-free Knowledge Distillation 30 Sep 2023 · 1 repository · arXiv:2310.00258Syntology official (archive's flag): 7 ran · 7 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 1 where Syntology's instrument failed) · 3 unverified (of 10 harvested samples) · 10 pointer-only (licence)
-
An Enhanced Low-Resolution Image Recognition Method for Traffic Environments 28 Sep 2023 · 0 repositories · arXiv:2309.16390
-
Distilling ODE Solvers of Diffusion Models into Smaller Steps 28 Sep 2023 · 0 repositories · arXiv:2309.16421
-
Cold & Warm Net: Addressing Cold-Start Users in Recommender Systems 27 Sep 2023 · 0 repositories · arXiv:2309.15646
-
DualVC 2: Dynamic Masked Convolution for Unified Streaming and Non-Streaming Voice Conversion 27 Sep 2023 · 0 repositories · arXiv:2309.15496
-
Inherit with Distillation and Evolve with Contrast: Exploring Class Incremental Semantic Segmentation Without Exemplar Memory 27 Sep 2023 · 0 repositories · arXiv:2309.15413
-
VideoAdviser: Video Knowledge Distillation for Multimodal Transfer Learning 27 Sep 2023 · 0 repositories · arXiv:2309.15494
-
ADU-Depth: Attention-based Distillation with Uncertainty Modeling for Depth Estimation 26 Sep 2023 · 0 repositories · arXiv:2309.14744
-
DONNAv2 -- Lightweight Neural Architecture Search for Vision tasks 26 Sep 2023 · 0 repositories · arXiv:2309.14670
-
Event Stream-based Visual Object Tracking: A High-Resolution Benchmark Dataset and A Novel Baseline 26 Sep 2023 · 4 repositories · arXiv:2309.14611Syntology official (archive's flag): 9 ran · 9 ran (of which 0 constructed an object rather than computing a result; 9 with no instrument failure: 1 honoured, 0 violated, 8 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 9 harvested samples) · 9 pointer-only (licence)
-
Learning Using Generated Privileged Information by Text-to-Image Diffusion Models 26 Sep 2023 · 0 repositories · arXiv:2309.15238
-
Noise-Tolerant Few-Shot Unsupervised Adapter for Vision-Language Models 26 Sep 2023 · 0 repositories · arXiv:2309.14928
-
Data Upcycling Knowledge Distillation for Image Super-Resolution 25 Sep 2023 · 1 repository · arXiv:2309.14162
-
DFRD: Data-Free Robustness Distillation for Heterogeneous Federated Learning 24 Sep 2023 · 0 repositories · arXiv:2309.13546
-
Multivariate Prototype Representation for Domain-Generalized Incremental Learning 24 Sep 2023 · 0 repositories · arXiv:2309.13563
-
Poster: Self-Supervised Quantization-Aware Knowledge Distillation 22 Sep 2023 · 0 repositories · arXiv:2309.13220
-
Triple-View Knowledge Distillation for Semi-Supervised Semantic Segmentation 22 Sep 2023 · 0 repositories · arXiv:2309.12557
-
A Sentence Speaks a Thousand Images: Domain Generalization through Distilling CLIP with Language Guidance 21 Sep 2023 · 1 repository · arXiv:2309.12530Syntology official (archive's flag): 14 ran · 14 ran (of which 0 constructed an object rather than computing a result; 14 with no instrument failure: 0 honoured, 0 violated, 14 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 16 harvested samples) · 16 pointer-only (licence)
-
Augmentation-free Dense Contrastive Distillation for Efficient Semantic Segmentation 21 Sep 2023 · 1 repository
-
CL-NeRF: Continual Learning of Neural Radiance Fields for Evolving Scene Representation 21 Sep 2023 · 0 repositories
-
Defending against Data-Free Model Extraction by Distributionally Robust Defensive Training 21 Sep 2023 · 0 repositories
-
Defending against Data-Free Model Extraction by Distributionally Robust Defensive Training 21 Sep 2023 · 0 repositories
-
Diffusion-Based Probabilistic Uncertainty Estimation for Active Domain Adaptation 21 Sep 2023 · 1 repository
-
Empowering Convolutional Neural Nets with MetaSin Activation 21 Sep 2023 · 0 repositories
-
Metis: Understanding and Enhancing In-Network Regular Expressions 21 Sep 2023 · 1 repository
-
Revisit the Power of Vanilla Knowledge Distillation: from Small Scale to Large Scale 21 Sep 2023 · 1 repository
-
Slimmed Asymmetrical Contrastive Learning and Cross Distillation for Lightweight Model Training 21 Sep 2023 · 1 repository
-
STXD: Structural and Temporal Cross-Modal Distillation for Multi-View 3D Object Detection 21 Sep 2023 · 0 repositories
-
TexQ: Zero-shot Network Quantization with Texture Feature Distribution Calibration 21 Sep 2023 · 0 repositories
-
EPTQ: Enhanced Post-Training Quantization via Hessian-guided Network-wise Optimization 20 Sep 2023 · 1 repository · arXiv:2309.11531
-
Language-Oriented Communication with Semantic Coding and Knowledge Distillation for Text-to-Image Generation 20 Sep 2023 · 0 repositories · arXiv:2309.11127
-
Weight Averaging Improves Knowledge Distillation under Domain Shift 20 Sep 2023 · 1 repository · arXiv:2309.11446
-
Incorporating Ultrasound Tongue Images for Audio-Visual Speech Enhancement 19 Sep 2023 · 0 repositories · arXiv:2309.10455
-
DFIL: Deepfake Incremental Learning by Exploiting Domain-invariant Forgery Clues 18 Sep 2023 · 1 repository · arXiv:2309.09526Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 2 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples) · 3 pointer-only (licence)
-
Distilling HuBERT with LSTMs via Decoupled Knowledge Distillation 18 Sep 2023 · 0 repositories · arXiv:2309.09920
-
Facilitating NSFW Text Detection in Open-Domain Dialogue Systems via Knowledge Distillation 18 Sep 2023 · 1 repository · arXiv:2309.09749
-
Heterogeneous Generative Knowledge Distillation with Masked Image Modeling 18 Sep 2023 · 0 repositories · arXiv:2309.09571
-
UNIDEAL: Curriculum Knowledge Distillation Federated Learning 16 Sep 2023 · 0 repositories · arXiv:2309.08961
-
One-Class Knowledge Distillation for Spoofing Speech Detection 15 Sep 2023 · 0 repositories · arXiv:2309.08285
-
Two-Step Knowledge Distillation for Tiny Speech Enhancement 15 Sep 2023 · 0 repositories · arXiv:2309.08144
-
A Novel Local-Global Feature Fusion Framework for Body-weight Exercise Recognition with Pressure Mapping Sensors 14 Sep 2023 · 0 repositories · arXiv:2309.07888
-
CoLLD: Contrastive Layer-to-layer Distillation for Compressing Multilingual Pre-trained Speech Encoders 14 Sep 2023 · 0 repositories · arXiv:2309.07707
-
Continual Learning with Dirichlet Generative-based Rehearsal 13 Sep 2023 · 0 repositories · arXiv:2309.06917
-
Self-Training and Multi-Task Learning for Limited Data: Evaluation Study on Object Detection 12 Sep 2023 · 0 repositories · arXiv:2309.06288
-
DAD++: Improved Data-free Test Time Adversarial Defense 10 Sep 2023 · 2 repositories · arXiv:2309.05132
-
Exploiting CLIP for Zero-shot HOI Detection Requires Knowledge Distillation at Multiple Levels 10 Sep 2023 · 1 repository · arXiv:2309.05069
-
Speech Emotion Recognition with Distilled Prosodic and Linguistic Affect Representations 9 Sep 2023 · 0 repositories · arXiv:2309.04849
-
Decoding visual brain representations from electroencephalography through Knowledge Distillation and latent diffusion models 8 Sep 2023 · 1 repository · arXiv:2309.07149
-
Knowledge Distillation-Empowered Digital Twin for Anomaly Detection 8 Sep 2023 · 0 repositories · arXiv:2309.04616
-
A deep Natural Language Inference predictor without language-specific training data 6 Sep 2023 · 0 repositories · arXiv:2309.02887
-
DMKD: Improving Feature-based Knowledge Distillation for Object Detection Via Dual Masking Augmentation 6 Sep 2023 · 0 repositories · arXiv:2309.02719
-
Knowledge Distillation Layer that Lets the Student Decide 6 Sep 2023 · 1 repository · arXiv:2309.02843
-
Leveraging ASR Pretrained Conformers for Speaker Verification through Transfer Learning and Knowledge Distillation 6 Sep 2023 · 0 repositories · arXiv:2309.03019
-
Rethinking Momentum Knowledge Distillation in Online Continual Learning 6 Sep 2023 · 1 repository · arXiv:2309.02870Syntology official (archive's flag): 1 ran · 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; the one sample that ran constructed an object rather than computing a result (of 1 harvested sample) · 1 pointer-only (licence)
-
Fast and High-Performance Learned Image Compression With Improved Checkerboard Context Model, Deformable Residual Module, and Knowledge Distillation 5 Sep 2023 · 0 repositories · arXiv:2309.02529
-
Prior Knowledge Guided Network for Video Anomaly Detection 4 Sep 2023 · 0 repositories · arXiv:2309.01682
-
COMEDIAN: Self-Supervised Learning and Knowledge Distillation for Action Spotting using Transformers 3 Sep 2023 · 1 repository · arXiv:2309.01270
-
Knowledge distillation for efficient standard scanplane detection of fetal ultrasound 1 Sep 2023 · 0 repositories
-
Adversarial Finetuning with Latent Representation Constraint to Mitigate Accuracy-Robustness Tradeoff 31 Aug 2023 · 0 repositories · arXiv:2308.16454
-
Knowledge Distillation from Non-streaming to Streaming ASR Encoder using Auxiliary Non-streaming Layer 31 Aug 2023 · 0 repositories · arXiv:2308.16415
-
Towards Long-Tailed Recognition for Graph Classification via Collaborative Experts 31 Aug 2023 · 0 repositories · arXiv:2308.16609
-
Exploring Multi-Modal Contextual Knowledge for Open-Vocabulary Object Detection 30 Aug 2023 · 0 repositories · arXiv:2308.15846
-
SpikeBERT: A Language Spikformer Learned from BERT with Knowledge Distillation 29 Aug 2023 · 1 repository · arXiv:2308.15122Syntology official (archive's flag): 8 ran · 8 ran (of which 0 constructed an object rather than computing a result; 8 with no instrument failure: 0 honoured, 0 violated, 8 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 9 harvested samples) · 9 pointer-only (licence)
-
Boosting Residual Networks with Group Knowledge 26 Aug 2023 · 1 repository · arXiv:2308.13772Syntology official (archive's flag): 9 ran · 9 ran (of which 0 constructed an object rather than computing a result; 7 with no instrument failure: 2 honoured, 2 violated, 3 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 9 harvested samples) · 3 pointer-only (licence)
-
DM-VTON: Distilled Mobile Real-time Virtual Try-On 26 Aug 2023 · 1 repository · arXiv:2308.13798
-
Improving Knowledge Distillation for BERT Models: Loss Functions, Mapping Methods, and Weight Tuning 26 Aug 2023 · 0 repositories · arXiv:2308.13958
-
3D Face Alignment Through Fusion of Head Pose Information and Features 25 Aug 2023 · 0 repositories · arXiv:2308.13327
-
REFT: Resource-Efficient Federated Training Framework for Heterogeneous and Resource-Constrained Environments 25 Aug 2023 · 0 repositories · arXiv:2308.13662
-
DLIP: Distilling Language-Image Pre-training 24 Aug 2023 · 0 repositories · arXiv:2308.12956
-
Fall Detection using Knowledge Distillation Based Long short-term memory for Offline Embedded and Low Power Devices 24 Aug 2023 · 0 repositories · arXiv:2308.12481
-
Ground-to-Aerial Person Search: Benchmark Dataset and Approach 24 Aug 2023 · 1 repository · arXiv:2308.12712
-
Sentence Embedding Models for Ancient Greek Using Multilingual Knowledge Distillation 24 Aug 2023 · 2 repositories · arXiv:2308.13116
-
Multimodal Locally Enhanced Transformer for Continuous Sign Language Recognition 22 Aug 2023 · 0 repositories
-
FedDAT: An Approach for Foundation Model Finetuning in Multi-Modal Heterogeneous Federated Learning 21 Aug 2023 · 1 repository · arXiv:2308.12305Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified (of 6 harvested samples)
-
SpikingBERT: Distilling BERT to Train Spiking Language Models Using Implicit Differentiation 21 Aug 2023 · 1 repository · arXiv:2308.10873Syntology official (archive's flag): 13 ran · 13 ran (of which 0 constructed an object rather than computing a result; 8 with no instrument failure: 2 honoured, 0 violated, 6 with no contract checked; 5 where Syntology's instrument failed) · 4 unverified (of 17 harvested samples) · 17 pointer-only (licence)
-
Representation Disparity-aware Distillation for 3D Object Detection 20 Aug 2023 · 0 repositories · arXiv:2308.10308
-
Adapt Your Teacher: Improving Knowledge Distillation for Exemplar-free Continual Learning 18 Aug 2023 · 1 repository · arXiv:2308.09544Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples)
-
CCFace: Classification Consistency for Low-Resolution Face Recognition 18 Aug 2023 · 0 repositories · arXiv:2308.09230
-
Unlimited Knowledge Distillation for Action Recognition in the Dark 18 Aug 2023 · 0 repositories · arXiv:2308.09327
-
Learning Lightweight Object Detectors via Multi-Teacher Progressive Distillation 17 Aug 2023 · 0 repositories · arXiv:2308.09105
-
Radio2Text: Streaming Speech Recognition Using mmWave Radio Signals 16 Aug 2023 · 0 repositories · arXiv:2308.08125
-
SkinDistilViT: Lightweight Vision Transformer for Skin Lesion Classification 16 Aug 2023 · 1 repository · arXiv:2308.08669
-
Distilling Knowledge from Resource Management Algorithms to Neural Networks: A Unified Training Assistance Approach 15 Aug 2023 · 0 repositories · arXiv:2308.07511
-
Token-Scaled Logit Distillation for Ternary Weight Generative Language Models 13 Aug 2023 · 1 repository · arXiv:2308.06744Syntology official (archive's flag): 5 ran · 5 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 5 harvested samples) · 5 pointer-only (licence)
-
Multi-Label Knowledge Distillation 12 Aug 2023 · 1 repository · arXiv:2308.06453Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)
-
Complex Facial Expression Recognition Using Deep Knowledge Distillation of Basic Features 11 Aug 2023 · 1 repository · arXiv:2308.06197
-
Continual Face Forgery Detection via Historical Distribution Preserving 11 Aug 2023 · 0 repositories · arXiv:2308.06217
-
Towards General and Fast Video Derain via Knowledge Distillation 10 Aug 2023 · 0 repositories · arXiv:2308.05346
-
AICSD: Adaptive Inter-Class Similarity Distillation for Semantic Segmentation 8 Aug 2023 · 2 repositories · arXiv:2308.04243
-
Enhancing Adversarial Robustness in Low-Label Regime via Adaptively Weighted Regularization and Knowledge Distillation 8 Aug 2023 · 1 repository · arXiv:2308.04061
-
Teacher-Student Architecture for Knowledge Distillation: A Survey 8 Aug 2023 · 0 repositories · arXiv:2308.04268
-
Adapter-based Selective Knowledge Distillation for Federated Multi-domain Meeting Summarization 7 Aug 2023 · 0 repositories · arXiv:2308.03275
-
Efficient Temporal Sentence Grounding in Videos with Multi-Teacher Knowledge Distillation 7 Aug 2023 · 1 repository · arXiv:2308.03725
-
Few-shot Class-Incremental Semantic Segmentation via Pseudo-Labeling and Knowledge Distillation 5 Aug 2023 · 1 repository · arXiv:2308.02790
-
One-stage Low-resolution Text Recognition with High-resolution Knowledge Transfer 5 Aug 2023 · 1 repository · arXiv:2308.02770
-
Class Incremental Learning with Self-Supervised Pre-Training and Prototype Learning 4 Aug 2023 · 0 repositories · arXiv:2308.02346
-
Scene-aware Human Pose Generation using Transformer 4 Aug 2023 · 0 repositories · arXiv:2308.02177
-
Transferable Graph Structure Learning for Graph-based Traffic Forecasting Across Cities 4 Aug 2023 · 1 repository