Methods › General › Knowledge Distillation › Knowledge Distillation › Papers, page 11
Knowledge Distillation
Papers archive 2025-07-28
archive papers tagged: 3,071 · with a code link: 1,258 · where Syntology ran a sample: 320 (276 with a run with no instrument failure, 44 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (320 of 3,071 tagged: 276 with a run with no instrument failure, 44 where every run was a failure of Syntology's instrument)
Page 11 of 31: papers 1,001 to 1,100 of 3,071, newest first by the archive's date (ties by slug), in archive order.
Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code, as “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. It is per sample and not a correctness claim. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from.
-
Dynamic Transformer Architecture for Continual Learning of Multimodal Tasks 27 Jan 2024 · 0 repositories · arXiv:2401.15275
-
Face to Cartoon Incremental Super-Resolution using Knowledge Distillation 27 Jan 2024 · 0 repositories · arXiv:2401.15366
-
Communication-Efficient Federated Learning through Adaptive Weight Clustering and Server-Side Distillation 25 Jan 2024 · 1 repository · arXiv:2401.14211
-
Self-supervised Video Object Segmentation with Distillation Learning of Deformable Attention 25 Jan 2024 · 0 repositories · arXiv:2401.13937
-
Towards Complementary Knowledge Distillation for Efficient Dense Image Prediction 24 Jan 2024 · 0 repositories · arXiv:2401.13174
-
A Novel Garment Transfer Method Supervised by Distilled Knowledge of Virtual Try-on Model 23 Jan 2024 · 0 repositories · arXiv:2401.12433
-
Contrastive Learning in Distilled Models 23 Jan 2024 · 1 repository · arXiv:2401.12472
-
Knowledge Distillation from Language-Oriented to Emergent Communication for Multi-Agent Remote Control 23 Jan 2024 · 0 repositories · arXiv:2401.12624
-
Keep Decoding Parallel with Effective Knowledge Distillation from Language Models to End-to-end Speech Recognisers 22 Jan 2024 · 0 repositories · arXiv:2401.11700
-
Knowledge Distillation on Spatial-Temporal Graph Convolutional Network for Traffic Prediction 22 Jan 2024 · 0 repositories · arXiv:2401.11798
-
Rethinking Centered Kernel Alignment in Knowledge Distillation 22 Jan 2024 · 1 repository · arXiv:2401.11824Syntology official (archive's flag): 5 ran · 5 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 6 harvested samples) · 6 pointer-only (licence)
-
Robustness to distribution shifts of compressed networks for edge devices 22 Jan 2024 · 0 repositories · arXiv:2401.12014
-
Stereo-Matching Knowledge Distilled Monocular Depth Estimation Filtered by Multiple Disparity Consistency 22 Jan 2024 · 0 repositories · arXiv:2401.12019
-
Zoom-shot: Fast and Efficient Unsupervised Zero-Shot Transfer of CLIP to Vision Encoders with Multimodal Loss 22 Jan 2024 · 0 repositories · arXiv:2401.11633
-
Confidence Preservation Property in Knowledge Distillation Abstractions 21 Jan 2024 · 0 repositories · arXiv:2401.11365
-
Enhancing Scalability in Recommender Systems through Lottery Ticket Hypothesis and Knowledge Distillation-based Neural Network Pruning 19 Jan 2024 · 0 repositories · arXiv:2401.10484
-
Large Language Models are Efficient Learners of Noise-Robust Speech Recognition 19 Jan 2024 · 1 repository · arXiv:2401.10446Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 1 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)
-
Model Compression Techniques in Biometrics Applications: A Survey 18 Jan 2024 · 1 repository · arXiv:2401.10139
-
Bayes Conditional Distribution Estimation for Knowledge Distillation Based on Conditional Mutual Information 16 Jan 2024 · 1 repository · arXiv:2401.08732Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples) · 3 pointer-only (licence)
-
OBSeg: Accurate and Fast Instance Segmentation Framework Using Segmentation Foundation Models with Oriented Bounding Box Prompts 16 Jan 2024 · 1 repository · arXiv:2401.08174
-
Cross-Level Multi-Instance Distillation for Self-Supervised Fine-Grained Visual Categorization 16 Jan 2024 · 0 repositories · arXiv:2401.08860
-
TelME: Teacher-leading Multimodal Fusion Network for Emotion Recognition in Conversation 16 Jan 2024 · 1 repository · arXiv:2401.12987
-
A Deep Hierarchical Feature Sparse Framework for Occluded Person Re-Identification 15 Jan 2024 · 0 repositories · arXiv:2401.07469
-
Lightweight Modality Adaptation to Sequential Recommendation via Correlation Supervision 14 Jan 2024 · 0 repositories · arXiv:2401.07257
-
EVOKE: Emotion Enabled Virtual Avatar Mapping Using Optimized Knowledge Distillation 13 Jan 2024 · 0 repositories · arXiv:2401.06957
-
Knowledge Distillation of Black-Box Large Language Models 13 Jan 2024 · 0 repositories · arXiv:2401.07013
-
An Empirical Investigation into the Effect of Parameter Choices in Knowledge Distillation 12 Jan 2024 · 0 repositories · arXiv:2401.06356
-
Graph Relation Distillation for Efficient Biomedical Instance Segmentation 12 Jan 2024 · 2 repositories · arXiv:2401.06370
-
Attention to detail: inter-resolution knowledge distillation 11 Jan 2024 · 2 repositories · arXiv:2401.06010
-
Object-Centric Diffusion for Efficient Video Editing 11 Jan 2024 · 0 repositories · arXiv:2401.05735
-
Hierarchical Knowledge Distillation on Text Graph for Data-limited Attribute Inference 10 Jan 2024 · 0 repositories · arXiv:2401.06802
-
Translate-Distill: Learning Cross-Language Dense Retrieval by Translation and Distillation 9 Jan 2024 · 1 repository · arXiv:2401.04810Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
Logits Poisoning Attack in Federated Distillation 8 Jan 2024 · 0 repositories · arXiv:2401.03685
-
Multi-Channel Multi-Domain based Knowledge Distillation Algorithm for Sleep Staging with Single-Channel EEG 7 Jan 2024 · 0 repositories · arXiv:2401.03430
-
Progressive Knowledge Distillation Of Stable Diffusion XL Using Layer Level Loss 5 Jan 2024 · 1 repository · arXiv:2401.02677
-
Bridging Modalities: Knowledge Distillation and Masked Training for Translating Multi-Modal Emotion Recognition to Uni-Modal, Speech-Only Emotion Recognition 4 Jan 2024 · 1 repository · arXiv:2401.03000
-
CTC Blank Triggered Dynamic Layer-Skipping for Efficient CTC-based Speech Recognition 4 Jan 2024 · 0 repositories · arXiv:2401.02046
-
Exploring Vacant Classes in Label-Skewed Federated Learning 4 Jan 2024 · 1 repository · arXiv:2401.02329
-
Self-supervised Reflective Learning through Self-distillation and Online Clustering for Speaker Representation Learning 3 Jan 2024 · 0 repositories · arXiv:2401.01473
-
Dual Teacher Knowledge Distillation with Domain Alignment for Face Anti-spoofing 2 Jan 2024 · 0 repositories · arXiv:2401.01102
-
Exploring Hyperspectral Anomaly Detection with Human Vision: A Small Target Aware Detector 2 Jan 2024 · 1 repository · arXiv:2401.01093
-
HAAQI-Net: A Non-intrusive Neural Music Audio Quality Assessment Model for Hearing Aids 2 Jan 2024 · 1 repository · arXiv:2401.01145
-
Query-Based Knowledge Sharing for Open-Vocabulary Multi-Label Classification 2 Jan 2024 · 0 repositories · arXiv:2401.01181
-
Building Vision-Language Models on Solid Foundations with Masked Distillation 1 Jan 2024 · 0 repositories
-
C2KD: Bridging the Modality Gap for Cross-Modal Knowledge Distillation 1 Jan 2024 · 0 repositories
-
CaKDP: Category-aware Knowledge Distillation and Pruning Framework for Lightweight 3D Object Detection 1 Jan 2024 · 1 repository
-
DIOD: Self-Distillation Meets Object Discovery 1 Jan 2024 · 1 repository
-
Curriculum-scheduled Knowledge Distillation from Multiple Pre-trained Teachers for Multi-domain Sequential Recommendation 1 Jan 2024 · 1 repository · arXiv:2401.00797Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)
-
FCS: Feature Calibration and Separation for Non-Exemplar Class Incremental Learning 1 Jan 2024 · 1 repository
-
IQ-VFI: Implicit Quadratic Motion Estimation for Video Frame Interpolation 1 Jan 2024 · 0 repositories
-
KD-DETR: Knowledge Distillation for Detection Transformer with Consistent Distillation Points Sampling 1 Jan 2024 · 0 repositories
-
LiSA: LiDAR Localization with Semantic Awareness 1 Jan 2024 · 1 repository
-
Point Segment and Count: A Generalized Framework for Object Counting 1 Jan 2024 · 1 repository
-
Robust Distillation via Untargeted and Targeted Intermediate Adversarial Samples 1 Jan 2024 · 0 repositories
-
Scaled Decoupled Distillation 1 Jan 2024 · 1 repository
-
SecFormer: Fast and Accurate Privacy-Preserving Inference for Transformer Models via SMPC 1 Jan 2024 · 1 repository · arXiv:2401.00793Syntology official: harvested, nothing ran · 2 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 3 harvested samples) · 3 pointer-only (licence)
-
Uncertainty-Guided Never-Ending Learning to Drive 1 Jan 2024 · 0 repositories
-
VkD: Improving Knowledge Distillation using Orthogonal Projections 1 Jan 2024 · 1 repository
-
Compressing Deep Image Super-resolution Models 31 Dec 2023 · 0 repositories · arXiv:2401.00523
-
ClST: A Convolutional Transformer Framework for Automatic Modulation Recognition by Knowledge Distillation 29 Dec 2023 · 0 repositories · arXiv:2312.17446
-
FerKD: Surgical Label Adaptation for Efficient Distillation 29 Dec 2023 · 1 repository · arXiv:2312.17473Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)
-
FedSDD: Scalable and Diversity-enhanced Distillation for Model Aggregation in Federated Learning 28 Dec 2023 · 0 repositories · arXiv:2312.17029
-
Layer Attack Unlearning: Fast and Accurate Machine Unlearning via Layer Level Attack and Knowledge Distillation 28 Dec 2023 · 0 repositories · arXiv:2312.16823
-
Dynamic Sub-graph Distillation for Robust Semi-supervised Continual Learning 27 Dec 2023 · 1 repository · arXiv:2312.16409
-
Group Multi-View Transformer for 3D Shape Analysis with Spatial Encoding 27 Dec 2023 · 1 repository · arXiv:2312.16477
-
AdapterDistillation: Non-Destructive Task Composition with Knowledge Distillation 26 Dec 2023 · 0 repositories · arXiv:2312.16261
-
Cloud-Device Collaborative Learning for Multimodal Large Language Models 26 Dec 2023 · 0 repositories · arXiv:2312.16279
-
Knowledge Distillation of LLM for Automatic Scoring of Science Education Assessments 26 Dec 2023 · 0 repositories · arXiv:2312.15842
-
Revisiting Knowledge Distillation under Distribution Shift 25 Dec 2023 · 1 repository · arXiv:2312.16242
-
Compressing Image-to-Image Translation GANs Using Local Density Structures on Their Learned Manifold 22 Dec 2023 · 0 repositories · arXiv:2312.14776
-
Less or More From Teacher: Exploiting Trilateral Geometry For Knowledge Distillation 22 Dec 2023 · 0 repositories · arXiv:2312.15112
-
How to Prune Your Language Model: Recovering Accuracy on the "Sparsity May Cry'' Benchmark 21 Dec 2023 · 0 repositories · arXiv:2312.13547
-
TinySAM: Pushing the Envelope for Efficient Segment Anything Model 21 Dec 2023 · 2 repositories · arXiv:2312.13789Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 2 where Syntology's instrument failed) · 4 unverified (of 7 harvested samples) · 6 pointer-only (licence)
-
DSFormer: Effective Compression of Text-Transformers by Dense-Sparse Weight Factorization 20 Dec 2023 · 0 repositories · arXiv:2312.13211
-
Federated Learning with Extremely Noisy Clients via Negative Distillation 20 Dec 2023 · 1 repository · arXiv:2312.12703Syntology official (archive's flag): 14 ran · 14 ran (of which 0 constructed an object rather than computing a result; 9 with no instrument failure: 1 honoured, 0 violated, 8 with no contract checked; 5 where Syntology's instrument failed) · 3 unverified (of 17 harvested samples) · 17 pointer-only (licence)
-
Object Attribute Matters in Visual Question Answering 20 Dec 2023 · 1 repository · arXiv:2401.09442
-
Distilling Autoregressive Models to Obtain High-Performance Non-Autoregressive Solvers for Vehicle Routing Problems with Faster Inference Speed 19 Dec 2023 · 1 repository · arXiv:2312.12469Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 1 unverified (of 3 harvested samples) · 3 pointer-only (licence)
-
Expediting Contrastive Language-Image Pretraining via Self-distilled Encoders 19 Dec 2023 · 0 repositories · arXiv:2312.12659
-
RadOcc: Learning Cross-Modality Occupancy Knowledge through Rendering Assisted Distillation 19 Dec 2023 · 0 repositories · arXiv:2312.11829
-
Decoupled Knowledge with Ensemble Learning for Online Distillation 18 Dec 2023 · 1 repository · arXiv:2312.11218
-
Mixed Distillation Helps Smaller Language Model Better Reasoning 17 Dec 2023 · 0 repositories · arXiv:2312.10730
-
Symmetrical Bidirectional Knowledge Alignment for Zero-Shot Sketch-Based Image Retrieval 16 Dec 2023 · 1 repository · arXiv:2312.10320
-
Faster Diffusion: Rethinking the Role of the Encoder for Diffusion Model Inference 15 Dec 2023 · 1 repository · arXiv:2312.09608Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples)
-
WAVER: Writing-style Agnostic Text-Video Retrieval via Distilling Vision-Language Models Through Open-Vocabulary Knowledge 15 Dec 2023 · 1 repository · arXiv:2312.09507
-
SKDF: A Simple Knowledge Distillation Framework for Distilling Open-Vocabulary Knowledge to Open-world Object Detector 14 Dec 2023 · 1 repository · arXiv:2312.08653
-
CLIP-guided Federated Learning on Heterogeneous and Long-Tailed Data 14 Dec 2023 · 1 repository · arXiv:2312.08648
-
COMBHelper: A Neural Approach to Reduce Search Space for Graph Combinatorial Problems 14 Dec 2023 · 1 repository · arXiv:2312.09086
-
Efficient speech detection in environmental audio using acoustic recognition and knowledge distillation 14 Dec 2023 · 0 repositories · arXiv:2312.09269
-
Generative Model-based Feature Knowledge Distillation for Action Recognition 14 Dec 2023 · 1 repository · arXiv:2312.08644
-
KDAS: Knowledge Distillation via Attention Supervision Framework for Polyp Segmentation 13 Dec 2023 · 2 repositories · arXiv:2312.08555
-
Mutual-Learning Knowledge Distillation for Nighttime UAV Tracking 13 Dec 2023 · 1 repository · arXiv:2312.07884
-
Traffic Signal Control Using Lightweight Transformers: An Offline-to-Online RL Approach 12 Dec 2023 · 1 repository · arXiv:2312.07795
-
A dynamic interactive learning framework for automated 3D medical image segmentation 11 Dec 2023 · 0 repositories · arXiv:2312.06072
-
IL-NeRF: Incremental Learning for Neural Radiance Fields with Camera Pose Alignment 10 Dec 2023 · 0 repositories · arXiv:2312.05748
-
Improving Adversarial Robust Fairness via Anti-Bias Soft Label Distillation 9 Dec 2023 · 1 repository · arXiv:2312.05508
-
Understanding the Effect of Model Compression on Social Bias in Large Language Models 9 Dec 2023 · 1 repository · arXiv:2312.05662
-
PixLore: A Dataset-driven Approach to Rich Image Captioning 8 Dec 2023 · 1 repository · arXiv:2312.05349
-
Augmentation-Free Dense Contrastive Knowledge Distillation for Efficient Semantic Segmentation 7 Dec 2023 · 1 repository · arXiv:2312.04168Syntology official (archive's flag): 1 ran · 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 7 unverified; the one sample that ran constructed an object rather than computing a result (of 8 harvested samples)
-
Combining inherent knowledge of vision-language models with unsupervised domain adaptation through strong-weak guidance 7 Dec 2023 · 1 repository · arXiv:2312.04066
-
KOALA: Empirical Lessons Toward Memory-Efficient and Fast Diffusion Models for Text-to-Image Synthesis 7 Dec 2023 · 0 repositories · arXiv:2312.04005