Methods › General › Knowledge Distillation › Knowledge Distillation › Papers, page 9
Knowledge Distillation
Papers archive 2025-07-28
archive papers tagged: 3,071 · with a code link: 1,258 · where Syntology ran a sample: 320 (276 with a run with no instrument failure, 44 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (320 of 3,071 tagged: 276 with a run with no instrument failure, 44 where every run was a failure of Syntology's instrument)
Page 9 of 31: papers 801 to 900 of 3,071, newest first by the archive's date (ties by slug), in archive order.
Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code, as “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. It is per sample and not a correctness claim. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from.
-
Semantic Objective Functions: A distribution-aware method for adding logical constraints in deep learning 3 May 2024 · 0 repositories · arXiv:2405.15789
-
Efficient Compression of Multitask Multilingual Speech Models 2 May 2024 · 0 repositories · arXiv:2405.00966
-
CrossMatch: Enhance Semi-Supervised Medical Image Segmentation with Perturbation Strategies and Knowledge Distillation 1 May 2024 · 1 repository · arXiv:2405.00354
-
Distillation Matters: Empowering Sequential Recommenders to Match the Performance of Large Language Model 1 May 2024 · 1 repository · arXiv:2405.00338Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 3 harvested samples) · 3 pointer-only (licence)
-
Knowledge Distillation vs. Pretraining from Scratch under a Fixed (Computation) Budget 30 Apr 2024 · 0 repositories · arXiv:2404.19319
-
Why does Knowledge Distillation Work? Rethink its Attention and Fidelity Mechanism 30 Apr 2024 · 1 repository · arXiv:2405.00739
-
Control Policy Correction Framework for Reinforcement Learning-based Energy Arbitrage Strategies 29 Apr 2024 · 0 repositories · arXiv:2404.18821
-
Enhancing Action Recognition from Low-Quality Skeleton Data via Part-Level Knowledge Distillation 28 Apr 2024 · 0 repositories · arXiv:2404.18206
-
Retrieval-Oriented Knowledge for Click-Through Rate Prediction 28 Apr 2024 · 1 repository · arXiv:2404.18304
-
Revealing the Two Sides of Data Augmentation: An Asymmetric Distillation-based Win-Win Solution for Open-Set Recognition 28 Apr 2024 · 0 repositories · arXiv:2404.19527
-
Correlation-Decoupled Knowledge Distillation for Multimodal Sentiment Analysis with Incomplete Modalities 25 Apr 2024 · 0 repositories · arXiv:2404.16456
-
Promoting CNNs with Cross-Architecture Knowledge Distillation for Efficient Monocular Depth Estimation 25 Apr 2024 · 0 repositories · arXiv:2404.16386
-
BeSound: Bluetooth-Based Position Estimation Enhancing with Cross-Modality Distillation 24 Apr 2024 · 0 repositories · arXiv:2404.15999
-
Compressed Meta-Optical Encoder for Image Classification 23 Apr 2024 · 0 repositories · arXiv:2406.06534
-
Sentence-Level or Token-Level? A Comprehensive Study on Knowledge Distillation 23 Apr 2024 · 0 repositories · arXiv:2404.14827
-
CKD: Contrastive Knowledge Distillation from A Sample-wise Perspective 22 Apr 2024 · 1 repository · arXiv:2404.14109
-
Distributed Learning for Wi-Fi AP Load Prediction 22 Apr 2024 · 0 repositories · arXiv:2405.05140
-
FedTAD: Topology-aware Data-free Knowledge Distillation for Subgraph Federated Learning 22 Apr 2024 · 0 repositories · arXiv:2404.14061
-
From LLM to NMT: Advancing Low-Resource Machine Translation with Claude 22 Apr 2024 · 0 repositories · arXiv:2404.13813
-
EncodeNet: A Framework for Boosting DNN Accuracy with Entropy-driven Generalized Converting Autoencoder 21 Apr 2024 · 0 repositories · arXiv:2404.13770
-
Dynamic Temperature Knowledge Distillation 19 Apr 2024 · 1 repository · arXiv:2404.12711
-
Unsupervised Domain Adaption Harnessing Vision-Language Pre-training 19 Apr 2024 · 1 repository
-
Data-free Knowledge Distillation for Fine-grained Visual Categorization 18 Apr 2024 · 1 repository · arXiv:2404.12037
-
KDk: A Defense Mechanism Against Label Inference Attacks in Vertical Federated Learning 18 Apr 2024 · 0 repositories · arXiv:2404.12369
-
GhostNetV3: Exploring the Training Strategies for Compact Models 17 Apr 2024 · 1 repository · arXiv:2404.11202Syntology 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples)
-
LAPTOP-Diff: Layer Pruning and Normalized Distillation for Compressing Diffusion Models 17 Apr 2024 · 0 repositories · arXiv:2404.11098
-
Camera clustering for scalable stream-based active distillation 16 Apr 2024 · 1 repository · arXiv:2404.10411
-
MK-SGN: A Spiking Graph Convolutional Network with Multimodal Fusion and Knowledge Distillation for Skeleton-based Action Recognition 16 Apr 2024 · 0 repositories · arXiv:2404.10210
-
AI-KD: Towards Alignment Invariant Face Image Quality Assessment Using Knowledge Distillation 15 Apr 2024 · 1 repository · arXiv:2404.09555
-
Digging into contrastive learning for robust depth estimation with diffusion models 15 Apr 2024 · 1 repository · arXiv:2404.09831Syntology official: harvested, nothing ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 3 harvested samples) · 1 pointer-only (licence)
-
MTKD: Multi-Teacher Knowledge Distillation for Image Super-Resolution 15 Apr 2024 · 0 repositories · arXiv:2404.09571
-
ReffAKD: Resource-efficient Autoencoder-based Knowledge Distillation 15 Apr 2024 · 1 repository · arXiv:2404.09886
-
Weight Copy and Low-Rank Adaptation for Few-Shot Distillation of Vision Transformers 14 Apr 2024 · 1 repository · arXiv:2404.09326
-
Adversarial Robustness of Distilled and Pruned Deep Learning-based Wireless Classifiers 11 Apr 2024 · 0 repositories · arXiv:2404.15344
-
Rethinking Transformer-Based Blind-Spot Network for Self-Supervised Image Denoising 11 Apr 2024 · 1 repository · arXiv:2404.07846Syntology official (archive's flag): 7 ran · 7 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 1 honoured, 0 violated, 4 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 7 harvested samples) · 7 pointer-only (licence)
-
A predictive machine learning force field framework for liquid electrolyte development 10 Apr 2024 · 0 repositories · arXiv:2404.07181
-
CLIP-Embed-KD: Computationally Efficient Knowledge Distillation Using Embeddings as Teachers 9 Apr 2024 · 1 repository · arXiv:2404.06170
-
Improving Facial Landmark Detection Accuracy and Efficiency with Knowledge Distillation 9 Apr 2024 · 0 repositories · arXiv:2404.06029
-
Optimization Methods for Personalizing Large Language Models through Retrieval Augmentation 9 Apr 2024 · 1 repository · arXiv:2404.05970Syntology official (archive's flag): 8 ran · 8 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 5 where Syntology's instrument failed) · 0 unverified (of 8 harvested samples) · 8 pointer-only (licence)
-
Robust feature knowledge distillation for enhanced performance of lightweight crack segmentation models 9 Apr 2024 · 0 repositories · arXiv:2404.06258
-
GHOST: Grounded Human Motion Generation with Open Vocabulary Scene-and-Text Contexts 8 Apr 2024 · 0 repositories · arXiv:2405.18438
-
MonoTAKD: Teaching Assistant Knowledge Distillation for Monocular 3D Object Detection 7 Apr 2024 · 1 repository · arXiv:2404.04910
-
Diffusion Time-step Curriculum for One Image to 3D Generation 6 Apr 2024 · 1 repository · arXiv:2404.04562
-
Do We Really Need a Complex Agent System? Distill Embodied Agent into a Single Model 6 Apr 2024 · 0 repositories · arXiv:2404.04619
-
Can Small Language Models Help Large Language Models Reason Better?: LM-Guided Chain-of-Thought 4 Apr 2024 · 0 repositories · arXiv:2404.03414
-
Goldfish: An Efficient Federated Unlearning Framework 4 Apr 2024 · 1 repository · arXiv:2404.03180
-
Knowledge Distillation-Based Model Extraction Attack using GAN-based Private Counterfactual Explanations 4 Apr 2024 · 1 repository · arXiv:2404.03348
-
Okay, Let's Do This! Modeling Event Coreference with Generated Rationales and Knowledge Distillation 4 Apr 2024 · 1 repository · arXiv:2404.03196Syntology official (archive's flag): 7 ran · 7 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 1 where Syntology's instrument failed) · 5 unverified (of 12 harvested samples) · 12 pointer-only (licence)
-
On the Surprising Efficacy of Distillation as an Alternative to Pre-Training Small Models 4 Apr 2024 · 1 repository · arXiv:2404.03263Syntology official (archive's flag): 4 ran · 4 ran (of which 3 constructed an object rather than computing a result; 4 with no instrument failure: 1 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 4 harvested samples)
-
Adaptive Affinity-Based Generalization For MRI Imaging Segmentation Across Resource-Limited Settings 3 Apr 2024 · 0 repositories · arXiv:2404.02738
-
Foundation Models for Structural Health Monitoring 3 Apr 2024 · 1 repository · arXiv:2404.02944
-
Rethinking Pruning for Vision-Language Models: Strategies for Effective Sparsity and Performance Restoration 3 Apr 2024 · 2 repositories · arXiv:2404.02424
-
Rethinking Kullback-Leibler Divergence in Knowledge Distillation for Large Language Models 3 Apr 2024 · 1 repository · arXiv:2404.02657Syntology official: harvested, nothing ran · 0 ran · 2 unverified (of 2 harvested samples) · 2 pointer-only (licence)
-
Class-Incremental Few-Shot Event Detection 2 Apr 2024 · 0 repositories · arXiv:2404.01767
-
Federated Distillation: A Survey 2 Apr 2024 · 0 repositories · arXiv:2404.08564
-
Pre-trained Vision and Language Transformers Are Few-Shot Incremental Learners 2 Apr 2024 · 1 repository · arXiv:2404.02117Syntology official (archive's flag): 12 ran · 12 ran (of which 0 constructed an object rather than computing a result; 8 with no instrument failure: 0 honoured, 0 violated, 8 with no contract checked; 4 where Syntology's instrument failed) · 2 unverified (of 14 harvested samples) · 1 pointer-only (licence)
-
Task Integration Distillation for Object Detectors 2 Apr 2024 · 0 repositories · arXiv:2404.01699
-
Towards Scalable & Efficient Interaction-Aware Planning in Autonomous Vehicles using Knowledge Distillation 2 Apr 2024 · 0 repositories · arXiv:2404.01746
-
TSCM: A Teacher-Student Model for Vision Place Recognition Using Cross-Metric Knowledge Distillation 2 Apr 2024 · 1 repository · arXiv:2404.01587
-
A Comprehensive Review of Knowledge Distillation in Computer Vision 1 Apr 2024 · 0 repositories · arXiv:2404.00936
-
LLM-RadJudge: Achieving Radiologist-Level Evaluation for X-Ray Report Generation 1 Apr 2024 · 0 repositories · arXiv:2404.00998
-
PDF: A Probability-Driven Framework for Open World 3D Point Cloud Semantic Segmentation 1 Apr 2024 · 1 repository · arXiv:2404.00979
-
SUGAR: Pre-training 3D Visual Representations for Robotics 1 Apr 2024 · 0 repositories · arXiv:2404.01491
-
DMSSN: Distilled Mixed Spectral-Spatial Network for Hyperspectral Salient Object Detection 31 Mar 2024 · 1 repository · arXiv:2404.00694
-
Weak-to-Strong 3D Object Detection with X-Ray Distillation 31 Mar 2024 · 1 repository · arXiv:2404.00679Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)
-
Orchestrate Latent Expertise: Advancing Online Continual Learning with Multi-Level Supervision and Reverse Self-Distillation 30 Mar 2024 · 1 repository · arXiv:2404.00417
-
ECLIPSE: Efficient Continual Learning in Panoptic Segmentation with Visual Prompt Tuning 29 Mar 2024 · 1 repository · arXiv:2403.20126Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 4 harvested samples) · 4 pointer-only (licence)
-
CRKD: Enhanced Camera-Radar Object Detection with Cross-modality Knowledge Distillation 28 Mar 2024 · 0 repositories · arXiv:2403.19104
-
De-confounded Data-free Knowledge Distillation for Handling Distribution Shifts 28 Mar 2024 · 0 repositories · arXiv:2403.19539
-
GOLD: Generalized Knowledge Distillation via Out-of-Distribution-Guided Language Data Generation 28 Mar 2024 · 0 repositories · arXiv:2403.19754
-
I2CKD : Intra- and Inter-Class Knowledge Distillation for Semantic Segmentation 27 Mar 2024 · 0 repositories · arXiv:2403.18490
-
Is Modularity Transferable? A Case Study through the Lens of Knowledge Distillation 27 Mar 2024 · 1 repository · arXiv:2403.18804
-
Enhancing Metaphor Detection through Soft Labels and Target Word Prediction 27 Mar 2024 · 0 repositories · arXiv:2403.18253
-
Order of Compression: A Systematic and Optimal Sequence to Combinationally Compress CNN 26 Mar 2024 · 0 repositories · arXiv:2403.17447
-
Oh! We Freeze: Improving Quantized Knowledge Distillation via Signal Propagation Analysis for Large Language Models 26 Mar 2024 · 0 repositories · arXiv:2403.18159
-
From Two-Stream to One-Stream: Efficient RGB-T Tracking via Mutual Prompt Learning and Knowledge Distillation 25 Mar 2024 · 0 repositories · arXiv:2403.16834
-
SDXS: Real-Time One-Step Latent Diffusion Models with Image Conditions 25 Mar 2024 · 1 repository · arXiv:2403.16627Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples) · 1 pointer-only (licence)
-
Configurable Holography: Towards Display and Scene Adaptation 24 Mar 2024 · 0 repositories · arXiv:2405.01558
-
iDAT: inverse Distillation Adapter-Tuning 23 Mar 2024 · 1 repository · arXiv:2403.15750
-
Learning to Project for Cross-Task Knowledge Distillation 21 Mar 2024 · 0 repositories · arXiv:2403.14494
-
MMIDR: Teaching Large Language Model to Interpret Multimodal Misinformation via Knowledge Distillation 21 Mar 2024 · 1 repository · arXiv:2403.14171
-
Facilitating Pornographic Text Detection for Open-Domain Dialogue Systems via Knowledge Distillation of Large Language Models 20 Mar 2024 · 1 repository · arXiv:2403.13250
-
Instruction Multi-Constraint Molecular Generation Using a Teacher-Student Large Language Model 20 Mar 2024 · 1 repository · arXiv:2403.13244
-
Scale Decoupled Distillation 20 Mar 2024 · 1 repository · arXiv:2403.13512
-
TransformMix: Learning Transformation and Mixing Strategies from Data 19 Mar 2024 · 0 repositories · arXiv:2403.12429
-
HVDistill: Transferring Knowledge from Images to Point Clouds via Unsupervised Hybrid-View Distillation 18 Mar 2024 · 1 repository · arXiv:2403.11817Syntology official (archive's flag): 6 ran · 6 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 1 violated, 5 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 7 harvested samples) · 7 pointer-only (licence)
-
KnFu: Effective Knowledge Fusion 18 Mar 2024 · 0 repositories · arXiv:2403.11892
-
Scheduled Knowledge Acquisition on Lightweight Vector Symbolic Architectures for Brain-Computer Interfaces 18 Mar 2024 · 1 repository · arXiv:2403.13844
-
TTT-KD: Test-Time Training for 3D Semantic Segmentation through Knowledge Distillation from Foundation Models 18 Mar 2024 · 0 repositories · arXiv:2403.11691
-
Multiple Teachers-Meticulous Student: A Domain Adaptive Meta-Knowledge Distillation Model for Medical Image Classification 17 Mar 2024 · 1 repository · arXiv:2403.11226
-
Self-Supervised Quantization-Aware Knowledge Distillation 17 Mar 2024 · 1 repository · arXiv:2403.11106
-
LookALike: Human Mimicry based collaborative decision making 16 Mar 2024 · 0 repositories · arXiv:2403.10824
-
Group-Mix SAM: Lightweight Solution for Industrial Assembly Line Applications 15 Mar 2024 · 0 repositories · arXiv:2403.10053
-
Histo-Genomic Knowledge Distillation For Cancer Prognosis From Histopathology Whole Slide Images 15 Mar 2024 · 1 repository · arXiv:2403.10040
-
Adapting OC20-trained EquiformerV2 Models for High-Entropy Materials 14 Mar 2024 · 0 repositories · arXiv:2403.09811
-
Knowledge Distillation in YOLOX-ViT for Side-Scan Sonar Object Detection 14 Mar 2024 · 1 repository · arXiv:2403.09313
-
MT-PATCHER: Selective and Extendable Knowledge Distillation from Large Language Models for Machine Translation 14 Mar 2024 · 1 repository · arXiv:2403.09522
-
Recurrent Drafter for Fast Speculative Decoding in Large Language Models 14 Mar 2024 · 1 repository · arXiv:2403.09919Syntology official (archive's flag): 9 ran · 9 ran (of which 0 constructed an object rather than computing a result; 9 with no instrument failure: 0 honoured, 0 violated, 9 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 9 harvested samples)
-
Select and Distill: Selective Dual-Teacher Knowledge Transfer for Continual Learning on Vision-Language Models 14 Mar 2024 · 0 repositories · arXiv:2403.09296
-
SpikeReveal: Unlocking Temporal Sequences from Real Blurry Inputs with Spike Streams 14 Mar 2024 · 3 repositories · arXiv:2403.09486Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 3 harvested samples) · 3 pointer-only (licence)