Methods › General › Knowledge Distillation › Knowledge Distillation › Papers, page 16

Knowledge Distillation

Papers archive 2025-07-28

archive papers tagged: 3,071 · with a code link: 1,258 · where Syntology ran a sample: 320 (276 with a run with no instrument failure, 44 where every run was a failure of Syntology's instrument) Syntology

Show: all tagged papersonly where code ran (320 of 3,071 tagged: 276 with a run with no instrument failure, 44 where every run was a failure of Syntology's instrument)

Page 16 of 31: papers 1,501 to 1,600 of 3,071, newest first by the archive's date (ties by slug), in archive order.

Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code, as “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. It is per sample and not a correctness claim. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from.

• Deep Collective Knowledge Distillation
  18 Apr 2023 · 0 repositories · arXiv:2304.08878
• Always Strengthen Your Strengths: A Drift-Aware Incremental Learning Framework for CTR Prediction
  17 Apr 2023 · 0 repositories · arXiv:2304.09062
• LaSNN: Layer-wise ANN-to-SNN Distillation for Effective and Efficient Training in Deep Spiking Neural Networks
  17 Apr 2023 · 0 repositories · arXiv:2304.09101
• Teacher Network Calibration Improves Cross-Quality Knowledge Distillation
  15 Apr 2023 · 1 repository · arXiv:2304.07593
• Learn What Is Possible, Then Choose What Is Best: Disentangling One-To-Many Relations in Language Through Text-based Games
  14 Apr 2023 · 1 repository · arXiv:2304.07258
• Class-Incremental Learning of Plant and Disease Detection: Growing Branches with Knowledge Distillation
  13 Apr 2023 · 0 repositories · arXiv:2304.06619
• Multi-Mode Online Knowledge Distillation for Self-Supervised Visual Representation Learning
  13 Apr 2023 · 1 repository · arXiv:2304.06461
  Syntology 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; the one sample that ran constructed an object rather than computing a result (of 1 harvested sample)
• Constructing Deep Spiking Neural Networks from Artificial Neural Networks with Knowledge Distillation
  12 Apr 2023 · 0 repositories · arXiv:2304.05627
• SFT-KD-Recon: Learning a Student-friendly Teacher for Knowledge Distillation in Magnetic Resonance Image Reconstruction
  11 Apr 2023 · 1 repository · arXiv:2304.05057
• A Survey on Recent Teacher-student Learning Studies
  10 Apr 2023 · 0 repositories · arXiv:2304.04615
• Grouped Knowledge Distillation for Deep Face Recognition
  10 Apr 2023 · 0 repositories · arXiv:2304.04462
• Homogenizing Non-IID datasets via In-Distribution Knowledge Distillation for Decentralized Learning
  9 Apr 2023 · 0 repositories · arXiv:2304.04326
• Continual Learning for LiDAR Semantic Segmentation: Class-Incremental and Coarse-to-Fine strategies on Sparse Data
  8 Apr 2023 · 1 repository · arXiv:2304.03980
• Model-Agnostic Decentralized Collaborative Learning for On-Device POI Recommendation
  8 Apr 2023 · 0 repositories · arXiv:2304.03947
• Progressive Volume Distillation with Active Learning for Efficient NeRF Architecture Conversion
  8 Apr 2023 · 1 repository · arXiv:2304.04012
• Continual Detection Transformer for Incremental Object Detection
  6 Apr 2023 · 0 repositories · arXiv:2304.03110
• DiGA: Distil to Generalize and then Adapt for Domain Adaptive Semantic Segmentation
  5 Apr 2023 · 1 repository · arXiv:2304.02222
  Syntology official: harvested, nothing ran · 0 ran · 1 unverified (of 1 harvested sample) · 1 pointer-only (licence)
• Self-Distillation for Gaussian Process Regression and Classification
  5 Apr 2023 · 1 repository · arXiv:2304.02641
  Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)
• Towards Efficient Task-Driven Model Reprogramming with Foundation Models
  5 Apr 2023 · 0 repositories · arXiv:2304.02263
• Cross-Class Feature Augmentation for Class Incremental Learning
  4 Apr 2023 · 0 repositories · arXiv:2304.01899
• MadEye: Boosting Live Video Analytics Accuracy with Adaptive Camera Configurations
  4 Apr 2023 · 0 repositories · arXiv:2304.02101
• Knowledge-Distilled Graph Neural Networks for Personalized Epileptic Seizure Detection
  3 Apr 2023 · 0 repositories · arXiv:2304.06038
• Vision-Language Models for Vision Tasks: A Survey
  3 Apr 2023 · 1 repository · arXiv:2304.00685
• A Unified Compression Framework for Efficient Speech-Driven Talking-Face Generation
  2 Apr 2023 · 0 repositories · arXiv:2304.00471
• GVP: Generative Volumetric Primitives
  31 Mar 2023 · 0 repositories · arXiv:2303.18193
• Knowledge Distillation for Feature Extraction in Underwater VSLAM
  31 Mar 2023 · 1 repository · arXiv:2303.17981
• Quick Dense Retrievers Consume KALE: Post Training Kullback Leibler Alignment of Embeddings for Asymmetrical dual encoders
  31 Mar 2023 · 0 repositories · arXiv:2304.01016
• Selective Knowledge Distillation for Non-Autoregressive Neural Machine Translation
  31 Mar 2023 · 0 repositories · arXiv:2303.17910
• If At First You Don't Succeed: Test Time Re-ranking for Zero-shot, Cross-domain Retrieval
  30 Mar 2023 · 0 repositories · arXiv:2303.17703
• KD-DLGAN: Data Limited Image Generation via Knowledge Distillation
  30 Mar 2023 · 0 repositories · arXiv:2303.17158
• Kaizen: Practical Self-supervised Continual Learning with Continual Fine-tuning
  30 Mar 2023 · 1 repository · arXiv:2303.17235
• SimDistill: Simulated Multi-modal Distillation for BEV 3D Object Detection
  29 Mar 2023 · 2 repositories · arXiv:2303.16818
  Syntology official (archive's flag): 10 ran · 10 ran (of which 0 constructed an object rather than computing a result; 10 with no instrument failure: 0 honoured, 0 violated, 10 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 10 harvested samples) · 3 pointer-only (licence)
• Information-Theoretic GAN Compression with Variational Energy-based Model
  28 Mar 2023 · 0 repositories · arXiv:2303.16050
• Projected Latent Distillation for Data-Agnostic Consolidation in Distributed Continual Learning
  28 Mar 2023 · 1 repository · arXiv:2303.15888
• SELF-VS: Self-supervised Encoding Learning For Video Summarization
  28 Mar 2023 · 1 repository · arXiv:2303.15993
• Improving Neural Topic Models with Wasserstein Knowledge Distillation
  27 Mar 2023 · 2 repositories · arXiv:2303.15350
• Mutually-paced Knowledge Distillation for Cross-lingual Temporal Knowledge Graph Reasoning
  27 Mar 2023 · 0 repositories · arXiv:2303.14898
• UniDistill: A Universal Cross-Modality Knowledge Distillation Framework for 3D Object Detection in Bird's-Eye View
  27 Mar 2023 · 1 repository · arXiv:2303.15083
  Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 2 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples)
• Multi-Frame Self-Supervised Depth Estimation with Multi-Scale Feature Fusion in Dynamic Scenes
  26 Mar 2023 · 0 repositories · arXiv:2303.14628
• Preserving Linear Separability in Continual Learning by Backward Feature Projection
  26 Mar 2023 · 1 repository · arXiv:2303.14595
• Multi-view knowledge distillation transformer for human action recognition
  25 Mar 2023 · 0 repositories · arXiv:2303.14358
• Supervised Masked Knowledge Distillation for Few-Shot Transformers
  25 Mar 2023 · 1 repository · arXiv:2303.15466
  Syntology official (archive's flag): 3 ran · 3 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples)
• CCL: Continual Contrastive Learning for LiDAR Place Recognition
  24 Mar 2023 · 1 repository · arXiv:2303.13952
• DyLiN: Making Light Field Networks Dynamic
  24 Mar 2023 · 0 repositories · arXiv:2303.14243
• Exploiting Unlabelled Photos for Stronger Fine-Grained SBIR
  24 Mar 2023 · 0 repositories · arXiv:2303.13779
• From Wide to Deep: Dimension Lifting Network for Parameter-efficient Knowledge Graph Embedding
  22 Mar 2023 · 0 repositories · arXiv:2303.12816
• Assessor-Guided Learning for Continual Environments
  21 Mar 2023 · 1 repository · arXiv:2303.11624
• Heterogeneous-Branch Collaborative Learning for Dialogue Generation
  21 Mar 2023 · 0 repositories · arXiv:2303.11621
• Out of Thin Air: Exploring Data-Free Adversarial Robustness Distillation
  21 Mar 2023 · 0 repositories · arXiv:2303.11611
• MV-MR: multi-views and multi-representations for self-supervised learning and knowledge distillation
  21 Mar 2023 · 1 repository · arXiv:2303.12130
• Understanding the Role of the Projector in Knowledge Distillation
  20 Mar 2023 · 4 repositories · arXiv:2303.11098
• Knowledge Distillation from Multiple Foundation Models for End-to-End Speech Recognition
  20 Mar 2023 · 0 repositories · arXiv:2303.10917
• AdaptGuard: Defending Against Universal Attacks for Model Adaptation
  19 Mar 2023 · 1 repository · arXiv:2303.10594
• An Empirical Study of Pre-trained Language Models in Simple Knowledge Graph Question Answering
  18 Mar 2023 · 1 repository · arXiv:2303.10368
• Channel-Aware Distillation Transformer for Depth Estimation on Nano Drones
  18 Mar 2023 · 1 repository · arXiv:2303.10386
• Crowd Counting with Online Knowledge Learning
  18 Mar 2023 · 0 repositories · arXiv:2303.10318
• Whole-slide-imaging Cancer Metastases Detection and Localization with Limited Tumorous Data
  18 Mar 2023 · 1 repository · arXiv:2303.10342
• Prototype Knowledge Distillation for Medical Segmentation with Missing Modality
  17 Mar 2023 · 1 repository · arXiv:2303.09830
• TeSLA: Test-Time Self-Learning With Automatic Adversarial Augmentation
  17 Mar 2023 · 1 repository · arXiv:2303.09870
  Syntology official (archive's flag): 6 ran · 6 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 2 honoured, 0 violated, 3 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 6 harvested samples) · 2 pointer-only (licence)
• DistillW2V2: A Small and Streaming Wav2vec 2.0 Based ASR Model
  16 Mar 2023 · 0 repositories · arXiv:2303.09278
• Global Knowledge Calibration for Fast Open-Vocabulary Segmentation
  16 Mar 2023 · 1 repository · arXiv:2303.09181
• Knowledge Distillation for Adaptive MRI Prostate Segmentation Based on Limit-Trained Multi-Teacher Models
  16 Mar 2023 · 0 repositories · arXiv:2303.09494
• Neural Architecture Search for Effective Teacher-Student Knowledge Transfer in Language Models
  16 Mar 2023 · 0 repositories · arXiv:2303.09639
• Towards a Smaller Student: Capacity Dynamic Distillation for Efficient Image Retrieval
  16 Mar 2023 · 0 repositories · arXiv:2303.09230
• Graph-less Collaborative Filtering
  15 Mar 2023 · 1 repository · arXiv:2303.08537
• Cross-resolution Face Recognition via Identity-Preserving Network and Knowledge Distillation
  15 Mar 2023 · 0 repositories · arXiv:2303.08665
• Feature-Rich Audio Model Inversion for Data-Free Knowledge Distillation Towards General Sound Classification
  14 Mar 2023 · 0 repositories · arXiv:2303.07643
• MetaMixer: A Regularization Strategy for Online Knowledge Distillation
  14 Mar 2023 · 0 repositories · arXiv:2303.07951
• MobileVOS: Real-Time Video Object Segmentation Contrastive Learning meets Knowledge Distillation
  14 Mar 2023 · 0 repositories · arXiv:2303.07815
• Teacher-Student Knowledge Distillation for Radar Perception on Embedded Accelerators
  14 Mar 2023 · 0 repositories · arXiv:2303.07586
• Continuous sign language recognition based on cross-resolution knowledge distillation
  13 Mar 2023 · 1 repository · arXiv:2303.06820
• SCPNet: Semantic Scene Completion on Point Cloud
  13 Mar 2023 · 1 repository · arXiv:2303.06884
• Extending global-local view alignment for self-supervised learning with remote sensing imagery
  12 Mar 2023 · 1 repository · arXiv:2303.06670
  Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 3 harvested samples)
• Knowledge Distillation for Efficient Sequences of Training Runs
  11 Mar 2023 · 0 repositories · arXiv:2303.06480
• Digital Twin-Assisted Knowledge Distillation Framework for Heterogeneous Federated Learning
  10 Mar 2023 · 0 repositories · arXiv:2303.06155
• Dynamic Y-KD: A Hybrid Approach to Continual Instance Segmentation
  10 Mar 2023 · 0 repositories · arXiv:2303.06015
• FedACK: Federated Adversarial Contrastive Knowledge Distillation for Cross-Lingual and Cross-Model Social Bot Detection
  10 Mar 2023 · 1 repository · arXiv:2303.07113
• Object-Aware Distillation Pyramid for Open-Vocabulary Object Detection
  10 Mar 2023 · 1 repository · arXiv:2303.05892
• Robust Knowledge Distillation from RNN-T Models With Noisy Training Labels Using Full-Sum Loss
  10 Mar 2023 · 0 repositories · arXiv:2303.05958
• Learning the Wrong Lessons: Inserting Trojans During Knowledge Distillation
  9 Mar 2023 · 0 repositories · arXiv:2303.05593
• NIFF: Alleviating Forgetting in Generalized Few-Shot Object Detection via Neural Instance Feature Forging
  9 Mar 2023 · 0 repositories · arXiv:2303.04958
• Enhancing Low-resolution Face Recognition with Feature Similarity Knowledge Distillation
  8 Mar 2023 · 1 repository · arXiv:2303.04681
• Adaptive Knowledge Distillation between Text and Speech Pre-trained Models
  7 Mar 2023 · 0 repositories · arXiv:2303.03600
• Gradient-Guided Knowledge Distillation for Object Detectors
  7 Mar 2023 · 0 repositories · arXiv:2303.04240
• KDSM: An uplift modeling framework based on knowledge distillation and sample matching
  6 Mar 2023 · 0 repositories · arXiv:2303.02980
• Students Parrot Their Teachers: Membership Inference on Model Distillation
  6 Mar 2023 · 0 repositories · arXiv:2303.03446
• Pre-trained Model Representations and their Robustness against Noise for Speech Emotion Analysis
  3 Mar 2023 · 0 repositories · arXiv:2303.03177
• Unsupervised Deep Digital Staining For Microscopic Cell Images Via Knowledge Distillation
  3 Mar 2023 · 0 repositories · arXiv:2303.02057
• X³KD: Knowledge Distillation Across Modalities, Tasks and Stages for Multi-Camera 3D Object Detection
  3 Mar 2023 · 0 repositories · arXiv:2303.02203
• Distillation from Heterogeneous Models for Top-K Recommendation
  2 Mar 2023 · 1 repository · arXiv:2303.01130
• Letz Translate: Low-Resource Machine Translation for Luxembourgish
  2 Mar 2023 · 0 repositories · arXiv:2303.01347
• Towards Activated Muscle Group Estimation in the Wild
  2 Mar 2023 · 1 repository · arXiv:2303.00952
• Weakly-supervised HOI Detection via Prior-guided Bi-level Representation Learning
  2 Mar 2023 · 0 repositories · arXiv:2303.01313
• Generic-to-Specific Distillation of Masked Autoencoders
  28 Feb 2023 · 1 repository · arXiv:2302.14771
• Incremental Learning of Acoustic Scenes and Sound Events
  28 Feb 2023 · 0 repositories · arXiv:2302.14815
• Language-Universal Adapter Learning with Knowledge Distillation for End-to-End Multilingual Speech Recognition
  28 Feb 2023 · 1 repository · arXiv:2303.01249
• Learning to Retain while Acquiring: Combating Distribution-Shift in Adversarial Data-Free Knowledge Distillation
  28 Feb 2023 · 0 repositories · arXiv:2302.14290
• Graph-based Knowledge Distillation: A survey and experimental evaluation
  27 Feb 2023 · 1 repository · arXiv:2302.14643
• OccDepth: A Depth-Aware Method for 3D Semantic Scene Completion
  27 Feb 2023 · 1 repository · arXiv:2302.13540
  Syntology official (archive's flag): 5 ran · 5 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 6 harvested samples) · 2 pointer-only (licence)
• A Light-weight Deep Learning Model for Remote Sensing Image Classification
  25 Feb 2023 · 0 repositories · arXiv:2302.13028