Methods › General › Knowledge Distillation › Knowledge Distillation › Papers, page 17

Knowledge Distillation

Papers archive 2025-07-28

archive papers tagged: 3,071 · with a code link: 1,258 · where Syntology ran a sample: 320 (276 with a run with no instrument failure, 44 where every run was a failure of Syntology's instrument) Syntology

Show: all tagged papersonly where code ran (320 of 3,071 tagged: 276 with a run with no instrument failure, 44 where every run was a failure of Syntology's instrument)

Page 17 of 31: papers 1,601 to 1,700 of 3,071, newest first by the archive's date (ties by slug), in archive order.

Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code, as “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. It is per sample and not a correctness claim. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from.

• A Knowledge Distillation framework for Multi-Organ Segmentation of Medaka Fish in Tomographic Image
  24 Feb 2023 · 0 repositories · arXiv:2302.12562
• Ensemble knowledge distillation of self-supervised speech models
  24 Feb 2023 · 0 repositories · arXiv:2302.12757
• A framework for benchmarking class-out-of-distribution detection and its application to ImageNet
  23 Feb 2023 · 1 repository · arXiv:2302.11893
  Syntology official (archive's flag): 13 ran · 13 ran (of which 0 constructed an object rather than computing a result; 13 with no instrument failure: 0 honoured, 0 violated, 13 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 15 harvested samples)
• A Neural Span-Based Continual Named Entity Recognition Model
  23 Feb 2023 · 1 repository · arXiv:2302.12200
  Syntology official (archive's flag): 10 ran · 10 ran (of which 0 constructed an object rather than computing a result; 10 with no instrument failure: 0 honoured, 0 violated, 10 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 11 harvested samples)
• Personalized Decentralized Federated Learning with Knowledge Distillation
  23 Feb 2023 · 0 repositories · arXiv:2302.12156
• Teacher Intervention: Improving Convergence of Quantization Aware Training for Ultra-Low Precision Transformers
  23 Feb 2023 · 1 repository · arXiv:2302.11812
  Syntology official: no sample here; runs from other or unrecorded repositories · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
• CEKD: Cross-Modal Edge-Privileged Knowledge Distillation for Semantic Scene Understanding Using Only Thermal Images
  22 Feb 2023 · 1 repository
• Debiased Distillation by Transplanting the Last Layer
  22 Feb 2023 · 0 repositories · arXiv:2302.11187
• Distilling Calibrated Student from an Uncalibrated Teacher
  22 Feb 2023 · 0 repositories · arXiv:2302.11472
• KS-DETR: Knowledge Sharing in Attention Learning for Detection Transformer
  22 Feb 2023 · 1 repository · arXiv:2302.11208
• Two-in-one Knowledge Distillation for Efficient Facial Forgery Detection
  21 Feb 2023 · 0 repositories · arXiv:2302.10437
• Social4Rec: Distilling User Preference from Social Graph for Video Recommendation in Tencent
  20 Feb 2023 · 2 repositories · arXiv:2302.09971
• Fairly Predicting Graft Failure in Liver Transplant for Organ Assigning
  18 Feb 2023 · 0 repositories · arXiv:2302.09400
• RobustDistiller: Compressing Universal Speech Representations for Enhanced Environment Robustness
  18 Feb 2023 · 0 repositories · arXiv:2302.09437
• Explicit and Implicit Knowledge Distillation via Unlabeled Data
  17 Feb 2023 · 0 repositories · arXiv:2302.08771
• Few-shot 3D LiDAR Semantic Segmentation for Autonomous Driving
  17 Feb 2023 · 0 repositories · arXiv:2302.08785
• Cross Modal Distillation for Flood Extent Mapping
  16 Feb 2023 · 0 repositories · arXiv:2302.08180
• Fuzzy Knowledge Distillation from High-Order TSK to Low-Order TSK
  16 Feb 2023 · 0 repositories · arXiv:2302.08038
• Learning From Biased Soft Labels
  16 Feb 2023 · 0 repositories · arXiv:2302.08155
• ST-MFNet Mini: Knowledge Distillation-Driven Frame Interpolation
  16 Feb 2023 · 1 repository · arXiv:2302.08455
• Offline-to-Online Knowledge Distillation for Video Instance Segmentation
  15 Feb 2023 · 0 repositories · arXiv:2302.07516
• Multi-teacher knowledge distillation as an effective method for compressing ensembles of neural networks
  14 Feb 2023 · 2 repositories · arXiv:2302.07215
• Take a Prior from Other Tasks for Severe Blur Removal
  14 Feb 2023 · 0 repositories · arXiv:2302.06898
• CholecTriplet2022: Show me a tool and tell me the triplet -- an endoscopic vision challenge for surgical action triplet detection
  13 Feb 2023 · 2 repositories · arXiv:2302.06294
• Learning from Noisy Crowd Labels with Logics
  13 Feb 2023 · 1 repository · arXiv:2302.06337
• PerAda: Parameter-Efficient Federated Learning Personalization with Generalization Guarantees
  13 Feb 2023 · 1 repository · arXiv:2302.06637
• SCLIFD:Supervised Contrastive Knowledge Distillation for Incremental Fault Diagnosis under Limited Fault Data
  12 Feb 2023 · 0 repositories · arXiv:2302.05929
• Dual Relation Knowledge Distillation for Object Detection
  11 Feb 2023 · 1 repository · arXiv:2302.05637
• Jaccard Metric Losses: Optimizing the Jaccard Index with Soft Labels
  11 Feb 2023 · 2 repositories · arXiv:2302.05666
  Syntology official (archive's flag): 1 ran · 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; the one sample that ran constructed an object rather than computing a result (of 1 harvested sample) · 1 pointer-only (licence)
• Feature Affinity Assisted Knowledge Distillation and Quantization of Deep Neural Networks on Label-Free Data
  10 Feb 2023 · 0 repositories · arXiv:2302.10899
• SOCRATES: Text-based Human Search and Approach using a Robot Dog
  10 Feb 2023 · 0 repositories · arXiv:2302.05324
• Lightweight Transformers for Clinical Natural Language Processing
  9 Feb 2023 · 1 repository · arXiv:2302.04725
• Enhancing Modality-Agnostic Representations via Meta-Learning for Brain Tumor Segmentation
  8 Feb 2023 · 0 repositories · arXiv:2302.04308
• SLaM: Student-Label Mixing for Distillation with Unlabeled Examples
  8 Feb 2023 · 0 repositories · arXiv:2302.03806
• Audio Representation Learning by Distilling Video as Privileged Information
  6 Feb 2023 · 0 repositories · arXiv:2302.02845
• Heterogeneous Federated Knowledge Graph Embedding Learning and Unlearning
  4 Feb 2023 · 0 repositories · arXiv:2302.02069
• Knowledge Distillation in Vision Transformers: A Critical Review
  4 Feb 2023 · 0 repositories · arXiv:2302.02108
• Enhancing Once-For-All: A Study on Parallel Blocks, Skip Connections and Early Exits
  3 Feb 2023 · 0 repositories · arXiv:2302.01888
• Adaptive Search-and-Training for Robust and Efficient Network Pruning
  1 Feb 2023 · 1 repository
• Distill-DBDGAN: Knowledge Distillation and Adversarial Learning Framework for Defocus Blur Detection
  1 Feb 2023 · 1 repository
• Improved Knowledge Distillation for Pre-trained Language Models via Knowledge Selection
  1 Feb 2023 · 0 repositories · arXiv:2302.00444
• Knowledge Distillation on Graphs: A Survey
  1 Feb 2023 · 0 repositories · arXiv:2302.00219
• AMD: Adaptive Masked Distillation for Object Detection
  31 Jan 2023 · 0 repositories · arXiv:2301.13538
• FractalAD: A simple industrial anomaly detection method using fractal anomaly generation and backbone knowledge distillation
  30 Jan 2023 · 1 repository · arXiv:2301.12739
• Knowledge Distillation ≈ Label Smoothing: Fact or Fallacy?
  30 Jan 2023 · 0 repositories · arXiv:2301.12609
• Knowledge Transfer from Pre-trained Language Models to Cif-based Speech Recognizers via Hierarchical Distillation
  30 Jan 2023 · 2 repositories · arXiv:2301.13003
• Few-shot Face Image Translation via GAN Prior Distillation
  28 Jan 2023 · 0 repositories · arXiv:2301.12257
• MVKT-ECG: Efficient Single-lead ECG Classification on Multi-Label Arrhythmia by Multi-View Knowledge Transferring
  28 Jan 2023 · 0 repositories · arXiv:2301.12178
• Can We Use Probing to Better Understand Fine-tuning and Knowledge Distillation of the BERT NLU?
  27 Jan 2023 · 0 repositories · arXiv:2301.11688
• A Simple Recipe for Competitive Low-compute Self supervised Vision Models
  23 Jan 2023 · 0 repositories · arXiv:2301.09451
• Unifying Synergies between Self-supervised Learning and Dynamic Computation
  22 Jan 2023 · 1 repository · arXiv:2301.09164
• ProKD: An Unsupervised Prototypical Knowledge Distillation Network for Zero-Resource Cross-Lingual Named Entity Recognition
  21 Jan 2023 · 0 repositories · arXiv:2301.08855
• The Best of Both Worlds: Accurate Global and Personalized Models through Federated Learning with Data-Free Hyper-Knowledge Distillation
  21 Jan 2023 · 0 repositories · arXiv:2301.08968
• RNAS-CL: Robust Neural Architecture Search by Cross-Layer Knowledge Distillation
  19 Jan 2023 · 0 repositories · arXiv:2301.08092
• Adaptively Integrated Knowledge Distillation and Prediction Uncertainty for Continual Learning
  18 Jan 2023 · 0 repositories · arXiv:2301.07316
• Knowledge Distillation in Federated Edge Learning: A Survey
  14 Jan 2023 · 1 repository · arXiv:2301.05849
• A Cohesive Distillation Architecture for Neural Language Models
  12 Jan 2023 · 0 repositories · arXiv:2301.08130
• CLIP2Scene: Towards Label-efficient 3D Scene Understanding by CLIP
  12 Jan 2023 · 1 repository · arXiv:2301.04926
• Effective Decision Boundary Learning for Class Incremental Learning
  12 Jan 2023 · 0 repositories · arXiv:2301.05180
• Online Hyperparameter Optimization for Class-Incremental Learning
  11 Jan 2023 · 1 repository · arXiv:2301.05032
  Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 3 unverified (of 4 harvested samples)
• Synthetic data generation method for data-free knowledge distillation in regression neural networks
  11 Jan 2023 · 1 repository · arXiv:2301.04338
• ERNIE 3.0 Tiny: Frustratingly Simple Method to Improve Task-Agnostic Distillation Generalization
  9 Jan 2023 · 1 repository · arXiv:2301.03416
  Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 3 harvested samples)
• Designing an Improved Deep Learning-based Model for COVID-19 Recognition in Chest X-ray Images: A Knowledge Distillation Approach
  6 Jan 2023 · 0 repositories · arXiv:2301.02735
• Knowledge-guided Causal Intervention for Weakly-supervised Object Localization
  3 Jan 2023 · 1 repository · arXiv:2301.01060
• RELIANT: Fair Knowledge Distillation for Graph Neural Networks
  3 Jan 2023 · 1 repository · arXiv:2301.01150
  Syntology official: harvested, nothing ran · 0 ran · 1 unverified (of 1 harvested sample) · 1 pointer-only (licence)
• Automated Knowledge Distillation via Monte Carlo Tree Search
  1 Jan 2023 · 0 repositories
• Beyond the Limitation of Monocular 3D Detector via Knowledge Distillation
  1 Jan 2023 · 1 repository
• Bilateral Memory Consolidation for Continual Learning
  1 Jan 2023 · 0 repositories
• Boosting Accuracy and Robustness of Student Models via Adaptive Adversarial Distillation
  1 Jan 2023 · 1 repository
• CaPriDe Learning: Confidential and Private Decentralized Learning Based on Encryption-Friendly Distillation Loss
  1 Jan 2023 · 1 repository
• CLIPPING: Distilling CLIP-Based Models With a Student Base for Video-Language Retrieval
  1 Jan 2023 · 0 repositories
• Data-Free Class-Incremental Hand Gesture Recognition
  1 Jan 2023 · 1 repository
• Data-Free Knowledge Distillation via Feature Exchange and Activation Region Constraint
  1 Jan 2023 · 1 repository
• Distilling Cross-Temporal Contexts for Continuous Sign Language Recognition
  1 Jan 2023 · 0 repositories
• Distilling DETR with Visual-Linguistic Knowledge for Open-Vocabulary Object Detection
  1 Jan 2023 · 1 repository
• Distilling Focal Knowledge From Imperfect Expert for 3D Object Detection
  1 Jan 2023 · 0 repositories
• Dual Learning with Dynamic Knowledge Distillation for Partially Relevant Video Retrieval
  1 Jan 2023 · 1 repository
• FedICT: Federated Multi-task Distillation for Multi-access Edge Computing
  1 Jan 2023 · 1 repository · arXiv:2301.00389
• ICD-Face: Intra-class Compactness Distillation for Face Recognition
  1 Jan 2023 · 0 repositories
• Incrementer: Transformer for Class-Incremental Semantic Segmentation With Knowledge Distillation Focusing on Old Class
  1 Jan 2023 · 0 repositories
• Knowledge-Spreader: Learning Semi-Supervised Facial Action Dynamics by Consistifying Knowledge Granularity
  1 Jan 2023 · 0 repositories
• Label-Guided Knowledge Distillation for Continual Semantic Segmentation on 2D Images and 3D Point Clouds
  1 Jan 2023 · 1 repository
• Masked Autoencoders Are Stronger Knowledge Distillers
  1 Jan 2023 · 0 repositories
• Multi-Level Logit Distillation
  1 Jan 2023 · 1 repository
• Multi-Task Learning with Knowledge Distillation for Dense Prediction
  1 Jan 2023 · 0 repositories
• Open-Set Fine-Grained Retrieval via Prompting Vision-Language Evaluator
  1 Jan 2023 · 0 repositories
• Probabilistic Knowledge Distillation of Face Ensembles
  1 Jan 2023 · 0 repositories
• Remembering Normality: Memory-guided Knowledge Distillation for Unsupervised Anomaly Detection
  1 Jan 2023 · 2 repositories
• Revisiting Prototypical Network for Cross Domain Few-Shot Learning
  1 Jan 2023 · 1 repository
• ScaleKD: Distilling Scale-Aware Knowledge in Small Object Detector
  1 Jan 2023 · 0 repositories
• SMOC-Net: Leveraging Camera Pose for Self-Supervised Monocular Object Pose Estimation
  1 Jan 2023 · 0 repositories
• Tiny Updater: Towards Efficient Neural Network-Driven Software Updating
  1 Jan 2023 · 0 repositories
• TripLe: Revisiting Pretrained Model Reuse and Progressive Learning for Efficient Vision Transformer Scaling and Searching
  1 Jan 2023 · 0 repositories
• UniKD: Universal Knowledge Distillation for Mimicking Homogeneous or Heterogeneous Object Detectors
  1 Jan 2023 · 0 repositories
• X3KD: Knowledge Distillation Across Modalities, Tasks and Stages for Multi-Camera 3D Object Detection
  1 Jan 2023 · 0 repositories
• A Unified Object Counting Network with Object Occupation Prior
  29 Dec 2022 · 1 repository · arXiv:2212.14193
• Discriminator-Cooperated Feature Map Distillation for GAN Compression
  29 Dec 2022 · 1 repository · arXiv:2212.14169
• Resolving Task Confusion in Dynamic Expansion Architectures for Class Incremental Learning
  29 Dec 2022 · 1 repository · arXiv:2212.14284
• NeRN -- Learning Neural Representations for Neural Networks
  27 Dec 2022 · 1 repository · arXiv:2212.13554
  Syntology official (archive's flag): 5 ran · 5 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 6 harvested samples)
• Prototype-guided Cross-task Knowledge Distillation for Large-scale Models
  26 Dec 2022 · 1 repository · arXiv:2212.13180