Browse State-of-the-Art › Knowledge Distillation › Papers, page 31

Knowledge Distillation

Papers archive 2025-07-28

archive papers tagged: 4,240 · with a code link: 1,740 · where Syntology ran a sample: 451 (380 with a run with no instrument failure, 71 where every run was a failure of Syntology's instrument) Syntology

Show: all tagged papersonly where code ran (451 of 4,240 tagged: 380 with a run with no instrument failure, 71 where every run was a failure of Syntology's instrument)

Page 31 of 43: papers 3,001 to 3,100 of 4,240, in archive order: by repositories listed in the archive (most first), then newest first, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers that list no repository come after every paper that lists one.

Papers without a page here are shown as plain text. A Syntology line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the figure “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code); hover it for the repositories the samples that ran came from. Abstracts are on each paper's page.

• MobileVOS: Real-Time Video Object Segmentation Contrastive Learning meets Knowledge Distillation
  14 Mar 2023 0 repositories listed
• Teacher-Student Knowledge Distillation for Radar Perception on Embedded Accelerators
  14 Mar 2023 0 repositories listed
• Visual-Policy Learning through Multi-Camera View to Single-Camera View Knowledge Distillation for Robot Manipulation Tasks
  13 Mar 2023 0 repositories listed
• Knowledge Distillation for Efficient Sequences of Training Runs
  11 Mar 2023 0 repositories listed
• Digital Twin-Assisted Knowledge Distillation Framework for Heterogeneous Federated Learning
  10 Mar 2023 0 repositories listed
• Dynamic Y-KD: A Hybrid Approach to Continual Instance Segmentation
  10 Mar 2023 0 repositories listed
• Robust Knowledge Distillation from RNN-T Models With Noisy Training Labels Using Full-Sum Loss
  10 Mar 2023 0 repositories listed
• Learning the Wrong Lessons: Inserting Trojans During Knowledge Distillation
  9 Mar 2023 0 repositories listed
• NIFF: Alleviating Forgetting in Generalized Few-Shot Object Detection via Neural Instance Feature Forging
  9 Mar 2023 0 repositories listed
• Adaptive Knowledge Distillation between Text and Speech Pre-trained Models
  7 Mar 2023 0 repositories listed
• Gradient-Guided Knowledge Distillation for Object Detectors
  7 Mar 2023 0 repositories listed
• KDSM: An uplift modeling framework based on knowledge distillation and sample matching
  6 Mar 2023 0 repositories listed
• Students Parrot Their Teachers: Membership Inference on Model Distillation
  6 Mar 2023 0 repositories listed
• IKD+: Reliable Low Complexity Deep Models For Retinopathy Classification
  4 Mar 2023 0 repositories listed
• Pre-trained Model Representations and their Robustness against Noise for Speech Emotion Analysis
  3 Mar 2023 0 repositories listed
• Unsupervised Deep Digital Staining For Microscopic Cell Images Via Knowledge Distillation
  3 Mar 2023 0 repositories listed
• X³KD: Knowledge Distillation Across Modalities, Tasks and Stages for Multi-Camera 3D Object Detection
  3 Mar 2023 0 repositories listed
• Distilling Multi-Level X-vector Knowledge for Small-footprint Speaker Verification
  2 Mar 2023 0 repositories listed
• Letz Translate: Low-Resource Machine Translation for Luxembourgish
  2 Mar 2023 0 repositories listed
• Weakly-supervised HOI Detection via Prior-guided Bi-level Representation Learning
  2 Mar 2023 0 repositories listed
• Distilled Reverse Attention Network for Open-world Compositional Zero-Shot Learning
  1 Mar 2023 0 repositories listed
• Towards domain generalisation in ASR with elitist sampling and ensemble knowledge distillation
  1 Mar 2023 0 repositories listed
• Incremental Learning of Acoustic Scenes and Sound Events
  28 Feb 2023 0 repositories listed
• Learning to Retain while Acquiring: Combating Distribution-Shift in Adversarial Data-Free Knowledge Distillation
  28 Feb 2023 0 repositories listed
• Leveraging Angular Distributions for Improved Knowledge Distillation
  27 Feb 2023 0 repositories listed
• A Light-weight Deep Learning Model for Remote Sensing Image Classification
  25 Feb 2023 0 repositories listed
• A Knowledge Distillation framework for Multi-Organ Segmentation of Medaka Fish in Tomographic Image
  24 Feb 2023 0 repositories listed
• Ensemble knowledge distillation of self-supervised speech models
  24 Feb 2023 0 repositories listed
• Personalized Decentralized Federated Learning with Knowledge Distillation
  23 Feb 2023 0 repositories listed
• Practical Knowledge Distillation: Using DNNs to Beat DNNs
  23 Feb 2023 0 repositories listed
• Debiased Distillation by Transplanting the Last Layer
  22 Feb 2023 0 repositories listed
• Distilling Calibrated Student from an Uncalibrated Teacher
  22 Feb 2023 0 repositories listed
• The Role of Masking for Efficient Supervised Knowledge Distillation of Vision Transformers
  21 Feb 2023 0 repositories listed
• Two-in-one Knowledge Distillation for Efficient Facial Forgery Detection
  21 Feb 2023 0 repositories listed
• HomoDistil: Homotopic Task-Agnostic Distillation of Pre-trained Transformers
  19 Feb 2023 0 repositories listed
• Fairly Predicting Graft Failure in Liver Transplant for Organ Assigning
  18 Feb 2023 0 repositories listed
• RobustDistiller: Compressing Universal Speech Representations for Enhanced Environment Robustness
  18 Feb 2023 0 repositories listed
• Explicit and Implicit Knowledge Distillation via Unlabeled Data
  17 Feb 2023 0 repositories listed
• Few-shot 3D LiDAR Semantic Segmentation for Autonomous Driving
  17 Feb 2023 0 repositories listed
• Cross Modal Distillation for Flood Extent Mapping
  16 Feb 2023 0 repositories listed
• Fuzzy Knowledge Distillation from High-Order TSK to Low-Order TSK
  16 Feb 2023 0 repositories listed
• LEALLA: Learning Lightweight Language-agnostic Sentence Embeddings with Knowledge Distillation
  16 Feb 2023 0 repositories listed
• Learning From Biased Soft Labels
  16 Feb 2023 0 repositories listed
• A lightweight network for photovoltaic cell defect detection in electroluminescence images based on neural architecture search and knowledge distillation
  15 Feb 2023 0 repositories listed
• Offline-to-Online Knowledge Distillation for Video Instance Segmentation
  15 Feb 2023 0 repositories listed
• Take a Prior from Other Tasks for Severe Blur Removal
  14 Feb 2023 0 repositories listed
• NYCU-TWO at Memotion 3: Good Foundation, Good Teacher, then you have Good Meme Analysis
  13 Feb 2023 0 repositories listed
• SCLIFD:Supervised Contrastive Knowledge Distillation for Incremental Fault Diagnosis under Limited Fault Data
  12 Feb 2023 0 repositories listed
• Feature Affinity Assisted Knowledge Distillation and Quantization of Deep Neural Networks on Label-Free Data
  10 Feb 2023 0 repositories listed
• SOCRATES: Text-based Human Search and Approach using a Robot Dog
  10 Feb 2023 0 repositories listed
• An Empirical Study of Uniform-Architecture Knowledge Distillation in Document Ranking
  8 Feb 2023 0 repositories listed
• Enhancing Modality-Agnostic Representations via Meta-Learning for Brain Tumor Segmentation
  8 Feb 2023 0 repositories listed
• Knowledge Distillation-based Information Sharing for Online Process Monitoring in Decentralized Manufacturing System
  8 Feb 2023 0 repositories listed
• SLaM: Student-Label Mixing for Distillation with Unlabeled Examples
  8 Feb 2023 0 repositories listed
• Audio Representation Learning by Distilling Video as Privileged Information
  6 Feb 2023 0 repositories listed
• Heterogeneous Federated Knowledge Graph Embedding Learning and Unlearning
  4 Feb 2023 0 repositories listed
• Knowledge Distillation in Vision Transformers: A Critical Review
  4 Feb 2023 0 repositories listed
• Enhancing Once-For-All: A Study on Parallel Blocks, Skip Connections and Early Exits
  3 Feb 2023 0 repositories listed
• Generalized Uncertainty of Deep Neural Networks: Taxonomy and Applications
  2 Feb 2023 0 repositories listed
• Continual Segment: Towards a Single, Unified and Accessible Continual Segmentation Model of 143 Whole-body Organs in CT Scans
  1 Feb 2023 0 repositories listed
• Improved Knowledge Distillation for Pre-trained Language Models via Knowledge Selection
  1 Feb 2023 0 repositories listed
• Knowledge Distillation on Graphs: A Survey
  1 Feb 2023 0 repositories listed
• AMD: Adaptive Masked Distillation for Object Detection
  31 Jan 2023 0 repositories listed
• Knowledge Distillation ≈ Label Smoothing: Fact or Fallacy?
  30 Jan 2023 0 repositories listed
• On student-teacher deviations in distillation: does it pay to disobey?
  30 Jan 2023 0 repositories listed
• Few-shot Face Image Translation via GAN Prior Distillation
  28 Jan 2023 0 repositories listed
• MVKT-ECG: Efficient Single-lead ECG Classification on Multi-Label Arrhythmia by Multi-View Knowledge Transferring
  28 Jan 2023 0 repositories listed
• Supervision Complexity and its Role in Knowledge Distillation
  28 Jan 2023 0 repositories listed
• Can We Use Probing to Better Understand Fine-tuning and Knowledge Distillation of the BERT NLU?
  27 Jan 2023 0 repositories listed
• EmbedDistill: A Geometric Knowledge Distillation for Information Retrieval
  27 Jan 2023 0 repositories listed
• Improved knowledge distillation by utilizing backward pass knowledge in neural networks
  27 Jan 2023 0 repositories listed
• Improving Text-based Early Prediction by Distillation from Privileged Time-Series Text
  26 Jan 2023 0 repositories listed
• A Simple Recipe for Competitive Low-compute Self supervised Vision Models
  23 Jan 2023 0 repositories listed
• ProKD: An Unsupervised Prototypical Knowledge Distillation Network for Zero-Resource Cross-Lingual Named Entity Recognition
  21 Jan 2023 0 repositories listed
• The Best of Both Worlds: Accurate Global and Personalized Models through Federated Learning with Data-Free Hyper-Knowledge Distillation
  21 Jan 2023 0 repositories listed
• RNAS-CL: Robust Neural Architecture Search by Cross-Layer Knowledge Distillation
  19 Jan 2023 0 repositories listed
• Adaptively Integrated Knowledge Distillation and Prediction Uncertainty for Continual Learning
  18 Jan 2023 0 repositories listed
• A Cohesive Distillation Architecture for Neural Language Models
  12 Jan 2023 0 repositories listed
• Effective Decision Boundary Learning for Class Incremental Learning
  12 Jan 2023 0 repositories listed
• Designing an Improved Deep Learning-based Model for COVID-19 Recognition in Chest X-ray Images: A Knowledge Distillation Approach
  6 Jan 2023 0 repositories listed
• Active Exploration of Multimodal Complementarity for Few-Shot Action Recognition
  1 Jan 2023 0 repositories listed
• Alleviating Catastrophic Forgetting of Incremental Object Detection via Within-Class and Between-Class Knowledge Distillation
  1 Jan 2023 0 repositories listed
• Automated Knowledge Distillation via Monte Carlo Tree Search
  1 Jan 2023 0 repositories listed
• Bilateral Memory Consolidation for Continual Learning
  1 Jan 2023 0 repositories listed
• CLIPPING: Distilling CLIP-Based Models With a Student Base for Video-Language Retrieval
  1 Jan 2023 0 repositories listed
• Continual Segment: Towards a Single, Unified and Non-forgetting Continual Segmentation Model of 143 Whole-body Organs in CT Scans
  1 Jan 2023 0 repositories listed
• DaFKD: Domain-Aware Federated Knowledge Distillation
  1 Jan 2023 0 repositories listed
• Distilling Cross-Temporal Contexts for Continuous Sign Language Recognition
  1 Jan 2023 0 repositories listed
• Distilling Focal Knowledge From Imperfect Expert for 3D Object Detection
  1 Jan 2023 0 repositories listed
• Endpoints Weight Fusion for Class Incremental Semantic Segmentation
  1 Jan 2023 0 repositories listed
• ICD-Face: Intra-class Compactness Distillation for Face Recognition
  1 Jan 2023 0 repositories listed
• Incrementer: Transformer for Class-Incremental Semantic Segmentation With Knowledge Distillation Focusing on Old Class
  1 Jan 2023 0 repositories listed
• Knowledge-Spreader: Learning Semi-Supervised Facial Action Dynamics by Consistifying Knowledge Granularity
  1 Jan 2023 0 repositories listed
• Masked Autoencoders Are Stronger Knowledge Distillers
  1 Jan 2023 0 repositories listed
• MEDIC: Remove Model Backdoors via Importance Driven Cloning
  1 Jan 2023 0 repositories listed
• Multi-Task Learning with Knowledge Distillation for Dense Prediction
  1 Jan 2023 0 repositories listed
• Open-Set Fine-Grained Retrieval via Prompting Vision-Language Evaluator
  1 Jan 2023 0 repositories listed
• Probabilistic Knowledge Distillation of Face Ensembles
  1 Jan 2023 0 repositories listed
• Rethinking Feature-Based Knowledge Distillation for Face Recognition
  1 Jan 2023 0 repositories listed
• ScaleKD: Distilling Scale-Aware Knowledge in Small Object Detector
  1 Jan 2023 0 repositories listed