Browse State-of-the-Art › Knowledge Distillation › Papers, page 32

Knowledge Distillation

Papers archive 2025-07-28

archive papers tagged: 4,240 · with a code link: 1,740 · where Syntology ran a sample: 451 (380 with a run with no instrument failure, 71 where every run was a failure of Syntology's instrument) Syntology

Show: all tagged papersonly where code ran (451 of 4,240 tagged: 380 with a run with no instrument failure, 71 where every run was a failure of Syntology's instrument)

Page 32 of 43: papers 3,101 to 3,200 of 4,240, in archive order: by repositories listed in the archive (most first), then newest first, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers that list no repository come after every paper that lists one.

Papers without a page here are shown as plain text. A Syntology line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the figure “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code); hover it for the repositories the samples that ran came from. Abstracts are on each paper's page.

• SMOC-Net: Leveraging Camera Pose for Self-Supervised Monocular Object Pose Estimation
  1 Jan 2023 0 repositories listed
• Tiny Updater: Towards Efficient Neural Network-Driven Software Updating
  1 Jan 2023 0 repositories listed
• TripLe: Revisiting Pretrained Model Reuse and Progressive Learning for Efficient Vision Transformer Scaling and Searching
  1 Jan 2023 0 repositories listed
• UniKD: Universal Knowledge Distillation for Mimicking Homogeneous or Heterogeneous Object Detectors
  1 Jan 2023 0 repositories listed
• X3KD: Knowledge Distillation Across Modalities, Tasks and Stages for Multi-Camera 3D Object Detection
  1 Jan 2023 0 repositories listed
• You Do Not Need Additional Priors or Regularizers in Retinex-Based Low-Light Image Enhancement
  1 Jan 2023 0 repositories listed
• BD-KD: Balancing the Divergences for Online Knowledge Distillation
  25 Dec 2022 0 repositories listed
• CAMeMBERT: Cascading Assistant-Mediated Multilingual BERT
  22 Dec 2022 0 repositories listed
• Adam: Dense Retrieval Distillation with Adaptive Dark Examples
  20 Dec 2022 0 repositories listed
• Diffusion Glancing Transformer for Parallel Sequence to Sequence Learning
  20 Dec 2022 0 repositories listed
• Fine-Grained Distillation for Long Document Retrieval
  20 Dec 2022 0 repositories listed
• I2D2: Inductive Knowledge Distillation with NeuroLogic and Self-Imitation
  19 Dec 2022 0 repositories listed
• KNIFE: Distilling Reasoning Knowledge From Free-Text Rationales
  19 Dec 2022 0 repositories listed
• Multi-View Knowledge Distillation from Crowd Annotations for Out-of-Domain Generalization
  19 Dec 2022 0 repositories listed
• 3D Point Cloud Pre-training with Knowledge Distillation from 2D Images
  17 Dec 2022 0 repositories listed
• Swing Distillation: A Privacy-Preserving Knowledge Distillation Framework
  16 Dec 2022 0 repositories listed
• Teaching Small Language Models to Reason
  16 Dec 2022 0 repositories listed
• Hybrid Paradigm-based Brain-Computer Interface for Robotic Arm Control
  14 Dec 2022 0 repositories listed
• Domain Adaptation for Dense Retrieval through Self-Supervision by Pseudo-Relevance Labeling
  13 Dec 2022 0 repositories listed
• Continuation KD: Improved Knowledge Distillation through the Lens of Continuation Optimization
  12 Dec 2022 0 repositories listed
• Improving Generalization of Pre-trained Language Models via Stochastic Weight Averaging
  12 Dec 2022 0 repositories listed
• Multimodal Matching-aware Co-attention Networks with Mutual Knowledge Distillation for Fake News Detection
  12 Dec 2022 0 repositories listed
• Siamese Sleep Transformer For Robust Sleep Stage Scoring With Self-knowledge Distillation and Selective Batch Sampling
  12 Dec 2022 0 repositories listed
• Teaching What You Should Teach: A Data-Based Distillation Method
  11 Dec 2022 0 repositories listed
• Multi-adversarial Faster-RCNN with Paradigm Teacher for Unrestricted Object Detection
  11 Dec 2022 0 repositories listed
• Complete-to-Partial 4D Distillation for Self-Supervised Point Cloud Sequence Representation Learning
  10 Dec 2022 0 repositories listed
• Knowledge Distillation Applied to Optical Channel Equalization: Solving the Parallelization Problem of Recurrent Connection
  8 Dec 2022 0 repositories listed
• Occlusion-Robust FAU Recognition by Mining Latent Space of Masked Autoencoders
  8 Dec 2022 0 repositories listed
• Leveraging Different Learning Styles for Improved Knowledge Distillation in Biomedical Imaging
  6 Dec 2022 0 repositories listed
• Life-long Learning for Multilingual Neural Machine Translation with Knowledge Distillation
  6 Dec 2022 0 repositories listed
• Open World DETR: Transformer based Open World Object Detection
  6 Dec 2022 0 repositories listed
• DA-CIL: Towards Domain Adaptive Class-Incremental 3D Object Detection
  5 Dec 2022 0 repositories listed
• Single image calibration using knowledge distillation approaches
  5 Dec 2022 0 repositories listed
• The RoyalFlush System for the WMT 2022 Efficiency Task
  3 Dec 2022 0 repositories listed
• Injecting Spatial Information for Monaural Speech Enhancement via Knowledge Distillation
  2 Dec 2022 0 repositories listed
• StructVPR: Distill Structural Knowledge with Weighting Samples for Visual Place Recognition
  2 Dec 2022 0 repositories listed
• Attention-Based Depth Distillation with 3D-Aware Positional Encoding for Monocular 3D Object Detection
  30 Nov 2022 0 repositories listed
• Coordinating Cross-modal Distillation for Molecular Property Prediction
  30 Nov 2022 0 repositories listed
• Explicit Knowledge Transfer for Weakly-Supervised Code Generation
  30 Nov 2022 0 repositories listed
• HEAT: Hardware-Efficient Automatic Tensor Decomposition for Transformer Compression
  30 Nov 2022 0 repositories listed
• Hint-dynamic Knowledge Distillation
  30 Nov 2022 0 repositories listed
• Random Copolymer inverse design system orienting on Accurate discovering of Antimicrobial peptide-mimetic copolymers
  30 Nov 2022 0 repositories listed
• Feature-domain Adaptive Contrastive Distillation for Efficient Single Image Super-Resolution
  29 Nov 2022 0 repositories listed
• BJTU-WeChat's Systems for the WMT22 Chat Translation Task
  28 Nov 2022 0 repositories listed
• Inter-KD: Intermediate Knowledge Distillation for CTC-Based Automatic Speech Recognition
  28 Nov 2022 0 repositories listed
• Class-aware Information for Logit-based Knowledge Distillation
  27 Nov 2022 0 repositories listed
• EPIK: Eliminating multi-model Pipelines with Knowledge-distillation
  27 Nov 2022 0 repositories listed
• SKDBERT: Compressing BERT via Stochastic Knowledge Distillation
  26 Nov 2022 0 repositories listed
• Structural Knowledge Distillation for Object Detection
  23 Nov 2022 0 repositories listed
• AI-KD: Adversarial learning and Implicit regularization for self-Knowledge Distillation
  20 Nov 2022 0 repositories listed
• Scalable Collaborative Learning via Representation Sharing
  20 Nov 2022 0 repositories listed
• DASECount: Domain-Agnostic Sample-Efficient Wireless Indoor Crowd Counting via Few-shot Learning
  18 Nov 2022 0 repositories listed
• D³ETR: Decoder Distillation for Detection Transformer
  17 Nov 2022 0 repositories listed
• DETRDistill: A Universal Knowledge Distillation Framework for DETR-families
  17 Nov 2022 0 repositories listed
• Knowledge distillation for fast and accurate DNA sequence correction
  17 Nov 2022 0 repositories listed
• Sub-Graph Learning for Spatiotemporal Forecasting via Knowledge Distillation
  17 Nov 2022 0 repositories listed
• Yield Evaluation of Citrus Fruits based on the YoloV5 compressed by Knowledge Distillation
  16 Nov 2022 0 repositories listed
• An Efficient Active Learning Pipeline for Legal Text Classification
  15 Nov 2022 0 repositories listed
• Instance-aware Model Ensemble With Distillation For Unsupervised Domain Adaptation
  15 Nov 2022 0 repositories listed
• An Interpretable Neuron Embedding for Static Knowledge Distillation
  14 Nov 2022 0 repositories listed
• Feature Correlation-guided Knowledge Transfer for Federated Self-supervised Learning
  14 Nov 2022 0 repositories listed
• Structured Knowledge Distillation Towards Efficient and Compact Multi-View 3D Detection
  14 Nov 2022 0 repositories listed
• Long-Range Zero-Shot Generative Deep Network Quantization
  13 Nov 2022 0 repositories listed
• FAN-Trans: Online Knowledge Distillation for Facial Action Unit Detection
  11 Nov 2022 0 repositories listed
• PILE: Pairwise Iterative Logits Ensemble for Multi-Teacher Labeled Distillation
  11 Nov 2022 0 repositories listed
• Knowledge Distillation for Federated Learning: a Practical Guide
  9 Nov 2022 0 repositories listed
• Bridging Fairness and Environmental Sustainability in Natural Language Processing
  8 Nov 2022 0 repositories listed
• Closing the Gap between Client and Global Model Performance in Heterogeneous Federated Learning
  7 Nov 2022 0 repositories listed
• Peak-First CTC: Reducing the Peak Latency of CTC Models by Applying Peak-First Regularization
  7 Nov 2022 0 repositories listed
• Breaking the trade-off in personalized speech enhancement with cross-task knowledge distillation
  5 Nov 2022 0 repositories listed
• LightVessel: Exploring Lightweight Coronary Artery Vessel Segmentation via Similarity Knowledge Distillation
  2 Nov 2022 0 repositories listed
• Multi-level Distillation of Semantic Knowledge for Pre-training Multilingual Language Model
  2 Nov 2022 0 repositories listed
• ARDIR: Improving Robustness using Knowledge Distillation of Internal Representation
  1 Nov 2022 0 repositories listed
• Enhancing Chinese Multi-Label Text Classification Performance with Response-based Knowledge Distillation
  1 Nov 2022 0 repositories listed
• Lightweight Sound Event Detection Model with RepVGG Architecture
  1 Nov 2022 0 repositories listed
• Maximum Likelihood Distillation for Robust Modulation Classification
  1 Nov 2022 0 repositories listed
• Generative Negative Text Replay for Continual Vision-Language Pretraining
  31 Oct 2022 0 repositories listed
• Lightweight Neural Network with Knowledge Distillation for CSI Feedback
  31 Oct 2022 0 repositories listed
• Application of Knowledge Distillation to Multi-task Speech Representation Learning
  29 Oct 2022 0 repositories listed
• Can Current Explainability Help Provide References in Clinical Notes to Support Humans Annotate Medical Codes?
  28 Oct 2022 0 repositories listed
• Completely Heterogeneous Federated Learning
  28 Oct 2022 0 repositories listed
• Semi-UFormer: Semi-supervised Uncertainty-aware Transformer for Image Dehazing
  28 Oct 2022 0 repositories listed
• Teacher-Student Architecture for Knowledge Learning: A Survey
  28 Oct 2022 0 repositories listed
• Collaborative Multi-Teacher Knowledge Distillation for Learning Low Bit-width Deep Neural Networks
  27 Oct 2022 0 repositories listed
• Li3DeTr: A LiDAR based 3D Detection Transformer
  27 Oct 2022 0 repositories listed
• QUILL: Query Intent with Large Language Models using Retrieval Augmentation and Multi-stage Distillation
  27 Oct 2022 0 repositories listed
• Weight Averaging: A Simple Yet Effective Method to Overcome Catastrophic Forgetting in Automatic Speech Recognition
  27 Oct 2022 0 repositories listed
• Long-tailed Food Classification
  26 Oct 2022 0 repositories listed
• An Effective Deep Network for Head Pose Estimation without Keypoints
  25 Oct 2022 0 repositories listed
• Online Cross-Layer Knowledge Distillation on Graph Neural Networks with Deep Supervision
  25 Oct 2022 0 repositories listed
• Referee: Reference-Free Sentence Summarization with Sharper Controllability through Symbolic Knowledge Distillation
  25 Oct 2022 0 repositories listed
• Legal-Tech Open Diaries: Lesson learned on how to develop and deploy light-weight models in the era of humongous Language Models
  24 Oct 2022 0 repositories listed
• Respecting Transfer Gap in Knowledge Distillation
  23 Oct 2022 0 repositories listed
• Adaptive Label Smoothing with Self-Knowledge in Natural Language Generation
  22 Oct 2022 0 repositories listed
• Hard Gate Knowledge Distillation -- Leverage Calibration for Robust and Reliable Language Model
  22 Oct 2022 0 repositories listed
• Performance-Efficiency Trade-Offs in Adapting Language Models to Text Classification Tasks
  21 Oct 2022 0 repositories listed
• Semi-supervised object detection based on single-stage detector for thighbone fracture localization
  20 Oct 2022 0 repositories listed
• Similarity of Neural Architectures using Adversarial Attack Transferability
  20 Oct 2022 0 repositories listed
• Toward Multiple Specialty Learners for Explaining GNNs via Online Knowledge Distillation
  20 Oct 2022 0 repositories listed
• A baseline revisited: Pushing the limits of multi-segment models for context-aware translation
  19 Oct 2022 0 repositories listed