Methods › General › Knowledge Distillation › Knowledge Distillation › Papers, page 18

Knowledge Distillation

Papers archive 2025-07-28

archive papers tagged: 3,071 · with a code link: 1,258 · where Syntology ran a sample: 320 (276 with a run with no instrument failure, 44 where every run was a failure of Syntology's instrument) Syntology

Show: all tagged papersonly where code ran (320 of 3,071 tagged: 276 with a run with no instrument failure, 44 where every run was a failure of Syntology's instrument)

Page 18 of 31: papers 1,701 to 1,800 of 3,071, newest first by the archive's date (ties by slug), in archive order.

Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code, as “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. It is per sample and not a correctness claim. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from.

• BD-KD: Balancing the Divergences for Online Knowledge Distillation
  25 Dec 2022 · 0 repositories · arXiv:2212.12965
• CAMeMBERT: Cascading Assistant-Mediated Multilingual BERT
  22 Dec 2022 · 0 repositories · arXiv:2212.11456
• Adam: Dense Retrieval Distillation with Adaptive Dark Examples
  20 Dec 2022 · 0 repositories · arXiv:2212.10192
• Diffusion Glancing Transformer for Parallel Sequence to Sequence Learning
  20 Dec 2022 · 0 repositories · arXiv:2212.10240
• Fine-Grained Distillation for Long Document Retrieval
  20 Dec 2022 · 0 repositories · arXiv:2212.10423
• RangeAugment: Efficient Online Augmentation with Range Learning
  20 Dec 2022 · 1 repository · arXiv:2212.10553
• I2D2: Inductive Knowledge Distillation with NeuroLogic and Self-Imitation
  19 Dec 2022 · 0 repositories · arXiv:2212.09246
• Learning Object-level Point Augmentor for Semi-supervised 3D Object Detection
  19 Dec 2022 · 1 repository · arXiv:2212.09273
• Continual Knowledge Distillation for Neural Machine Translation
  18 Dec 2022 · 1 repository · arXiv:2212.09097
• 3D Point Cloud Pre-training with Knowledge Distillation from 2D Images
  17 Dec 2022 · 0 repositories · arXiv:2212.08974
• Swing Distillation: A Privacy-Preserving Knowledge Distillation Framework
  16 Dec 2022 · 0 repositories · arXiv:2212.08349
• Gradient-based Intra-attention Pruning on Pre-trained Language Models
  15 Dec 2022 · 1 repository · arXiv:2212.07634
  Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 3 harvested samples)
• Domain Adaptation for Dense Retrieval through Self-Supervision by Pseudo-Relevance Labeling
  13 Dec 2022 · 0 repositories · arXiv:2212.06552
• Multimodal Matching-aware Co-attention Networks with Mutual Knowledge Distillation for Fake News Detection
  12 Dec 2022 · 0 repositories · arXiv:2212.05699
• Teaching What You Should Teach: A Data-Based Distillation Method
  11 Dec 2022 · 0 repositories · arXiv:2212.05422
• Multi-adversarial Faster-RCNN with Paradigm Teacher for Unrestricted Object Detection
  11 Dec 2022 · 0 repositories
• Complete-to-Partial 4D Distillation for Self-Supervised Point Cloud Sequence Representation Learning
  10 Dec 2022 · 0 repositories · arXiv:2212.05330
• LEAD: Liberal Feature-based Distillation for Dense Retrieval
  10 Dec 2022 · 1 repository · arXiv:2212.05225
• Knowledge Distillation Applied to Optical Channel Equalization: Solving the Parallelization Problem of Recurrent Connection
  8 Dec 2022 · 0 repositories · arXiv:2212.04569
• Occlusion-Robust FAU Recognition by Mining Latent Space of Masked Autoencoders
  8 Dec 2022 · 0 repositories · arXiv:2212.04029
• Enhancing Low-Density EEG-Based Brain-Computer Interfaces with Similarity-Keeping Knowledge Distillation
  6 Dec 2022 · 1 repository · arXiv:2212.03329
• Leveraging Different Learning Styles for Improved Knowledge Distillation in Biomedical Imaging
  6 Dec 2022 · 0 repositories · arXiv:2212.02931
• Life-long Learning for Multilingual Neural Machine Translation with Knowledge Distillation
  6 Dec 2022 · 0 repositories · arXiv:2212.02800
• Open World DETR: Transformer based Open World Object Detection
  6 Dec 2022 · 0 repositories · arXiv:2212.02969
• DA-CIL: Towards Domain Adaptive Class-Incremental 3D Object Detection
  5 Dec 2022 · 0 repositories · arXiv:2212.02057
• FedUKD: Federated UNet Model with Knowledge Distillation for Land Use Classification from Satellite and Street Views
  5 Dec 2022 · 2 repositories · arXiv:2212.02196
• The RoyalFlush System for the WMT 2022 Efficiency Task
  3 Dec 2022 · 0 repositories · arXiv:2212.01543
• Improving Simultaneous Machine Translation with Monolingual Data
  2 Dec 2022 · 1 repository · arXiv:2212.01188
• Injecting Spatial Information for Monaural Speech Enhancement via Knowledge Distillation
  2 Dec 2022 · 0 repositories · arXiv:2212.01012
• StructVPR: Distill Structural Knowledge with Weighting Samples for Visual Place Recognition
  2 Dec 2022 · 0 repositories · arXiv:2212.00937
• BEV-LGKD: A Unified LiDAR-Guided Knowledge Distillation Framework for BEV 3D Object Detection
  1 Dec 2022 · 1 repository · arXiv:2212.00623
• Distilling Reasoning Capabilities into Smaller Language Models
  1 Dec 2022 · 1 repository · arXiv:2212.00193
• Attention-Based Depth Distillation with 3D-Aware Positional Encoding for Monocular 3D Object Detection
  30 Nov 2022 · 0 repositories · arXiv:2211.16779
• Coordinating Cross-modal Distillation for Molecular Property Prediction
  30 Nov 2022 · 0 repositories · arXiv:2211.16712
• Explicit Knowledge Transfer for Weakly-Supervised Code Generation
  30 Nov 2022 · 0 repositories · arXiv:2211.16740
• HEAT: Hardware-Efficient Automatic Tensor Decomposition for Transformer Compression
  30 Nov 2022 · 0 repositories · arXiv:2211.16749
• Hint-dynamic Knowledge Distillation
  30 Nov 2022 · 0 repositories · arXiv:2211.17059
• Knowledge Distillation based Degradation Estimation for Blind Super-Resolution
  30 Nov 2022 · 1 repository · arXiv:2211.16928
• Random Copolymer inverse design system orienting on Accurate discovering of Antimicrobial peptide-mimetic copolymers
  30 Nov 2022 · 0 repositories · arXiv:2212.00023
• Curriculum Temperature for Knowledge Distillation
  29 Nov 2022 · 1 repository · arXiv:2211.16231
  Syntology official (archive's flag): 8 ran · 8 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 5 where Syntology's instrument failed) · 7 unverified (of 15 harvested samples) · 2 pointer-only (licence)
• Feature-domain Adaptive Contrastive Distillation for Efficient Single Image Super-Resolution
  29 Nov 2022 · 0 repositories · arXiv:2211.15951
• Dense Interspecies Face Embedding
  28 Nov 2022 · 1 repository
• Inter-KD: Intermediate Knowledge Distillation for CTC-Based Automatic Speech Recognition
  28 Nov 2022 · 0 repositories · arXiv:2211.15075
• SgVA-CLIP: Semantic-guided Visual Adapting of Vision-Language Models for Few-shot Image Classification
  28 Nov 2022 · 1 repository · arXiv:2211.16191
• Class-aware Information for Logit-based Knowledge Distillation
  27 Nov 2022 · 0 repositories · arXiv:2211.14773
• Unbiased Knowledge Distillation for Recommendation
  27 Nov 2022 · 1 repository · arXiv:2211.14729
• SKDBERT: Compressing BERT via Stochastic Knowledge Distillation
  26 Nov 2022 · 0 repositories · arXiv:2211.14466
• A Strong Baseline for Generalized Few-Shot Semantic Segmentation
  25 Nov 2022 · 2 repositories · arXiv:2211.14126
• MPCViT: Searching for Accurate and Efficient MPC-Friendly Vision Transformer with Heterogeneous Attention
  25 Nov 2022 · 1 repository · arXiv:2211.13955
• XKD: Cross-modal Knowledge Distillation with Domain Alignment for Video Representation Learning
  25 Nov 2022 · 1 repository · arXiv:2211.13929
• Distilling Knowledge from Self-Supervised Teacher by Embedding Graph Alignment
  23 Nov 2022 · 1 repository · arXiv:2211.13264
  Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples) · 2 pointer-only (licence)
• On the Transferability of Visual Features in Generalized Zero-Shot Learning
  22 Nov 2022 · 1 repository · arXiv:2211.12494
• Blind Knowledge Distillation for Robust Image Classification
  21 Nov 2022 · 1 repository · arXiv:2211.11355
• Directed Acyclic Graph Factorization Machines for CTR Prediction via Knowledge Distillation
  21 Nov 2022 · 1 repository · arXiv:2211.11159
• Multi-Level Knowledge Distillation for Out-of-Distribution Detection in Text
  21 Nov 2022 · 1 repository · arXiv:2211.11300
  Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 4 harvested samples)
• Scalable Collaborative Learning via Representation Sharing
  20 Nov 2022 · 0 repositories · arXiv:2211.10943
• DASECount: Domain-Agnostic Sample-Efficient Wireless Indoor Crowd Counting via Few-shot Learning
  18 Nov 2022 · 0 repositories · arXiv:2211.10040
• EEG aided boosting of single-lead ECG based sleep staging with Deep Knowledge Distillation
  18 Nov 2022 · 1 repository · arXiv:2211.13125
• BEVDistill: Cross-Modal BEV Distillation for Multi-View 3D Object Detection
  17 Nov 2022 · 1 repository · arXiv:2211.09386
• ConNER: Consistency Training for Cross-lingual Named Entity Recognition
  17 Nov 2022 · 1 repository · arXiv:2211.09394
• D³ETR: Decoder Distillation for Detection Transformer
  17 Nov 2022 · 0 repositories · arXiv:2211.09768
• DETRDistill: A Universal Knowledge Distillation Framework for DETR-families
  17 Nov 2022 · 0 repositories · arXiv:2211.10156
• Yield Evaluation of Citrus Fruits based on the YoloV5 compressed by Knowledge Distillation
  16 Nov 2022 · 0 repositories · arXiv:2211.08743
• An Efficient Active Learning Pipeline for Legal Text Classification
  15 Nov 2022 · 0 repositories · arXiv:2211.08112
• An Investigation of the Combination of Rehearsal and Knowledge Distillation in Continual Learning for Spoken Language Understanding
  15 Nov 2022 · 1 repository · arXiv:2211.08161
• Knowledge Distillation for Detection Transformer with Consistent Distillation Points Sampling
  15 Nov 2022 · 2 repositories · arXiv:2211.08071
• An Interpretable Neuron Embedding for Static Knowledge Distillation
  14 Nov 2022 · 0 repositories · arXiv:2211.07647
• Fcaformer: Forward Cross Attention in Hybrid Vision Transformer
  14 Nov 2022 · 2 repositories · arXiv:2211.07198
• Cross-Modality Knowledge Distillation Network for Monocular 3D Object Detection
  14 Nov 2022 · 1 repository · arXiv:2211.07171
  Syntology official (archive's flag): 1 ran · 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified; the one sample that ran constructed an object rather than computing a result (of 2 harvested samples)
• Structured Knowledge Distillation Towards Efficient and Compact Multi-View 3D Detection
  14 Nov 2022 · 0 repositories · arXiv:2211.08398
• FAN-Trans: Online Knowledge Distillation for Facial Action Unit Detection
  11 Nov 2022 · 0 repositories · arXiv:2211.06143
• Knowledge Distillation from Cross Teaching Teachers for Efficient Semi-Supervised Abdominal Organ Segmentation in CT
  11 Nov 2022 · 1 repository · arXiv:2211.05942
• PILE: Pairwise Iterative Logits Ensemble for Multi-Teacher Labeled Distillation
  11 Nov 2022 · 0 repositories · arXiv:2211.06059
• Efficient Large-scale Audio Tagging via Transformer-to-CNN Knowledge Distillation
  9 Nov 2022 · 2 repositories · arXiv:2211.04772
  Syntology community repositories only · 2 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples) · 1 pointer-only (licence)
• Knowledge Distillation for Federated Learning: a Practical Guide
  9 Nov 2022 · 0 repositories · arXiv:2211.04742
• Bridging Fairness and Environmental Sustainability in Natural Language Processing
  8 Nov 2022 · 0 repositories · arXiv:2211.04256
• Understanding the Role of Mixup in Knowledge Distillation: An Empirical Study
  8 Nov 2022 · 1 repository · arXiv:2211.03946
• AlphaPose: Whole-Body Regional Multi-Person Pose Estimation and Tracking in Real-Time
  7 Nov 2022 · 8 repositories · arXiv:2211.03375
• Closing the Gap between Client and Global Model Performance in Heterogeneous Federated Learning
  7 Nov 2022 · 0 repositories · arXiv:2211.03457
• CoNMix for Source-free Single and Multi-target Domain Adaptation
  7 Nov 2022 · 1 repository · arXiv:2211.03876
  Syntology official: harvested, nothing ran · 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 2 unverified (of 4 harvested samples) · 4 pointer-only (licence)
• Peak-First CTC: Reducing the Peak Latency of CTC Models by Applying Peak-First Regularization
  7 Nov 2022 · 0 repositories · arXiv:2211.03284
• Breaking the trade-off in personalized speech enhancement with cross-task knowledge distillation
  5 Nov 2022 · 0 repositories · arXiv:2211.02944
• SSDA-YOLO: Semi-supervised Domain Adaptive YOLO for Cross-Domain Object Detection
  4 Nov 2022 · 1 repository · arXiv:2211.02213
• Gradient Knowledge Distillation for Pre-trained Language Models
  2 Nov 2022 · 1 repository · arXiv:2211.01071
  Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 4 where Syntology's instrument failed) · 3 unverified (of 7 harvested samples) · 7 pointer-only (licence)
• LightVessel: Exploring Lightweight Coronary Artery Vessel Segmentation via Similarity Knowledge Distillation
  2 Nov 2022 · 0 repositories · arXiv:2211.00899
• MPCFormer: fast, performant and private Transformer inference with MPC
  2 Nov 2022 · 1 repository · arXiv:2211.01452
• Multi-level Distillation of Semantic Knowledge for Pre-training Multilingual Language Model
  2 Nov 2022 · 0 repositories · arXiv:2211.01200
• ARDIR: Improving Robustness using Knowledge Distillation of Internal Representation
  1 Nov 2022 · 0 repositories · arXiv:2211.00239
• Maximum Likelihood Distillation for Robust Modulation Classification
  1 Nov 2022 · 0 repositories · arXiv:2211.00748
• Generative Negative Text Replay for Continual Vision-Language Pretraining
  31 Oct 2022 · 0 repositories · arXiv:2210.17322
• Lightweight Neural Network with Knowledge Distillation for CSI Feedback
  31 Oct 2022 · 0 repositories · arXiv:2210.17113
• QuaLA-MiniLM: a Quantized Length Adaptive MiniLM
  31 Oct 2022 · 2 repositories · arXiv:2210.17114
• Application of Knowledge Distillation to Multi-task Speech Representation Learning
  29 Oct 2022 · 0 repositories · arXiv:2210.16611
• BEBERT: Efficient and Robust Binary Ensemble BERT
  28 Oct 2022 · 1 repository · arXiv:2210.15976
• Completely Heterogeneous Federated Learning
  28 Oct 2022 · 0 repositories · arXiv:2210.15865
• Lightweight and High-Fidelity End-to-End Text-to-Speech with Multi-Band Generation and Inverse Short-Time Fourier Transform
  28 Oct 2022 · 1 repository · arXiv:2210.15975
• Semi-UFormer: Semi-supervised Uncertainty-aware Transformer for Image Dehazing
  28 Oct 2022 · 0 repositories · arXiv:2210.16057
• Teacher-Student Architecture for Knowledge Learning: A Survey
  28 Oct 2022 · 0 repositories · arXiv:2210.17332
• A Knowledge Distillation Framework For Enhancing Ear-EEG Based Sleep Staging With Scalp-EEG Data
  27 Oct 2022 · 1 repository · arXiv:2211.02638
• Collaborative Multi-Teacher Knowledge Distillation for Learning Low Bit-width Deep Neural Networks
  27 Oct 2022 · 0 repositories · arXiv:2210.16103