Methods › General › Knowledge Distillation › Knowledge Distillation › Papers, page 19

Knowledge Distillation

Papers archive 2025-07-28

archive papers tagged: 3,071 · with a code link: 1,258 · where Syntology ran a sample: 320 (276 with a run with no instrument failure, 44 where every run was a failure of Syntology's instrument) Syntology

Show: all tagged papersonly where code ran (320 of 3,071 tagged: 276 with a run with no instrument failure, 44 where every run was a failure of Syntology's instrument)

Page 19 of 31: papers 1,801 to 1,900 of 3,071, newest first by the archive's date (ties by slug), in archive order.

Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code, as “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. It is per sample and not a correctness claim. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from.

• Li3DeTr: A LiDAR based 3D Detection Transformer
  27 Oct 2022 · 0 repositories · arXiv:2210.15365
• Too Brittle To Touch: Comparing the Stability of Quantization and Distillation Towards Developing Lightweight Low-Resource MT Models
  27 Oct 2022 · 1 repository · arXiv:2210.15184
• Weight Averaging: A Simple Yet Effective Method to Overcome Catastrophic Forgetting in Automatic Speech Recognition
  27 Oct 2022 · 0 repositories · arXiv:2210.15282
• An Effective Deep Network for Head Pose Estimation without Keypoints
  25 Oct 2022 · 0 repositories · arXiv:2210.13705
• GlobalFlowNet: Video Stabilization using Deep Distilled Global Motion Estimates
  25 Oct 2022 · 1 repository · arXiv:2210.13769
• Online Cross-Layer Knowledge Distillation on Graph Neural Networks with Deep Supervision
  25 Oct 2022 · 0 repositories · arXiv:2210.13743
• Referee: Reference-Free Sentence Summarization with Sharper Controllability through Symbolic Knowledge Distillation
  25 Oct 2022 · 0 repositories · arXiv:2210.13800
• Geometric Knowledge Distillation: Topology Compression for Graph Neural Networks
  24 Oct 2022 · 2 repositories · arXiv:2210.13014
  Syntology official (archive's flag): 1 ran · 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified; the one sample that ran constructed an object rather than computing a result (of 2 harvested samples) · 2 pointer-only (licence)
• Legal-Tech Open Diaries: Lesson learned on how to develop and deploy light-weight models in the era of humongous Language Models
  24 Oct 2022 · 0 repositories · arXiv:2210.13086
• Adaptive Label Smoothing with Self-Knowledge in Natural Language Generation
  22 Oct 2022 · 0 repositories · arXiv:2210.13459
• Hard Gate Knowledge Distillation -- Leverage Calibration for Robust and Reliable Language Model
  22 Oct 2022 · 0 repositories · arXiv:2210.12427
• Distilling the Undistillable: Learning from a Nasty Teacher
  21 Oct 2022 · 1 repository · arXiv:2210.11728
• Modeling Document-level Temporal Structures for Building Temporal Dependency Graphs
  21 Oct 2022 · 1 repository · arXiv:2210.11787
• Performance-Efficiency Trade-Offs in Adapting Language Models to Text Classification Tasks
  21 Oct 2022 · 0 repositories · arXiv:2210.12022
• Similarity of Neural Architectures using Adversarial Attack Transferability
  20 Oct 2022 · 0 repositories · arXiv:2210.11407
• Toward Multiple Specialty Learners for Explaining GNNs via Online Knowledge Distillation
  20 Oct 2022 · 0 repositories · arXiv:2210.11094
• On effects of Knowledge Distillation on Transfer Learning
  18 Oct 2022 · 0 repositories · arXiv:2210.09668
• SA-MLP: Distilling Graph Knowledge from GNNs into Structure-Aware MLP
  18 Oct 2022 · 4 repositories · arXiv:2210.09609
  Syntology community repositories only · 4 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 5 harvested samples)
• Federated Learning with Privacy-Preserving Ensemble Attention Distillation
  16 Oct 2022 · 0 repositories · arXiv:2210.08464
• RoS-KD: A Robust Stochastic Knowledge Distillation Approach for Noisy Medical Imaging
  15 Oct 2022 · 0 repositories · arXiv:2210.08388
• EfficientVLM: Fast and Accurate Vision-Language Models via Knowledge Distillation and Modal-adaptive Pruning
  14 Oct 2022 · 1 repository · arXiv:2210.07795
  Syntology official (archive's flag): 7 ran · 7 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 3 where Syntology's instrument failed) · 2 unverified (of 9 harvested samples) · 9 pointer-only (licence)
• Improving generalizability of distilled self-supervised speech processing models under distorted settings
  14 Oct 2022 · 1 repository · arXiv:2210.07978
• Knowledge Distillation approach towards Melanoma Detection
  14 Oct 2022 · 1 repository · arXiv:2210.08086
• Learning Generalizable Models for Vehicle Routing Problems via Knowledge Distillation
  14 Oct 2022 · 1 repository · arXiv:2210.07686
  Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 1 honoured, 1 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 6 unverified (of 8 harvested samples)
• Probabilistic Integration of Object Level Annotations in Chest X-ray Classification
  13 Oct 2022 · 0 repositories · arXiv:2210.06980
• Boosting Graph Neural Networks via Adaptive Knowledge Distillation
  12 Oct 2022 · 0 repositories · arXiv:2210.05920
• Decomposed Knowledge Distillation for Class-Incremental Semantic Segmentation
  12 Oct 2022 · 1 repository · arXiv:2210.05941
  Syntology 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; the one sample that ran constructed an object rather than computing a result (of 1 harvested sample) · 1 pointer-only (licence)
• Comparison of Soft and Hard Target RNN-T Distillation for Large-scale ASR
  11 Oct 2022 · 0 repositories · arXiv:2210.05793
• Linkless Link Prediction via Relational Distillation
  11 Oct 2022 · 0 repositories · arXiv:2210.05801
• ME-D2N: Multi-Expert Domain Decompositional Network for Cross-Domain Few-Shot Learning
  11 Oct 2022 · 1 repository · arXiv:2210.05280
• PP-StructureV2: A Stronger Document Analysis System
  11 Oct 2022 · 1 repository · arXiv:2210.05391
• SaiT: Sparse Vision Transformers through Adaptive Token Pruning
  11 Oct 2022 · 1 repository · arXiv:2210.05832
• Distill the Image to Nowhere: Inversion Knowledge Distillation for Multimodal Machine Translation
  10 Oct 2022 · 1 repository · arXiv:2210.04468
  Syntology official (archive's flag): 4 ran · 4 ran (of which 2 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 4 where Syntology's instrument failed) · 1 unverified (of 5 harvested samples) · 5 pointer-only (licence)
• Knowledge Distillation Transfer Sets and their Impact on Downstream NLU Tasks
  10 Oct 2022 · 0 repositories · arXiv:2210.04834
• Patch-based Knowledge Distillation for Lifelong Person Re-Identification
  10 Oct 2022 · 1 repository
• Let Images Give You More:Point Cloud Cross-Modal Training for Shape Analysis
  9 Oct 2022 · 2 repositories · arXiv:2210.04208
• Meta-DMoE: Adapting to Domain Shift by Meta-Distillation from Mixture-of-Experts
  8 Oct 2022 · 1 repository · arXiv:2210.03885
  Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified (of 7 harvested samples)
• Bi-directional Weakly Supervised Knowledge Distillation for Whole Slide Image Classification
  7 Oct 2022 · 1 repository · arXiv:2210.03664
  Syntology official (archive's flag): 3 ran · 3 ran (of which 1 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 1 violated, 1 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples) · 3 pointer-only (licence)
• C2KD: Cross-Lingual Cross-Modal Knowledge Distillation for Multilingual Text-Video Retrieval
  7 Oct 2022 · 1 repository · arXiv:2210.03625
• Mutual Learning of Single- and Multi-Channel End-to-End Neural Diarization
  7 Oct 2022 · 0 repositories · arXiv:2210.03459
• Effective Self-supervised Pre-training on Low-compute Networks without Distillation
  6 Oct 2022 · 1 repository · arXiv:2210.02808
  Syntology official (archive's flag): 6 ran · 6 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 3 where Syntology's instrument failed) · 3 unverified (of 9 harvested samples) · 3 pointer-only (licence)
• AlphaFold Distillation for Protein Design
  5 Oct 2022 · 1 repository · arXiv:2210.03488
• Automated Graph Self-supervised Learning via Multi-teacher Knowledge Distillation
  5 Oct 2022 · 0 repositories · arXiv:2210.02099
• Meta-Ensemble Parameter Learning
  5 Oct 2022 · 0 repositories · arXiv:2210.01973
• A Study on the Efficiency and Generalization of Light Hybrid Retrievers
  4 Oct 2022 · 0 repositories · arXiv:2210.01371
• Domain Discrepancy Aware Distillation for Model Aggregation in Federated Learning
  4 Oct 2022 · 0 repositories · arXiv:2210.02190
• Knowledge Distillation based Contextual Relevance Matching for E-commerce Product Search
  4 Oct 2022 · 0 repositories · arXiv:2210.01701
• Positive Pair Distillation Considered Harmful: Continual Meta Metric Learning for Lifelong Object Re-Identification
  4 Oct 2022 · 1 repository · arXiv:2210.01600
• Attention Distillation: self-supervised vision transformer students need more guidance
  3 Oct 2022 · 1 repository · arXiv:2210.00944
• Robust Active Distillation
  3 Oct 2022 · 0 repositories · arXiv:2210.01213
• Multi-stage Progressive Compression of Conformer Transducer for On-device Speech Recognition
  1 Oct 2022 · 0 repositories · arXiv:2210.00169
• Designing and Training of Lightweight Neural Networks on Edge Devices using Early Halting in Knowledge Distillation
  30 Sep 2022 · 0 repositories · arXiv:2209.15560
• F-VLM: Open-Vocabulary Object Detection upon Frozen Vision and Language Models
  30 Sep 2022 · 1 repository · arXiv:2209.15639
• Slimmable Networks for Contrastive Self-supervised Learning
  30 Sep 2022 · 1 repository · arXiv:2209.15525
• Towards a Unified View of Affinity-Based Knowledge Distillation
  30 Sep 2022 · 0 repositories · arXiv:2209.15555
• Using Knowledge Distillation to improve interpretable models in a retail banking context
  30 Sep 2022 · 0 repositories · arXiv:2209.15496
• Label driven Knowledge Distillation for Federated Learning with non-IID Data
  29 Sep 2022 · 0 repositories · arXiv:2209.14520
• Teaching Where to Look: Attention Similarity Knowledge Distillation for Low Resolution Face Recognition
  29 Sep 2022 · 1 repository · arXiv:2209.14498
  Syntology official (archive's flag): 1 ran · 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; the one sample that ran constructed an object rather than computing a result (of 1 harvested sample)
• Towards Explaining Autonomy with Verbalised Decision Tree States
  28 Sep 2022 · 0 repositories · arXiv:2209.13985
• Efficient On-Device Session-Based Recommendation
  27 Sep 2022 · 1 repository · arXiv:2209.13422
• Rethinking Resolution in the Context of Efficient Video Recognition
  26 Sep 2022 · 1 repository · arXiv:2209.12797
  Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 5 harvested samples) · 2 pointer-only (licence)
• Joint Speech Activity and Overlap Detection with Multi-Exit Architecture
  24 Sep 2022 · 0 repositories · arXiv:2209.11906
• DRKF: Distilled Rotated Kernel Fusion for Efficient Rotation Invariant Descriptors in Local Feature Matching
  22 Sep 2022 · 0 repositories · arXiv:2209.10907
• Momentum Adversarial Distillation: Handling Large Distribution Shifts in Data-Free Knowledge Distillation
  21 Sep 2022 · 0 repositories · arXiv:2209.10359
• Exploring Inconsistent Knowledge Distillation for Object Detection with Data Augmentation
  20 Sep 2022 · 1 repository · arXiv:2209.09841
  Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 6 harvested samples) · 4 pointer-only (licence)
• Parameter-Efficient Conformers via Sharing Sparsely-Gated Experts for End-to-End Speech Recognition
  17 Sep 2022 · 0 repositories · arXiv:2209.08326
• Causes of Catastrophic Forgetting in Class-Incremental Semantic Segmentation
  16 Sep 2022 · 1 repository · arXiv:2209.08010
• Continual Learning for Class- and Domain-Incremental Semantic Segmentation
  16 Sep 2022 · 0 repositories · arXiv:2209.08023
• Deliberated Domain Bridging for Domain Adaptive Semantic Segmentation
  16 Sep 2022 · 1 repository · arXiv:2209.07695
• Self-Supervised Learning of Phenotypic Representations from Cell Images with Weak Labels
  16 Sep 2022 · 1 repository · arXiv:2209.07819
• CES-KD: Curriculum-based Expert Selection for Guided Knowledge Distillation
  15 Sep 2022 · 0 repositories · arXiv:2209.07606
• On-Device Domain Generalization
  15 Sep 2022 · 2 repositories · arXiv:2209.07521
• PlaStIL: Plastic and Stable Memory-Free Class-Incremental Learning
  14 Sep 2022 · 0 repositories · arXiv:2209.06606
• Multi-stage Distillation Framework for Cross-Lingual Semantic Similarity Matching
  13 Sep 2022 · 1 repository · arXiv:2209.05869
• Online Continual Learning via the Meta-learning Update with Multi-scale Knowledge Distillation and Data Augmentation
  12 Sep 2022 · 0 repositories · arXiv:2209.06107
• Switchable Online Knowledge Distillation
  12 Sep 2022 · 1 repository · arXiv:2209.04996
  Syntology official (archive's flag): 10 ran · 10 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 1 violated, 5 with no contract checked; 4 where Syntology's instrument failed) · 3 unverified (of 13 harvested samples) · 3 pointer-only (licence)
• Preserving Privacy in Federated Learning with Ensemble Cross-Domain Knowledge Distillation
  10 Sep 2022 · 0 repositories · arXiv:2209.04599
• In-situ animal behavior classification using knowledge distillation and fixed-point quantization
  9 Sep 2022 · 0 repositories · arXiv:2209.04130
• Selecting Related Knowledge via Efficient Channel Attention for Online Continual Learning
  9 Sep 2022 · 0 repositories · arXiv:2209.04212
• Exploring Target Representations for Masked Autoencoders
  8 Sep 2022 · 1 repository · arXiv:2209.03917
  Syntology official (archive's flag): 11 ran · 11 ran (of which 0 constructed an object rather than computing a result; 10 with no instrument failure: 1 honoured, 0 violated, 9 with no contract checked; 1 where Syntology's instrument failed) · 2 unverified (of 13 harvested samples) · 2 pointer-only (licence)
• On the Effectiveness of Compact Biomedical Transformers
  7 Sep 2022 · 1 repository · arXiv:2209.03182
• Domain Generalization for Prostate Segmentation in Transrectal Ultrasound Images: A Multi-center Study
  5 Sep 2022 · 1 repository · arXiv:2209.02126
• A Novel Self-Knowledge Distillation Approach with Siamese Representation Learning for Action Recognition
  3 Sep 2022 · 0 repositories · arXiv:2209.01311
• A New Knowledge Distillation Network for Incremental Few-Shot Surface Defect Detection
  1 Sep 2022 · 1 repository · arXiv:2209.00519
• Dynamics-Adaptive Continual Reinforcement Learning via Progressive Contextualization
  1 Sep 2022 · 0 repositories · arXiv:2209.00347
• FAKD: Feature Augmented Knowledge Distillation for Semantic Segmentation
  30 Aug 2022 · 1 repository · arXiv:2208.14143
• Dynamic Data-Free Knowledge Distillation by Easy-to-Hard Learning Strategy
  29 Aug 2022 · 1 repository · arXiv:2208.13648
• Progressive Self-Distillation for Ground-to-Aerial Perception Knowledge Transfer
  29 Aug 2022 · 1 repository · arXiv:2208.13404
• Goal-Conditioned Q-Learning as Knowledge Distillation
  28 Aug 2022 · 1 repository · arXiv:2208.13298
• CMD: Self-supervised 3D Action Representation Learning with Cross-modal Mutual Distillation
  26 Aug 2022 · 1 repository · arXiv:2208.12448
• Dense Depth Distillation with Out-of-Distribution Simulated Images
  26 Aug 2022 · 0 repositories · arXiv:2208.12464
• Disentangle and Remerge: Interventional Knowledge Distillation for Few-Shot Object Detection from A Conditional Causal Perspective
  26 Aug 2022 · 1 repository · arXiv:2208.12681
  Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)
• Unsupervised Spike Depth Estimation via Cross-modality Cross-domain Knowledge Transfer
  26 Aug 2022 · 1 repository · arXiv:2208.12527
• Masked Autoencoders Enable Efficient Knowledge Distillers
  25 Aug 2022 · 1 repository · arXiv:2208.12256
• Lifelong Learning for Neural powered Mixed Integer Programming
  24 Aug 2022 · 0 repositories · arXiv:2208.12226
• LTE4G: Long-Tail Experts for Graph Neural Networks
  22 Aug 2022 · 1 repository · arXiv:2208.10205
• Multi-Granularity Distillation Scheme Towards Lightweight Semi-Supervised Semantic Segmentation
  22 Aug 2022 · 1 repository · arXiv:2208.10169
  Syntology official (archive's flag): 9 ran · 9 ran (of which 0 constructed an object rather than computing a result; 9 with no instrument failure: 1 honoured, 1 violated, 7 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 9 harvested samples) · 2 pointer-only (licence)
• Multi-View Attention Transfer for Efficient Speech Enhancement
  22 Aug 2022 · 0 repositories · arXiv:2208.10367
• PANDA: Prompt Transfer Meets Knowledge Distillation for Efficient Model Adaptation
  22 Aug 2022 · 1 repository · arXiv:2208.10160
  Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 3 harvested samples)
• A semi-supervised Teacher-Student framework for surgical tool detection and localization
  21 Aug 2022 · 1 repository · arXiv:2208.09926