Methods › General › Knowledge Distillation › Knowledge Distillation › Papers, page 21

Knowledge Distillation

Papers archive 2025-07-28

archive papers tagged: 3,071 · with a code link: 1,258 · where Syntology ran a sample: 320 (276 with a run with no instrument failure, 44 where every run was a failure of Syntology's instrument) Syntology

Show: all tagged papersonly where code ran (320 of 3,071 tagged: 276 with a run with no instrument failure, 44 where every run was a failure of Syntology's instrument)

Page 21 of 31: papers 2,001 to 2,100 of 3,071, newest first by the archive's date (ties by slug), in archive order.

Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code, as “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. It is per sample and not a correctness claim. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from.

• Divide to Adapt: Mitigating Confirmation Bias for Domain Adaptation of Black-Box Predictors
  28 May 2022 · 1 repository · arXiv:2205.14467
• One Reference Is Not Enough: Diverse Distillation with Reference Selection for Non-Autoregressive Translation
  28 May 2022 · 1 repository · arXiv:2205.14333
  Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 3 harvested samples) · 3 pointer-only (licence)
• Parameter-Efficient and Student-Friendly Knowledge Distillation
  28 May 2022 · 0 repositories · arXiv:2205.15308
• Geometer: Graph Few-Shot Class-Incremental Learning via Prototype Representation
  27 May 2022 · 1 repository · arXiv:2205.13954
  Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 4 unverified (of 6 harvested samples)
• Region-aware Knowledge Distillation for Efficient Image-to-Image Translation
  25 May 2022 · 0 repositories · arXiv:2205.12451
• CDFKD-MFS: Collaborative Data-free Knowledge Distillation via Multi-level Feature Sharing
  24 May 2022 · 1 repository · arXiv:2205.11845
• Compressing Deep Graph Neural Networks via Adversarial Knowledge Distillation
  24 May 2022 · 1 repository · arXiv:2205.11678
• Optimizing Performance of Federated Person Re-identification: Benchmarking and Analysis
  24 May 2022 · 2 repositories · arXiv:2205.12144
  Syntology official (archive's flag): 6 ran · 6 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 8 harvested samples)
• Boosting Multi-Label Image Classification with Complementary Parallel Self-Distillation
  23 May 2022 · 1 repository · arXiv:2205.10986
  Syntology official (archive's flag): 1 ran · 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; the one sample that ran constructed an object rather than computing a result (of 1 harvested sample) · 1 pointer-only (licence)
• LILA-BOTI : Leveraging Isolated Letter Accumulations By Ordering Teacher Insights for Bangla Handwriting Recognition
  23 May 2022 · 1 repository · arXiv:2205.11420
• PointDistiller: Structured Knowledge Distillation Towards Efficient and Compact 3D Detection
  23 May 2022 · 1 repository · arXiv:2205.11098
• IDEAL: Query-Efficient Data-Free Learning from Black-box Models
  23 May 2022 · 1 repository · arXiv:2205.11158
  Syntology official (archive's flag): 6 ran · 6 ran (of which 3 constructed an object rather than computing a result; 5 with no instrument failure: 1 honoured, 0 violated, 4 with no contract checked; 1 where Syntology's instrument failed) · 3 unverified (of 9 harvested samples) · 9 pointer-only (licence)
• Knowledge Distillation via the Target-aware Transformer
  22 May 2022 · 2 repositories · arXiv:2205.10793
  Syntology community repositories only · 2 ran (of which 2 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; every one of the 2 samples that ran constructed an object rather than computing a result (of 2 harvested samples)
• Knowledge Distillation from A Stronger Teacher
  21 May 2022 · 3 repositories · arXiv:2205.10536
  Syntology official (archive's flag): 5 ran · 10 ran (of which 1 constructed an object rather than computing a result; 10 with no instrument failure: 4 honoured, 4 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 11 harvested samples)
• Aligning Logits Generatively for Principled Black-Box Knowledge Distillation
  21 May 2022 · 1 repository · arXiv:2205.10490
• InDistill: Information flow-preserving knowledge distillation for model compression
  20 May 2022 · 1 repository · arXiv:2205.10003
• Simple Regularisation for Uncertainty-Aware Knowledge Distillation
  19 May 2022 · 0 repositories · arXiv:2205.09526
• [Re] Distilling Knowledge via Knowledge Review
  18 May 2022 · 1 repository · arXiv:2205.11246
• Chemical transformer compression for accelerating both training and inference of molecular modeling
  16 May 2022 · 1 repository · arXiv:2205.07582
• Prompting to Distill: Boosting Data-Free Knowledge Distillation via Reinforced Prompt
  16 May 2022 · 0 repositories · arXiv:2205.07523
• Not to Overfit or Underfit the Source Domains? An Empirical Study of Domain Generalization in Question Answering
  15 May 2022 · 0 repositories · arXiv:2205.07257
• Knowledge Distillation Meets Open-Set Semi-Supervised Learning
  13 May 2022 · 1 repository · arXiv:2205.06701
  Syntology official (archive's flag): 6 ran · 6 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified (of 6 harvested samples) · 1 pointer-only (licence)
• D3T-GAN: Data-Dependent Domain Transfer GANs for Few-shot Image Generation
  12 May 2022 · 0 repositories · arXiv:2205.06032
• Knowledge Distillation for Multi-Target Domain Adaptation in Real-Time Person Re-Identification
  12 May 2022 · 1 repository · arXiv:2205.06237
• "Teaching Independent Parts Separately" (TIPSy-GAN) : Improving Accuracy and Stability in Unsupervised Adversarial 2D to 3D Pose Estimation
  12 May 2022 · 0 repositories · arXiv:2205.05980
• DistilProtBert: A distilled protein language model used to distinguish between real proteins and their randomly shuffled counterparts
  10 May 2022 · 1 repository
• Incremental-DETR: Incremental Few-Shot Object Detection via Self-Supervised Learning
  9 May 2022 · 0 repositories · arXiv:2205.04042
• Data-Free Adversarial Knowledge Distillation for Graph Neural Networks
  8 May 2022 · 0 repositories · arXiv:2205.03811
• Automatic Block-wise Pruning with Auxiliary Gating Structures for Deep Convolutional Neural Networks
  7 May 2022 · 0 repositories · arXiv:2205.03602
• Distilling Inter-Class Distance for Semantic Segmentation
  7 May 2022 · 0 repositories · arXiv:2205.03650
• Collective Relevance Labeling for Passage Retrieval
  6 May 2022 · 1 repository · arXiv:2205.03273
• A Deep Reinforcement Learning Framework for Rapid Diagnosis of Whole Slide Pathological Images
  5 May 2022 · 0 repositories · arXiv:2205.02850
• Alignahead: Online Cross-Layer Knowledge Extraction on Graph Neural Networks
  5 May 2022 · 1 repository · arXiv:2205.02468
• Holistic Approach to Measure Sample-level Adversarial Vulnerability and its Utility in Building Trustworthy Systems
  5 May 2022 · 0 repositories · arXiv:2205.02604
• Spot-adaptive Knowledge Distillation
  5 May 2022 · 2 repositories · arXiv:2205.02399
• Generalized Knowledge Distillation via Relationship Matching
  4 May 2022 · 1 repository · arXiv:2205.01915
  Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples)
• Attention-based Knowledge Distillation in Multi-attention Tasks: The Impact of a DCT-driven Loss
  4 May 2022 · 0 repositories · arXiv:2205.01997
• Knowledge Distillation of Russian Language Models with Reduction of Vocabulary
  4 May 2022 · 1 repository · arXiv:2205.02340
• FedDKD: Federated Learning with Decentralized Knowledge Distillation
  2 May 2022 · 0 repositories · arXiv:2205.00706
• Nearest Neighbor Knowledge Distillation for Neural Machine Translation
  1 May 2022 · 1 repository · arXiv:2205.00479
• EasyNLP: A Comprehensive and Easy-to-use Toolkit for Natural Language Processing
  30 Apr 2022 · 1 repository · arXiv:2205.00258
• Multiple Degradation and Reconstruction Network for Single Image Denoising via Knowledge Distillation
  29 Apr 2022 · 0 repositories · arXiv:2204.13873
• Curriculum Learning for Dense Retrieval Distillation
  28 Apr 2022 · 1 repository · arXiv:2204.13679
• Conformer and Blind Noisy Students for Improved Image Quality Assessment
  27 Apr 2022 · 1 repository · arXiv:2204.12819
• DearKD: Data-Efficient Early Knowledge Distillation for Vision Transformers
  27 Apr 2022 · 0 repositories · arXiv:2204.12997
• Human-Centered Prior-Guided and Task-Dependent Multi-Task Representation Learning for Action Recognition Pre-Training
  27 Apr 2022 · 0 repositories · arXiv:2204.12729
• Selective Cross-Task Distillation
  25 Apr 2022 · 0 repositories · arXiv:2204.11526
• Boosting Pruned Networks with Linear Over-parameterization
  25 Apr 2022 · 0 repositories · arXiv:2204.11444
• On-Device Next-Item Recommendation with Self-Supervised Knowledge Distillation
  23 Apr 2022 · 1 repository · arXiv:2204.11091
• Learning to Purification for Unsupervised Person Re-identification
  21 Apr 2022 · 0 repositories · arXiv:2204.09931
• Unseen Object Instance Segmentation with Fully Test-time RGB-D Embeddings Adaptation
  21 Apr 2022 · 0 repositories · arXiv:2204.09847
• DialoKG: Knowledge-Structure Aware Task-Oriented Dialogue Generation
  19 Apr 2022 · 1 repository · arXiv:2204.09149
• Modeling Missing Annotations for Incremental Learning in Object Detection
  19 Apr 2022 · 1 repository · arXiv:2204.08766
• Multi-Modal Few-Shot Object Detection with Meta-Learning-Based Cross-Modal Prompting
  16 Apr 2022 · 0 repositories · arXiv:2204.07841
• Ensemble diverse hypotheses and knowledge distillation for unsupervised cross-subject adaptation
  15 Apr 2022 · 1 repository · arXiv:2204.07308
• Cross-Image Relational Knowledge Distillation for Semantic Segmentation
  14 Apr 2022 · 1 repository · arXiv:2204.06986
  Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
• DistPro: Searching A Fast Knowledge Distillation Process via Meta Optimization
  12 Apr 2022 · 0 repositories · arXiv:2204.05547
• Localization Distillation for Object Detection
  12 Apr 2022 · 1 repository · arXiv:2204.05957
• LRH-Net: A Multi-Level Knowledge Distillation Approach for Low-Resource Heart Network
  11 Apr 2022 · 1 repository · arXiv:2204.08000
• FOSTER: Feature Boosting and Compression for Class-Incremental Learning
  10 Apr 2022 · 2 repositories · arXiv:2204.04662
  Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 6 unverified (of 8 harvested samples)
• Solving ImageNet: a Unified Scheme for Training any Backbone to Top Results
  7 Apr 2022 · 2 repositories · arXiv:2204.03475
• Overcoming Catastrophic Forgetting in Incremental Object Detection via Elastic Response Distillation
  5 Apr 2022 · 1 repository · arXiv:2204.02136
  Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 6 harvested samples) · 3 pointer-only (licence)
• Towards On-Board Panoptic Segmentation of Multispectral Satellite Images
  5 Apr 2022 · 0 repositories · arXiv:2204.01952
• Co-Teaching for Unsupervised Domain Adaptation and Expansion
  4 Apr 2022 · 1 repository · arXiv:2204.01210
• Using Explainable Boosting Machine to Compare Idiographic and Nomothetic Approaches for Ecological Momentary Assessment Data
  4 Apr 2022 · 0 repositories · arXiv:2204.01689
• A Dual-Contrastive Framework for Low-Resource Cross-Lingual Named Entity Recognition
  2 Apr 2022 · 0 repositories · arXiv:2204.00796
• CL-XABSA: Contrastive Learning for Cross-lingual Aspect-based Sentiment Analysis
  2 Apr 2022 · 1 repository · arXiv:2204.00791
• Class-Incremental Learning by Knowledge Distillation with Adaptive Feature Consolidation
  2 Apr 2022 · 1 repository · arXiv:2204.00895
  Syntology official (archive's flag): 2 ran · 2 ran (of which 2 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified; every one of the 2 samples that ran constructed an object rather than computing a result (of 5 harvested samples) · 5 pointer-only (licence)
• Fast Real-time Personalized Speech Enhancement: End-to-End Enhancement Network (E3Net) and Knowledge Distillation
  2 Apr 2022 · 0 repositories · arXiv:2204.00771
• Distill-VQ: Learning Retrieval Oriented Vector Quantization By Distilling Knowledge from Dense Embeddings
  1 Apr 2022 · 2 repositories · arXiv:2204.00185
  Syntology official (archive's flag): 6 ran · 6 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 8 harvested samples)
• Knowledge distillation with error-correcting transfer learning for wind power prediction
  1 Apr 2022 · 0 repositories · arXiv:2204.00649
• Rethinking Position Bias Modeling with Knowledge Distillation for CTR Prediction
  1 Apr 2022 · 0 repositories · arXiv:2204.00270
• Unified and Effective Ensemble Knowledge Distillation
  1 Apr 2022 · 0 repositories · arXiv:2204.00548
• A Closer Look at Rehearsal-Free Continual Learning
  31 Mar 2022 · 0 repositories · arXiv:2203.17269
• Conditional Autoregressors are Interpretable Classifiers
  31 Mar 2022 · 0 repositories · arXiv:2203.17002
• It's All In the Teacher: Zero-Shot Quantization Brought Closer to the Teacher
  31 Mar 2022 · 1 repository · arXiv:2203.17008
• Adversarial Speaker Distillation for Countermeasure Model on Automatic Speaker Verification
  31 Mar 2022 · 0 repositories · arXiv:2203.17031
• Device-Directed Speech Detection: Regularization via Distillation for Weakly-Supervised Models
  30 Mar 2022 · 0 repositories · arXiv:2203.15975
• Monitored Distillation for Positive Congruent Depth Completion
  30 Mar 2022 · 1 repository · arXiv:2203.16034
• Rainbow Keywords: Efficient Incremental Learning for Online Spoken Keyword Spotting
  30 Mar 2022 · 1 repository · arXiv:2203.16361
• Instance Relation Graph Guided Source-Free Domain Adaptive Object Detection
  29 Mar 2022 · 1 repository · arXiv:2203.15793
• Nix-TTS: Lightweight and End-to-End Text-to-Speech via Module-wise Distillation
  29 Mar 2022 · 1 repository · arXiv:2203.15643
• Doodle It Yourself: Class Incremental Learning by Drawing a Few Sketches
  28 Mar 2022 · 0 repositories · arXiv:2203.14843
• RAVIR: A Dataset and Methodology for the Semantic Segmentation and Quantitative Analysis of Retinal Arteries and Veins in Infrared Reflectance Imaging
  28 Mar 2022 · 0 repositories · arXiv:2203.14928
• Knowledge Distillation with the Reused Teacher Classifier
  26 Mar 2022 · 1 repository · arXiv:2203.14001
  Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
• Uncertainty-aware Contrastive Distillation for Incremental Semantic Segmentation
  26 Mar 2022 · 1 repository · arXiv:2203.14098
• A Cross-Domain Approach for Continuous Impression Recognition from Dyadic Audio-Visual-Physio Signals
  25 Mar 2022 · 0 repositories · arXiv:2203.13932
• PCA-Based Knowledge Distillation Towards Lightweight and Content-Style Balanced Photorealistic Style Transfer Models
  25 Mar 2022 · 1 repository · arXiv:2203.13452
• Ensembling and Knowledge Distilling of Large Sequence Taggers for Grammatical Error Correction
  24 Mar 2022 · 1 repository · arXiv:2203.13064
• Multitask Emotion Recognition Model with Knowledge Distillation and Task Discriminator
  24 Mar 2022 · 0 repositories · arXiv:2203.13072
• R-DFCIL: Relation-Guided Representation Learning for Data-Free Class Incremental Learning
  24 Mar 2022 · 1 repository · arXiv:2203.13104
• Rich Feature Construction for the Optimization-Generalization Dilemma
  24 Mar 2022 · 2 repositories · arXiv:2203.15516
  Syntology official: no sample here; runs from other or unrecorded repositories · 3 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples) · 3 pointer-only (licence)
• Mitigating Gender Bias in Distilled Language Models via Counterfactual Role Reversal
  23 Mar 2022 · 0 repositories · arXiv:2203.12574
• Scale-Equivalent Distillation for Semi-Supervised Object Detection
  23 Mar 2022 · 0 repositories · arXiv:2203.12244
• Channel Self-Supervision for Online Knowledge Distillation
  22 Mar 2022 · 0 repositories · arXiv:2203.11660
• SSD-KD: A Self-supervised Diverse Knowledge Distillation Method for Lightweight Skin Lesion Classification Using Dermoscopic Images
  22 Mar 2022 · 1 repository · arXiv:2203.11490
• Document-Level Relation Extraction with Adaptive Focal Loss and Knowledge Distillation
  21 Mar 2022 · 1 repository · arXiv:2203.10900
• Open-Vocabulary One-Stage Detection with Hierarchical Visual-Language Knowledge Distillation
  20 Mar 2022 · 1 repository · arXiv:2203.10593
  Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 3 harvested samples) · 1 pointer-only (licence)
• Emulating Quantum Dynamics with Neural Networks via Knowledge Distillation
  19 Mar 2022 · 1 repository · arXiv:2203.10200
• A Closer Look at Knowledge Distillation with Features, Logits, and Gradients
  18 Mar 2022 · 0 repositories · arXiv:2203.10163