Browse State-of-the-Art › Knowledge Distillation › Papers, page 34

Knowledge Distillation

Papers archive 2025-07-28

archive papers tagged: 4,240 · with a code link: 1,740 · where Syntology ran a sample: 451 (380 with a run with no instrument failure, 71 where every run was a failure of Syntology's instrument) Syntology

Show: all tagged papersonly where code ran (451 of 4,240 tagged: 380 with a run with no instrument failure, 71 where every run was a failure of Syntology's instrument)

Page 34 of 43: papers 3,301 to 3,400 of 4,240, in archive order: by repositories listed in the archive (most first), then newest first, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers that list no repository come after every paper that lists one.

Papers without a page here are shown as plain text. A Syntology line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the figure “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code); hover it for the repositories the samples that ran came from. Abstracts are on each paper's page.

• ListBERT: Learning to Rank E-commerce products with Listwise BERT
  30 Jun 2022 0 repositories listed
• Extreme compression of sentence-transformer ranker models: faster inference, longer battery life, and less storage on edge devices
  29 Jun 2022 0 repositories listed
• Knowledge Distillation of Transformer-based Language Models Revisited
  29 Jun 2022 0 repositories listed
• QTI Submission to DCASE 2021: residual normalization for device-imbalanced acoustic scene classification with efficient design
  28 Jun 2022 0 repositories listed
• Revisiting Architecture-aware Knowledge Distillation: Smaller Models and Faster Search
  27 Jun 2022 0 repositories listed
• Representative Teacher Keys for Knowledge Distillation Model Compression Based on Attention Mechanism for Image Classification
  26 Jun 2022 0 repositories listed
• Mixed Sample Augmentation for Online Distillation
  24 Jun 2022 0 repositories listed
• Knowledge Distillation via Weighted Ensemble of Teaching Assistants
  23 Jun 2022 0 repositories listed
• Conformer with dual-mode chunked attention for joint online and offline ASR
  22 Jun 2022 0 repositories listed
• Knowledge Distillation for Oriented Object Detection on Aerial Images
  20 Jun 2022 0 repositories listed
• Revisiting Self-Distillation
  17 Jun 2022 0 repositories listed
• Multi scale Feature Extraction and Fusion for Online Knowledge Distillation
  16 Jun 2022 0 repositories listed
• FreeKD: Free-direction Knowledge Distillation for Graph Neural Networks
  14 Jun 2022 0 repositories listed
• FreeTransfer-X: Safe and Label-Free Cross-Lingual Transfer from Off-the-Shelf Models
  14 Jun 2022 0 repositories listed
• Toward Student-Oriented Teacher Network Training For Knowledge Distillation
  14 Jun 2022 0 repositories listed
• Federated Bayesian Neural Regression: A Scalable Global Federated Gaussian Process
  13 Jun 2022 0 repositories listed
• Robust Distillation for Worst-class Performance
  13 Jun 2022 0 repositories listed
• Knowledge Distillation Decision Tree for Unravelling Black-box Machine Learning Models
  9 Jun 2022 0 repositories listed
• SDQ: Stochastic Differentiable Quantization with Mixed Precision
  9 Jun 2022 0 repositories listed
• Narrowing the Coordinate-frame Gap in Behavior Prediction Models: Distillation for Efficient and Accurate Scene-centric Motion Forecasting
  8 Jun 2022 0 repositories listed
• Confidence-aware Self-Semantic Distillation on Knowledge Graph Embedding
  7 Jun 2022 0 repositories listed
• Self-Knowledge Distillation based Self-Supervised Learning for Covid-19 Detection from Chest X-Ray Images
  7 Jun 2022 0 repositories listed
• Reconsidering Learning Objectives in Unbiased Recommendation with Unobserved Confounders
  7 Jun 2022 0 repositories listed
• Lip-Listening: Mixing Senses to Understand Lips using Cross Modality Knowledge Distillation for Word-Based Models
  5 Jun 2022 0 repositories listed
• Point-to-Voxel Knowledge Distillation for LiDAR Semantic Segmentation
  5 Jun 2022 0 repositories listed
• Vanilla Feature Distillation for Improving the Accuracy-Robustness Trade-Off in Adversarial Training
  5 Jun 2022 0 repositories listed
• Guided Deep Metric Learning
  4 Jun 2022 0 repositories listed
• 3D-Augmented Contrastive Knowledge Distillation for Image-based Object Pose Estimation
  2 Jun 2022 0 repositories listed
• Generalized Supervised Contrastive Learning
  1 Jun 2022 0 repositories listed
• Detecting Optimism in Tweets using Knowledge Distillation and Linguistic Analysis of Optimism
  1 Jun 2022 0 repositories listed
• Searching for COMETINHO: The Little Metric That Could
  1 Jun 2022 0 repositories listed
• VFed-SSD: Towards Practical Vertical Federated Advertising
  31 May 2022 0 repositories listed
• What Knowledge Gets Distilled in Knowledge Distillation?
  31 May 2022 0 repositories listed
• Spectral Maps for Learning on Subgraphs
  30 May 2022 0 repositories listed
• Knowledge Distillation for 6D Pose Estimation by Aligning Distributions of Local Predictions
  30 May 2022 0 repositories listed
• A General Multiple Data Augmentation Based Framework for Training Deep Neural Networks
  29 May 2022 0 repositories listed
• Parameter-Efficient and Student-Friendly Knowledge Distillation
  28 May 2022 0 repositories listed
• DFM: Dialogue Foundation Model for Universal Large-Scale Dialogue-Oriented Task Learning
  25 May 2022 0 repositories listed
• Region-aware Knowledge Distillation for Efficient Image-to-Image Translation
  25 May 2022 0 repositories listed
• Do we need Label Regularization to Fine-tune Pre-trained Language Models?
  25 May 2022 0 repositories listed
• Simple Regularisation for Uncertainty-Aware Knowledge Distillation
  19 May 2022 0 repositories listed
• ERNIE-Search: Bridging Cross-Encoder with Dual-Encoder via Self On-the-fly Distillation for Dense Passage Retrieval
  18 May 2022 0 repositories listed
• Prompting to Distill: Boosting Data-Free Knowledge Distillation via Reinforced Prompt
  16 May 2022 0 repositories listed
• Not to Overfit or Underfit the Source Domains? An Empirical Study of Domain Generalization in Question Answering
  15 May 2022 0 repositories listed
• D3T-GAN: Data-Dependent Domain Transfer GANs for Few-shot Image Generation
  12 May 2022 0 repositories listed
• "Teaching Independent Parts Separately" (TIPSy-GAN) : Improving Accuracy and Stability in Unsupervised Adversarial 2D to 3D Pose Estimation
  12 May 2022 0 repositories listed
• Incremental-DETR: Incremental Few-Shot Object Detection via Self-Supervised Learning
  9 May 2022 0 repositories listed
• Data-Free Adversarial Knowledge Distillation for Graph Neural Networks
  8 May 2022 0 repositories listed
• Automatic Block-wise Pruning with Auxiliary Gating Structures for Deep Convolutional Neural Networks
  7 May 2022 0 repositories listed
• ConceptDistil: Model-Agnostic Distillation of Concept Explanations
  7 May 2022 0 repositories listed
• Distilling Inter-Class Distance for Semantic Segmentation
  7 May 2022 0 repositories listed
• A Deep Reinforcement Learning Framework for Rapid Diagnosis of Whole Slide Pathological Images
  5 May 2022 0 repositories listed
• Holistic Approach to Measure Sample-level Adversarial Vulnerability and its Utility in Building Trustworthy Systems
  5 May 2022 0 repositories listed
• FedSPLIT: One-Shot Federated Recommendation System Based on Non-negative Joint Matrix Factorization and Knowledge Distillation
  4 May 2022 0 repositories listed
• Attention-based Knowledge Distillation in Multi-attention Tasks: The Impact of a DCT-driven Loss
  4 May 2022 0 repositories listed
• FedDKD: Federated Learning with Decentralized Knowledge Distillation
  2 May 2022 0 repositories listed
• An Unsupervised Multiple-Task and Multiple-Teacher Model for Cross-lingual Named Entity Recognition
  1 May 2022 0 repositories listed
• CMU’s IWSLT 2022 Dialect Speech Translation System
  1 May 2022 0 repositories listed
• Domain-specific knowledge distillation yields smaller and better models for conversational commerce
  1 May 2022 0 repositories listed
• Knowledge Distillation Meets Few-Shot Learning: An Approach for Few-Shot Intent Classification Within and Across Domains
  1 May 2022 0 repositories listed
• Low Resource Causal Event Detection from Biomedical Literature
  1 May 2022 0 repositories listed
• Model Distillation for Faithful Explanations of Medical Code Predictions
  1 May 2022 0 repositories listed
• The Xiaomi Text-to-Text Simultaneous Speech Translation System for IWSLT 2022
  1 May 2022 0 repositories listed
• Multiple Degradation and Reconstruction Network for Single Image Denoising via Knowledge Distillation
  29 Apr 2022 0 repositories listed
• DearKD: Data-Efficient Early Knowledge Distillation for Vision Transformers
  27 Apr 2022 0 repositories listed
• Human-Centered Prior-Guided and Task-Dependent Multi-Task Representation Learning for Action Recognition Pre-Training
  27 Apr 2022 0 repositories listed
• Transfer Learning with Pre-trained Conditional Generative Models
  27 Apr 2022 0 repositories listed
• Improving Feature Generalizability with Multitask Learning in Class Incremental Learning
  26 Apr 2022 0 repositories listed
• Selective Cross-Task Distillation
  25 Apr 2022 0 repositories listed
• Boosting Pruned Networks with Linear Over-parameterization
  25 Apr 2022 0 repositories listed
• Joint Feature Distribution Alignment Learning for NIR-VIS and VIS-VIS Face Recognition
  25 Apr 2022 0 repositories listed
• Revisiting Graph based Social Recommendation: A Distillation Enhanced Social Graph Network
  25 Apr 2022 0 repositories listed
• Learning to Purification for Unsupervised Person Re-identification
  21 Apr 2022 0 repositories listed
• Unseen Object Instance Segmentation with Fully Test-time RGB-D Embeddings Adaptation
  21 Apr 2022 0 repositories listed
• HRPose: Real-Time High-Resolution 6D Pose Estimation Network Using Knowledge Distillation
  20 Apr 2022 0 repositories listed
• Multi-Modal Few-Shot Object Detection with Meta-Learning-Based Cross-Modal Prompting
  16 Apr 2022 0 repositories listed
• CILDA: Contrastive Data Augmentation using Intermediate Layer Knowledge Distillation
  15 Apr 2022 0 repositories listed
• Spatial Likelihood Voting with Self-Knowledge Distillation for Weakly Supervised Object Detection
  14 Apr 2022 0 repositories listed
• Impossible Triangle: What's Next for Pre-trained Language Models?
  13 Apr 2022 0 repositories listed
• CoupleFace: Relation Matters for Face Recognition Distillation
  12 Apr 2022 0 repositories listed
• DistPro: Searching A Fast Knowledge Distillation Process via Meta Optimization
  12 Apr 2022 0 repositories listed
• Towards On-Board Panoptic Segmentation of Multispectral Satellite Images
  5 Apr 2022 0 repositories listed
• CDKT-FL: Cross-Device Knowledge Transfer using Proxy Dataset in Federated Learning
  4 Apr 2022 0 repositories listed
• Using Explainable Boosting Machine to Compare Idiographic and Nomothetic Approaches for Ecological Momentary Assessment Data
  4 Apr 2022 0 repositories listed
• DST: Dynamic Substitute Training for Data-free Black-box Attack
  3 Apr 2022 0 repositories listed
• A Dual-Contrastive Framework for Low-Resource Cross-Lingual Named Entity Recognition
  2 Apr 2022 0 repositories listed
• Fast Real-time Personalized Speech Enhancement: End-to-End Enhancement Network (E3Net) and Knowledge Distillation
  2 Apr 2022 0 repositories listed
• Knowledge distillation with error-correcting transfer learning for wind power prediction
  1 Apr 2022 0 repositories listed
• Preventing Distillation-based Attacks on Neural Network IP
  1 Apr 2022 0 repositories listed
• Rethinking Position Bias Modeling with Knowledge Distillation for CTR Prediction
  1 Apr 2022 0 repositories listed
• Unified and Effective Ensemble Knowledge Distillation
  1 Apr 2022 0 repositories listed
• A Closer Look at Rehearsal-Free Continual Learning
  31 Mar 2022 0 repositories listed
• Conditional Autoregressors are Interpretable Classifiers
  31 Mar 2022 0 repositories listed
• Adversarial Speaker Distillation for Countermeasure Model on Automatic Speaker Verification
  31 Mar 2022 0 repositories listed
• Device-Directed Speech Detection: Regularization via Distillation for Weakly-Supervised Models
  30 Mar 2022 0 repositories listed
• Doodle It Yourself: Class Incremental Learning by Drawing a Few Sketches
  28 Mar 2022 0 repositories listed
• Knowledge Distillation: Bad Models Can Be Good Role Models
  28 Mar 2022 0 repositories listed
• RAVIR: A Dataset and Methodology for the Semantic Segmentation and Quantitative Analysis of Retinal Arteries and Veins in Infrared Reflectance Imaging
  28 Mar 2022 0 repositories listed
• A Cross-Domain Approach for Continuous Impression Recognition from Dyadic Audio-Visual-Physio Signals
  25 Mar 2022 0 repositories listed
• Class-Incremental Learning for Action Recognition in Videos
  25 Mar 2022 0 repositories listed Syntology 6 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 1 honoured, 0 violated, 3 with no contract checked; 2 where Syntology's instrument failed) · 5 unverified (of 11 harvested samples) · 2 pointer-only (licence)

Syntology lines on 1 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced; each line links to that paper's sample list. Syntology's record for this page has not changed since 2026-09-28, the first build that kept a record date for it; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.