Browse State-of-the-Art › Knowledge Distillation › Papers, page 40

Knowledge Distillation

Papers archive 2025-07-28

archive papers tagged: 4,240 · with a code link: 1,740 · where Syntology ran a sample: 451 (380 with a run with no instrument failure, 71 where every run was a failure of Syntology's instrument) Syntology

Show: all tagged papersonly where code ran (451 of 4,240 tagged: 380 with a run with no instrument failure, 71 where every run was a failure of Syntology's instrument)

Page 40 of 43: papers 3,901 to 4,000 of 4,240, in archive order: by repositories listed in the archive (most first), then newest first, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers that list no repository come after every paper that lists one.

Papers without a page here are shown as plain text. A Syntology line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the figure “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code); hover it for the repositories the samples that ran came from. Abstracts are on each paper's page.

• Distilling Structured Knowledge for Text-Based Relational Reasoning
  1 Nov 2020 0 repositories listed
• Fast End-to-end Coreference Resolution for Korean
  1 Nov 2020 0 repositories listed
• FedED: Federated Learning via Ensemble Distillation for Medical Relation Extraction
  1 Nov 2020 0 repositories listed
• High Performance Natural Language Processing
  1 Nov 2020 0 repositories listed
• HW-TSC’s Participation in the WMT 2020 News Translation Shared Task
  1 Nov 2020 0 repositories listed
• IIE’s Neural Machine Translation Systems for WMT20
  1 Nov 2020 0 repositories listed
• MixKD: Towards Efficient Distillation of Large-scale Language Models
  1 Nov 2020 0 repositories listed
• The NiuTrans Machine Translation Systems for WMT20
  1 Nov 2020 0 repositories listed
• Using the Past Knowledge to Improve Sentiment Classification
  1 Nov 2020 0 repositories listed
• ProxylessKD: Direct Knowledge Distillation with Inherited Classifier for Face Recognition
  31 Oct 2020 0 repositories listed
• Cross-lingual Machine Reading Comprehension with Language Branch Knowledge Distillation
  27 Oct 2020 0 repositories listed
• Activation Map Adaptation for Effective Knowledge Distillation
  26 Oct 2020 0 repositories listed
• Empowering Knowledge Distillation via Open Set Recognition for Robust 3D Point Cloud Classification
  25 Oct 2020 0 repositories listed
• Improved Synthetic Training for Reading Comprehension
  24 Oct 2020 0 repositories listed
• Generating Long Financial Report using Conditional Variational Autoencoders with Knowledge Distillation
  23 Oct 2020 0 repositories listed
• Iterative Graph Self-Distillation
  23 Oct 2020 0 repositories listed
• Contextualized Attention-based Knowledge Transfer for Spoken Conversational Question Answering
  21 Oct 2020 0 repositories listed
• Knowledge Distillation for Improved Accuracy in Spoken Question Answering
  21 Oct 2020 0 repositories listed
• Edge Bias in Federated Learning and its Solution by Buffered Knowledge Distillation
  20 Oct 2020 0 repositories listed
• Fast Video Salient Object Detection via Spatiotemporal Knowledge Distillation
  20 Oct 2020 0 repositories listed
• Knowledge Distillation in Wide Neural Networks: Risk Bound, Data Efficiency and Imperfect Teacher
  20 Oct 2020 0 repositories listed
• Comparing Fisher Information Regularization with Distillation for DNN Quantization
  19 Oct 2020 0 repositories listed
• Noisy Neural Network Compression for Analog Storage Devices
  19 Oct 2020 0 repositories listed
• AutoADR: Automatic Model Design for Ad Relevance
  14 Oct 2020 0 repositories listed
• MulDE: Multi-teacher Knowledge Distillation for Low-dimensional Knowledge Graph Embeddings
  14 Oct 2020 0 repositories listed
• Collective Wisdom: Improving Low-resource Neural Machine Translation using Adaptive Knowledge Distillation
  12 Oct 2020 0 repositories listed
• Dual-mode ASR: Unify and Improve Streaming ASR with Full-context Modeling
  12 Oct 2020 0 repositories listed
• Adversarial Self-Supervised Data-Free Distillation for Text Classification
  10 Oct 2020 0 repositories listed
• Distilling a Deep Neural Network into a Takagi-Sugeno-Kang Fuzzy Inference System
  10 Oct 2020 0 repositories listed
• Be Your Own Best Competitor! Multi-Branched Adversarial Knowledge Transfer
  9 Oct 2020 0 repositories listed
• Locally Linear Region Knowledge Distillation
  9 Oct 2020 0 repositories listed
• DiPair: Fast and Accurate Distillation for Trillion-Scale Text Matching and Pair Modeling
  7 Oct 2020 0 repositories listed
• Galileo at SemEval-2020 Task 12: Multi-lingual Learning for Offensive Language Identification using Pre-trained Language Models
  7 Oct 2020 0 repositories listed
• Deep Representation Learning of Patient Data from Electronic Health Records (EHR): A Systematic Review
  6 Oct 2020 0 repositories listed
• A Survey on Deep Neural Network Compression: Challenges, Overview, and Solutions
  5 Oct 2020 0 repositories listed
• Towards Cross-modality Medical Image Segmentation with Online Mutual Knowledge Distillation
  4 Oct 2020 0 repositories listed
• Neighbourhood Distillation: On the benefits of non end-to-end distillation
  2 Oct 2020 0 repositories listed
• Online Knowledge Distillation via Multi-branch Diversity Enhancement
  2 Oct 2020 0 repositories listed
• WeChat Neural Machine Translation Systems for WMT20
  1 Oct 2020 0 repositories listed
• Pea-KD: Parameter-efficient and Accurate Knowledge Distillation on BERT
  30 Sep 2020 0 repositories listed
• Stochastic Precision Ensemble: Self-Knowledge Distillation for Quantized Deep Neural Networks
  30 Sep 2020 0 repositories listed
• Distillation of Weighted Automata from Recurrent Neural Networks using a Spectral Approach
  28 Sep 2020 0 repositories listed
• Kernel Based Progressive Distillation for Adder Neural Networks
  28 Sep 2020 0 repositories listed
• Pea-KD: Parameter-efficient and accurate Knowledge Distillation
  28 Sep 2020 0 repositories listed
• Multi-Frame to Single-Frame: Knowledge Distillation for 3D Object Detection
  24 Sep 2020 0 repositories listed
• Sim-to-Real Transfer in Deep Reinforcement Learning for Robotics: a Survey
  24 Sep 2020 0 repositories listed
• Open-set Short Utterance Forensic Speaker Verification using Teacher-Student Network with Explicit Inductive Bias
  21 Sep 2020 0 repositories listed
• EI-MTD:Moving Target Defense for Edge Intelligence against Adversarial Attacks
  19 Sep 2020 0 repositories listed
• Introspective Learning by Distilling Knowledge from Online Self-explanation
  19 Sep 2020 0 repositories listed
• Weight Distillation: Transferring the Knowledge in Neural Network Parameters
  19 Sep 2020 0 repositories listed
• Efficient Transformer-based Large Scale Language Representations using Hardware-friendly Block Structured Pruning
  17 Sep 2020 0 repositories listed
• Mimic and Conquer: Heterogeneous Tree Structure Distillation for Syntactic NLP
  16 Sep 2020 0 repositories listed
• Collaborative Distillation in the Parameter and Spectrum Domains for Video Action Recognition
  15 Sep 2020 0 repositories listed
• BoostingBERT:Integrating Multi-Class Boosting into BERT for NLP Tasks
  13 Sep 2020 0 repositories listed
• DualDE: Dually Distilling Knowledge Graph Embedding for Faster and Cheaper Reasoning
  13 Sep 2020 0 repositories listed
• SSKD: Self-Supervised Knowledge Distillation for Cross Domain Adaptive Person Re-Identification
  13 Sep 2020 0 repositories listed
• Extending Label Smoothing Regularization with Self-Knowledge Distillation
  11 Sep 2020 0 repositories listed
• On the Orthogonality of Knowledge Distillation with Other Techniques: From an Ensemble Perspective
  9 Sep 2020 0 repositories listed
• Lifelong Object Detection
  2 Sep 2020 0 repositories listed
• SAIL: Self-Augmented Graph Contrastive Learning
  2 Sep 2020 0 repositories listed
• Classification of Diabetic Retinopathy Using Unlabeled Data and Knowledge Distillation
  1 Sep 2020 0 repositories listed
• MetaDistiller: Network Self-Boosting via Meta-Learned Top-Down Distillation
  27 Aug 2020 0 repositories listed
• Point Adversarial Self Mining: A Simple Method for Facial Expression Recognition
  26 Aug 2020 0 repositories listed
• Learn to Talk via Proactive Knowledge Transfer
  23 Aug 2020 0 repositories listed
• Multi-Person Full Body Pose Estimation
  23 Aug 2020 0 repositories listed
• Rectified Decision Trees: Exploring the Landscape of Interpretable and Effective Machine Learning
  21 Aug 2020 0 repositories listed
• Learning to Extract Attribute Value from Product via Question Answering: A Multi-task Approach
  20 Aug 2020 0 repositories listed
• Cascaded channel pruning using hierarchical self-distillation
  16 Aug 2020 0 repositories listed
• An Ensemble of Knowledge Sharing Models for Dynamic Hand Gesture Recognition
  13 Aug 2020 0 repositories listed
• Compression of Deep Learning Models for Text: A Survey
  12 Aug 2020 0 repositories listed
• Towards Unsupervised Crowd Counting via Regression-Detection Bi-knowledge Transfer
  12 Aug 2020 0 repositories listed
• Compact Speaker Embedding: lrx-vector
  11 Aug 2020 0 repositories listed
• S2OSC: A Holistic Semi-Supervised Approach for Open Set Classification
  11 Aug 2020 0 repositories listed
• Knowledge Distillation-aided End-to-End Learning for Linear Precoding in Multiuser MIMO Downlink Systems with Finite-Rate Feedback
  10 Aug 2020 0 repositories listed
• Knowledge Distillation and Data Selection for Semi-Supervised Learning in CTC Acoustic Models
  10 Aug 2020 0 repositories listed
• LRSpeech: Extremely Low-Resource Speech Synthesis and Recognition
  9 Aug 2020 0 repositories listed
• MED-TEX: Transferring and Explaining Knowledge with Less Data from Pretrained Medical Imaging Models
  6 Aug 2020 0 repositories listed
• Teacher-Student Training and Triplet Loss for Facial Expression Recognition under Occlusion
  3 Aug 2020 0 repositories listed
• TutorNet: Towards Flexible Knowledge Distillation for End-to-End Speech Recognition
  3 Aug 2020 0 repositories listed
• Differentiable Feature Aggregation Search for Knowledge Distillation
  2 Aug 2020 0 repositories listed
• AMLN: Adversarial-based Mutual Learning Network for Online Knowledge Distillation
  1 Aug 2020 0 repositories listed
• Exclusivity-Consistency Regularized Knowledge Distillation for Face Recognition
  1 Aug 2020 0 repositories listed
• Local Correlation Consistency for Knowledge Distillation
  1 Aug 2020 0 repositories listed
• Weight Decay Scheduling and Knowledge Distillation for Active Learning
  1 Aug 2020 0 repositories listed
• YOLO in the Dark - Domain Adaptation Method for Merging Multiple Models -
  1 Aug 2020 0 repositories listed
• Dynamic Knowledge Distillation for Black-box Hypothesis Transfer Learning
  24 Jul 2020 0 repositories listed
• Interpretable Foreground Object Search As Knowledge Distillation
  20 Jul 2020 0 repositories listed
• Multi-label Contrastive Predictive Coding
  20 Jul 2020 0 repositories listed
• CovidCare: Transferring Knowledge from Existing EMR to Emerging Epidemic for Interpretable Prognosis
  17 Jul 2020 0 repositories listed
• Knowledge Distillation in Deep Learning and its Applications
  17 Jul 2020 0 repositories listed
• Add a SideNet to your MainNet
  14 Jul 2020 0 repositories listed
• P-KDGAN: Progressive Knowledge Distillation with GANs for One-class Novelty Detection
  14 Jul 2020 0 repositories listed
• Dual-Teacher: Integrating Intra-domain and Inter-domain Teachers for Annotation-efficient Cardiac Segmentation
  13 Jul 2020 0 repositories listed
• Representation Transfer by Optimal Transport
  13 Jul 2020 0 repositories listed
• Data-Efficient Ranking Distillation for Image Retrieval
  10 Jul 2020 0 repositories listed
• Optical Flow Distillation: Towards Efficient and Stable Video Style Transfer
  10 Jul 2020 0 repositories listed
• Interactive Knowledge Distillation
  3 Jul 2020 0 repositories listed
• Knowledge Distillation Beyond Model Compression
  3 Jul 2020 0 repositories listed
• CASIA's System for IWSLT 2020 Open Domain Translation
  1 Jul 2020 0 repositories listed
• Exploring the Limits of Simple Learners in Knowledge Distillation for Document Classification with DocBERT
  1 Jul 2020 0 repositories listed