Methods › General › Knowledge Distillation › Knowledge Distillation › Papers, page 20
Knowledge Distillation
Papers archive 2025-07-28
archive papers tagged: 3,071 · with a code link: 1,258 · where Syntology ran a sample: 320 (276 with a run with no instrument failure, 44 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (320 of 3,071 tagged: 276 with a run with no instrument failure, 44 where every run was a failure of Syntology's instrument)
Page 20 of 31: papers 1,901 to 2,000 of 3,071, newest first by the archive's date (ties by slug), in archive order.
Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code, as “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. It is per sample and not a correctness claim. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from.
-
Effectiveness of Function Matching in Driving Scene Recognition 20 Aug 2022 · 0 repositories · arXiv:2208.09694
-
Mind the Gap in Distilling StyleGANs 18 Aug 2022 · 1 repository · arXiv:2208.08840
-
Quantifying the Knowledge in a DNN to Explain Knowledge Distillation for Classification 18 Aug 2022 · 0 repositories · arXiv:2208.08741
-
Progressive Cross-modal Knowledge Distillation for Human Action Recognition 17 Aug 2022 · 0 repositories · arXiv:2208.08090
-
RAWtoBit: A Fully End-to-end Camera ISP Network 16 Aug 2022 · 0 repositories · arXiv:2208.07639
-
Unsupervised Domain Adaptation for Segmentation with Black-box Source Model 16 Aug 2022 · 0 repositories · arXiv:2208.07769
-
A Knowledge Distillation-Based Backdoor Attack in Federated Learning 12 Aug 2022 · 0 repositories · arXiv:2208.06176
-
BEiT v2: Masked Image Modeling with Vector-Quantized Visual Tokenizers 12 Aug 2022 · 3 repositories · arXiv:2208.06366
-
Non-Autoregressive Sign Language Production via Knowledge Distillation 12 Aug 2022 · 0 repositories · arXiv:2208.06183
-
MixSKD: Self-Knowledge Distillation from Mixup for Image Recognition 11 Aug 2022 · 1 repository · arXiv:2208.05768Syntology official (archive's flag): 3 ran · 3 ran (of which 3 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified; every one of the 3 samples that ran constructed an object rather than computing a result (of 4 harvested samples) · 4 pointer-only (licence)
-
PA-Seg: Learning from Point Annotations for 3D Medical Image Segmentation using Contextual Regularization and Cross Knowledge Distillation 11 Aug 2022 · 1 repository · arXiv:2208.05669
-
SKDCGN: Source-free Knowledge Distillation of Counterfactual Generative Networks using cGANs 8 Aug 2022 · 1 repository · arXiv:2208.04226
-
Label Semantic Knowledge Distillation for Unbiased Scene Graph Generation 7 Aug 2022 · 0 repositories · arXiv:2208.03763
-
Study of Encoder-Decoder Architectures for Code-Mix Search Query Translation 7 Aug 2022 · 0 repositories · arXiv:2208.03713
-
Deep Semi-Supervised and Self-Supervised Learning for Diabetic Retinopathy Detection 4 Aug 2022 · 0 repositories · arXiv:2208.02408
-
Distributional Correlation--Aware Knowledge Distillation for Stock Trading Volume Prediction 4 Aug 2022 · 1 repository · arXiv:2208.07232Syntology official: harvested, nothing ran · 0 ran · 2 unverified (of 2 harvested samples) · 2 pointer-only (licence)
-
KD-SCFNet: Towards More Accurate and Efficient Salient Object Detection via Knowledge Distillation 3 Aug 2022 · 1 repository · arXiv:2208.02178
-
Pose Uncertainty Aware Movement Synchrony Estimation via Spatial-Temporal Graph Transformer 1 Aug 2022 · 0 repositories · arXiv:2208.01161
-
Aggretriever: A Simple Approach to Aggregate Textual Representations for Robust Dense Passage Retrieval 31 Jul 2022 · 1 repository · arXiv:2208.00511
-
Chinese grammatical error correction based on knowledge distillation 31 Jul 2022 · 2 repositories · arXiv:2208.00351
-
Meta-Learning based Degradation Representation for Blind Super-Resolution 28 Jul 2022 · 1 repository · arXiv:2207.13963
-
SDBERT: SparseDistilBERT, a faster and smaller BERT model 28 Jul 2022 · 0 repositories · arXiv:2208.10246
-
NICEST: Noisy Label Correction and Training for Robust Scene Graph Generation 27 Jul 2022 · 0 repositories · arXiv:2207.13316
-
Exploring Generalizable Distillation for Efficient Medical Image Segmentation 26 Jul 2022 · 1 repository · arXiv:2207.12995
-
Domain-invariant Feature Exploration for Domain Generalization 25 Jul 2022 · 1 repository · arXiv:2207.12020Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 6 harvested samples)
-
Few-Shot Object Detection by Knowledge Distillation Using Bag-of-Visual-Words Representations 25 Jul 2022 · 0 repositories · arXiv:2207.12049
-
HIRE: Distilling High-order Relational Knowledge From Heterogeneous Graph Neural Networks 25 Jul 2022 · 0 repositories · arXiv:2207.11887
-
Handling Data Heterogeneity in Federated Learning via Knowledge Distillation and Fusion 23 Jul 2022 · 1 repository · arXiv:2207.11447
-
Online Knowledge Distillation via Mutual Contrastive Learning for Visual Recognition 23 Jul 2022 · 2 repositories · arXiv:2207.11518
-
Spatial-Channel Token Distillation for Vision MLPs 23 Jul 2022 · 1 repository
-
Few-Shot Class-Incremental Learning via Entropy-Regularized Data-Free Replay 22 Jul 2022 · 1 repository · arXiv:2207.11213Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 2 harvested samples)
-
Federated Semi-Supervised Domain Adaptation via Knowledge Transfer 21 Jul 2022 · 0 repositories · arXiv:2207.10727
-
Many-to-One Knowledge Distillation of Real-Time Epileptic Seizure Detection for Low-Power Wearable Internet of Things Systems 20 Jul 2022 · 0 repositories · arXiv:2208.00885
-
Model Compression for Resource-Constrained Mobile Robots 20 Jul 2022 · 0 repositories · arXiv:2207.10082
-
Context Unaware Knowledge Distillation for Image Retrieval 19 Jul 2022 · 1 repository · arXiv:2207.09070
-
FedX: Unsupervised Federated Learning with Cross Knowledge Distillation 19 Jul 2022 · 1 repository · arXiv:2207.09158
-
Informative knowledge distillation for image anomaly segmentation 19 Jul 2022 · 1 repository
-
Learning Knowledge Representation with Meta Knowledge Distillation for Single Image Super-Resolution 18 Jul 2022 · 0 repositories · arXiv:2207.08356
-
Rethinking Data Augmentation for Robust Visual Question Answering 18 Jul 2022 · 1 repository · arXiv:2207.08739Syntology official: harvested, nothing ran · 0 ran · 1 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
Subclass Knowledge Distillation with Known Subclass Labels 17 Jul 2022 · 0 repositories · arXiv:2207.08063
-
Deep versus Wide: An Analysis of Student Architectures for Task-Agnostic Knowledge Distillation of Self-Supervised Speech Models 14 Jul 2022 · 0 repositories · arXiv:2207.06867
-
Dynamic Low-Resolution Distillation for Cost-Efficient End-to-End Text Spotting 14 Jul 2022 · 1 repository · arXiv:2207.06694
-
Large-scale Knowledge Distillation with Elastic Heterogeneous Computing Resources 14 Jul 2022 · 1 repository · arXiv:2207.06667
-
DSPNet: Towards Slimmable Pretrained Networks based on Discriminative Self-supervised Learning 13 Jul 2022 · 0 repositories · arXiv:2207.06075
-
Re2G: Retrieve, Rerank, Generate 13 Jul 2022 · 1 repository · arXiv:2207.06300Syntology official (archive's flag): 7 ran · 7 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 8 harvested samples) · 1 pointer-only (licence)
-
SlimSeg: Slimmable Semantic Segmentation with Boundary Supervision 13 Jul 2022 · 0 repositories · arXiv:2207.06242
-
Cross-Architecture Knowledge Distillation 12 Jul 2022 · 0 repositories · arXiv:2207.05273
-
Distilled Non-Semantic Speech Embeddings with Binary Neural Networks for Low-Resource Devices 12 Jul 2022 · 1 repository · arXiv:2207.05784
-
HEAD: HEtero-Assists Distillation for Heterogeneous Object Detectors 12 Jul 2022 · 1 repository · arXiv:2207.05345
-
Normalized Feature Distillation for Semantic Segmentation 12 Jul 2022 · 0 repositories · arXiv:2207.05256
-
1st Place Solution to the EPIC-Kitchens Action Anticipation Challenge 2022 10 Jul 2022 · 0 repositories · arXiv:2207.05730
-
2DPASS: 2D Priors Assisted Semantic Segmentation on LiDAR Point Clouds 10 Jul 2022 · 1 repository · arXiv:2207.04397
-
FairDistillation: Mitigating Stereotyping in Language Models 10 Jul 2022 · 1 repository · arXiv:2207.04546
-
Improving Streaming End-to-End ASR on Transformer-based Causal Models with Encoder States Revision Strategies 6 Jul 2022 · 0 repositories · arXiv:2207.02495
-
Low-resource Low-footprint Wake-word Detection using Knowledge Distillation 6 Jul 2022 · 0 repositories · arXiv:2207.03331
-
A Generative Framework for Personalized Learning and Estimation: Theory, Algorithms, and Privacy 5 Jul 2022 · 0 repositories · arXiv:2207.01771
-
ACT-Net: Asymmetric Co-Teacher Network for Semi-supervised Memory-efficient Medical Image Segmentation 5 Jul 2022 · 1 repository · arXiv:2207.01900
-
GLANCE: Global to Local Architecture-Neutral Concept-based Explanations 5 Jul 2022 · 0 repositories · arXiv:2207.01917
-
Open-Vocabulary Multi-Label Classification via Multi-Modal Knowledge Transfer 5 Jul 2022 · 1 repository · arXiv:2207.01887Syntology official (archive's flag): 5 ran · 5 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 3 where Syntology's instrument failed) · 2 unverified (of 7 harvested samples) · 2 pointer-only (licence)
-
VEM²L: A Plug-and-play Framework for Fusing Text and Structure Knowledge on Sparse Knowledge Graph Completion 4 Jul 2022 · 0 repositories · arXiv:2207.01528
-
PrUE: Distilling Knowledge from Sparse Teacher Networks 3 Jul 2022 · 1 repository · arXiv:2207.00586
-
ListBERT: Learning to Rank E-commerce products with Listwise BERT 30 Jun 2022 · 0 repositories · arXiv:2206.15198
-
Extreme compression of sentence-transformer ranker models: faster inference, longer battery life, and less storage on edge devices 29 Jun 2022 · 0 repositories · arXiv:2207.12852
-
Knowledge Distillation of Transformer-based Language Models Revisited 29 Jun 2022 · 0 repositories · arXiv:2206.14366
-
Revisiting Label Smoothing and Knowledge Distillation Compatibility: What was Missing? 29 Jun 2022 · 1 repository · arXiv:2206.14532Syntology official (archive's flag): 10 ran · 10 ran (of which 0 constructed an object rather than computing a result; 9 with no instrument failure: 0 honoured, 0 violated, 9 with no contract checked; 1 where Syntology's instrument failed) · 6 unverified (of 16 harvested samples) · 1 pointer-only (licence)
-
Cooperative Retriever and Ranker in Deep Recommenders 28 Jun 2022 · 1 repository · arXiv:2206.14649
-
QTI Submission to DCASE 2021: residual normalization for device-imbalanced acoustic scene classification with efficient design 28 Jun 2022 · 0 repositories · arXiv:2206.13909
-
Representative Teacher Keys for Knowledge Distillation Model Compression Based on Attention Mechanism for Image Classification 26 Jun 2022 · 0 repositories · arXiv:2206.12788
-
Feature Representation Learning for Robust Retinal Disease Detection from Optical Coherence Tomography Images 24 Jun 2022 · 1 repository · arXiv:2206.12136
-
Mixed Sample Augmentation for Online Distillation 24 Jun 2022 · 0 repositories · arXiv:2206.12370
-
Knowledge Distillation via Weighted Ensemble of Teaching Assistants 23 Jun 2022 · 0 repositories · arXiv:2206.12005
-
Conformer with dual-mode chunked attention for joint online and offline ASR 22 Jun 2022 · 0 repositories · arXiv:2206.11157
-
Knowledge Distillation for Oriented Object Detection on Aerial Images 20 Jun 2022 · 0 repositories · arXiv:2206.09796
-
MetaFed: Federated Learning among Federations with Cyclic Knowledge Distillation for Personalized Healthcare 17 Jun 2022 · 2 repositories · arXiv:2206.08516
-
Multi scale Feature Extraction and Fusion for Online Knowledge Distillation 16 Jun 2022 · 0 repositories · arXiv:2206.08224
-
FreeKD: Free-direction Knowledge Distillation for Graph Neural Networks 14 Jun 2022 · 0 repositories · arXiv:2206.06561
-
FreeTransfer-X: Safe and Label-Free Cross-Lingual Transfer from Off-the-Shelf Models 14 Jun 2022 · 0 repositories · arXiv:2206.06586
-
Toward Student-Oriented Teacher Network Training For Knowledge Distillation 14 Jun 2022 · 0 repositories · arXiv:2206.06661
-
Federated Bayesian Neural Regression: A Scalable Global Federated Gaussian Process 13 Jun 2022 · 0 repositories · arXiv:2206.06357
-
The Modality Focusing Hypothesis: Towards Understanding Crossmodal Knowledge Distillation 13 Jun 2022 · 1 repository · arXiv:2206.06487Syntology official: harvested, nothing ran · 0 ran · 1 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
Reducing Capacity Gap in Knowledge Distillation with Review Mechanism for Crowd Counting 11 Jun 2022 · 1 repository · arXiv:2206.05475
-
Knowledge Distillation Decision Tree for Unravelling Black-box Machine Learning Models 9 Jun 2022 · 0 repositories · arXiv:2206.04661
-
Narrowing the Coordinate-frame Gap in Behavior Prediction Models: Distillation for Efficient and Accurate Scene-centric Motion Forecasting 8 Jun 2022 · 0 repositories · arXiv:2206.03970
-
cViL: Cross-Lingual Training of Vision-Language Models using Knowledge Distillation 7 Jun 2022 · 1 repository · arXiv:2206.03354
-
Confidence-aware Self-Semantic Distillation on Knowledge Graph Embedding 7 Jun 2022 · 0 repositories · arXiv:2206.02963
-
Lip-Listening: Mixing Senses to Understand Lips using Cross Modality Knowledge Distillation for Word-Based Models 5 Jun 2022 · 0 repositories · arXiv:2207.05692
-
Point-to-Voxel Knowledge Distillation for LiDAR Semantic Segmentation 5 Jun 2022 · 0 repositories · arXiv:2206.02099
-
Vanilla Feature Distillation for Improving the Accuracy-Robustness Trade-Off in Adversarial Training 5 Jun 2022 · 0 repositories · arXiv:2206.02158
-
Extreme Compression for Pre-trained Transformers Made Simple and Efficient 4 Jun 2022 · 1 repository · arXiv:2206.01859
-
Guided Deep Metric Learning 4 Jun 2022 · 0 repositories · arXiv:2206.02029
-
ZeroQuant: Efficient and Affordable Post-Training Quantization for Large-Scale Transformers 4 Jun 2022 · 3 repositories · arXiv:2206.01861Syntology official: harvested for another paper · 0 ran · 1 unverified (of 1 harvested sample)
-
3D-Augmented Contrastive Knowledge Distillation for Image-based Object Pose Estimation 2 Jun 2022 · 0 repositories · arXiv:2206.02531
-
Generalized Supervised Contrastive Learning 1 Jun 2022 · 0 repositories · arXiv:2206.00384
-
VFed-SSD: Towards Practical Vertical Federated Advertising 31 May 2022 · 0 repositories · arXiv:2205.15987
-
Spectral Maps for Learning on Subgraphs 30 May 2022 · 0 repositories · arXiv:2205.14938
-
Knowledge Distillation for 6D Pose Estimation by Aligning Distributions of Local Predictions 30 May 2022 · 0 repositories · arXiv:2205.14971
-
RLx2: Training a Sparse Deep Reinforcement Learning Model from Scratch 30 May 2022 · 1 repository · arXiv:2205.15043
-
Towards Efficient 3D Object Detection with Knowledge Distillation 30 May 2022 · 1 repository · arXiv:2205.15156Syntology official: harvested, nothing ran · 0 ran · 4 unverified (of 4 harvested samples)
-
A General Multiple Data Augmentation Based Framework for Training Deep Neural Networks 29 May 2022 · 0 repositories · arXiv:2205.14606
-
MiniDisc: Minimal Distillation Schedule for Language Model Compression 29 May 2022 · 1 repository · arXiv:2205.14570