Methods › General › Knowledge Distillation › Knowledge Distillation › Papers where code ran, page 2
Knowledge Distillation
Papers archive 2025-07-28
archive papers tagged: 3,071 · with a code link: 1,258 · where Syntology ran a sample: 320 (276 with a run with no instrument failure, 44 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (320 of 3,071 tagged: 276 with a run with no instrument failure, 44 where every run was a failure of Syntology's instrument)
Syntology We ran code from the paper's repository; we did not isolate this method inside it.
Page 2 of 4: papers 101 to 200 of the 320 tagged papers where Syntology ran at least one harvested sample (276 with a run with no instrument failure, 44 where every run was a failure of Syntology's instrument), newest first by the archive's date (ties by arXiv id). This is a filter on Syntology's record ordered by date only, not a ranking; a run is not a correctness claim. A paper missing from this list is not a recorded non-run: it may have no arXiv id, no harvested code, or only samples that have not run yet.
Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code, as “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. It is per sample and not a correctness claim. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from.
-
Distilling Out-of-Distribution Robustness from Vision-Language Foundation Models 2 Nov 2023 · 1 repository · arXiv:2311.01441Syntology official (archive's flag): 1 ran · 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; the one sample that ran constructed an object rather than computing a result (of 1 harvested sample)
-
MCC-KD: Multi-CoT Consistent Knowledge Distillation 23 Oct 2023 · 1 repository · arXiv:2310.14747Syntology official (archive's flag): 5 ran · 5 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 7 harvested samples) · 7 pointer-only (licence)
-
Dialogue Chain-of-Thought Distillation for Commonsense-aware Conversational Agents 13 Oct 2023 · 1 repository · arXiv:2310.09343Syntology official: no sample here; runs from other or unrecorded repositories · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 2 harvested samples)
-
Online Speculative Decoding 11 Oct 2023 · 1 repository · arXiv:2310.07177Syntology official (archive's flag): 11 ran · 11 ran (of which 0 constructed an object rather than computing a result; 9 with no instrument failure: 0 honoured, 0 violated, 9 with no contract checked; 2 where Syntology's instrument failed) · 2 unverified (of 13 harvested samples) · 13 pointer-only (licence)
-
DASpeech: Directed Acyclic Transformer for Fast and High-quality Speech-to-Speech Translation 11 Oct 2023 · 1 repository · arXiv:2310.07403Syntology official (archive's flag): 5 ran · 5 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 7 harvested samples) · 7 pointer-only (licence)
-
SEA: Sparse Linear Attention with Estimated Attention Mask 3 Oct 2023 · 1 repository · arXiv:2310.01777Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 2 harvested samples) · 2 pointer-only (licence)
-
NAYER: Noisy Layer Data Generation for Efficient and Effective Data-free Knowledge Distillation 30 Sep 2023 · 1 repository · arXiv:2310.00258Syntology official (archive's flag): 7 ran · 7 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 1 where Syntology's instrument failed) · 3 unverified (of 10 harvested samples) · 10 pointer-only (licence)
-
Event Stream-based Visual Object Tracking: A High-Resolution Benchmark Dataset and A Novel Baseline 26 Sep 2023 · 4 repositories · arXiv:2309.14611Syntology official (archive's flag): 9 ran · 9 ran (of which 0 constructed an object rather than computing a result; 9 with no instrument failure: 1 honoured, 0 violated, 8 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 9 harvested samples) · 9 pointer-only (licence)
-
A Sentence Speaks a Thousand Images: Domain Generalization through Distilling CLIP with Language Guidance 21 Sep 2023 · 1 repository · arXiv:2309.12530Syntology official (archive's flag): 14 ran · 14 ran (of which 0 constructed an object rather than computing a result; 14 with no instrument failure: 0 honoured, 0 violated, 14 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 16 harvested samples) · 16 pointer-only (licence)
-
DFIL: Deepfake Incremental Learning by Exploiting Domain-invariant Forgery Clues 18 Sep 2023 · 1 repository · arXiv:2309.09526Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 2 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples) · 3 pointer-only (licence)
-
Rethinking Momentum Knowledge Distillation in Online Continual Learning 6 Sep 2023 · 1 repository · arXiv:2309.02870Syntology official (archive's flag): 1 ran · 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; the one sample that ran constructed an object rather than computing a result (of 1 harvested sample) · 1 pointer-only (licence)
-
SpikeBERT: A Language Spikformer Learned from BERT with Knowledge Distillation 29 Aug 2023 · 1 repository · arXiv:2308.15122Syntology official (archive's flag): 8 ran · 8 ran (of which 0 constructed an object rather than computing a result; 8 with no instrument failure: 0 honoured, 0 violated, 8 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 9 harvested samples) · 9 pointer-only (licence)
-
Boosting Residual Networks with Group Knowledge 26 Aug 2023 · 1 repository · arXiv:2308.13772Syntology official (archive's flag): 9 ran · 9 ran (of which 0 constructed an object rather than computing a result; 7 with no instrument failure: 2 honoured, 2 violated, 3 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 9 harvested samples) · 3 pointer-only (licence)
-
SpikingBERT: Distilling BERT to Train Spiking Language Models Using Implicit Differentiation 21 Aug 2023 · 1 repository · arXiv:2308.10873Syntology official (archive's flag): 13 ran · 13 ran (of which 0 constructed an object rather than computing a result; 8 with no instrument failure: 2 honoured, 0 violated, 6 with no contract checked; 5 where Syntology's instrument failed) · 4 unverified (of 17 harvested samples) · 17 pointer-only (licence)
-
FedDAT: An Approach for Foundation Model Finetuning in Multi-Modal Heterogeneous Federated Learning 21 Aug 2023 · 1 repository · arXiv:2308.12305Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified (of 6 harvested samples)
-
Adapt Your Teacher: Improving Knowledge Distillation for Exemplar-free Continual Learning 18 Aug 2023 · 1 repository · arXiv:2308.09544Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples)
-
Token-Scaled Logit Distillation for Ternary Weight Generative Language Models 13 Aug 2023 · 1 repository · arXiv:2308.06744Syntology official (archive's flag): 5 ran · 5 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 5 harvested samples) · 5 pointer-only (licence)
-
Multi-Label Knowledge Distillation 12 Aug 2023 · 1 repository · arXiv:2308.06453Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)
-
VQGraph: Rethinking Graph Representation Space for Bridging GNNs and MLPs 4 Aug 2023 · 1 repository · arXiv:2308.02117Syntology official (archive's flag): 23 ran · 23 ran (of which 1 constructed an object rather than computing a result; 10 with no instrument failure: 1 honoured, 4 violated, 5 with no contract checked; 13 where Syntology's instrument failed) · 7 unverified (of 30 harvested samples) · 30 pointer-only (licence)
-
Online Prototype Learning for Online Continual Learning 1 Aug 2023 · 1 repository · arXiv:2308.00301Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
f-Divergence Minimization for Sequence-Level Knowledge Distillation 27 Jul 2023 · 1 repository · arXiv:2307.15190Syntology official (archive's flag): 8 ran · 8 ran (of which 0 constructed an object rather than computing a result; 8 with no instrument failure: 0 honoured, 0 violated, 8 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 9 harvested samples) · 9 pointer-only (licence)
-
DPM-OT: A New Diffusion Probabilistic Model Based on Optimal Transport 21 Jul 2023 · 1 repository · arXiv:2307.11308Syntology official (archive's flag): 9 ran · 9 ran (of which 0 constructed an object rather than computing a result; 7 with no instrument failure: 1 honoured, 0 violated, 6 with no contract checked; 2 where Syntology's instrument failed) · 4 unverified (of 13 harvested samples) · 13 pointer-only (licence)
-
Cluster-aware Semi-supervised Learning: Relational Knowledge Distillation Provably Learns Clustering 20 Jul 2023 · 1 repository · arXiv:2307.11030Syntology 15 ran (of which 3 constructed an object rather than computing a result; 14 with no instrument failure: 0 honoured, 0 violated, 14 with no contract checked; 1 where Syntology's instrument failed) · 3 unverified (of 18 harvested samples) · 5 pointer-only (licence)
-
Class-relation Knowledge Distillation for Novel Class Discovery 18 Jul 2023 · 2 repositories · arXiv:2307.09158Syntology official: harvested, nothing ran · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 3 harvested samples) · 1 pointer-only (licence)
-
Multimodal Distillation for Egocentric Action Recognition 14 Jul 2023 · 1 repository · arXiv:2307.07483Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples)
-
KDSTM: Neural Semi-supervised Topic Modeling with Knowledge Distillation 4 Jul 2023 · 0 repositories · arXiv:2307.01878Syntology 6 ran (of which 1 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 8 harvested samples)
-
NaturalInversion: Data-Free Image Synthesis Improving Real-World Consistency 29 Jun 2023 · 1 repository · arXiv:2306.16661Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified (of 4 harvested samples) · 4 pointer-only (licence)
-
Mitigating Accuracy-Robustness Trade-off via Balanced Multi-Teacher Adversarial Distillation 28 Jun 2023 · 1 repository · arXiv:2306.16170Syntology official (archive's flag): 1 ran · 2 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples) · 2 pointer-only (licence)
-
Bridging the Gap between Decision and Logits in Decision-based Knowledge Distillation for Pre-trained Language Models 15 Jun 2023 · 1 repository · arXiv:2306.08909Syntology official (archive's flag): 1 ran · 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; the one sample that ran constructed an object rather than computing a result (of 1 harvested sample) · 1 pointer-only (licence)
-
Adaptive Multi-Teacher Knowledge Distillation with Meta-Learning 11 Jun 2023 · 1 repository · arXiv:2306.06634Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
Revisiting Data-Free Knowledge Distillation with Poisoned Teachers 4 Jun 2023 · 1 repository · arXiv:2306.02368Syntology official (archive's flag): 6 ran · 6 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 2 where Syntology's instrument failed) · 1 unverified (of 7 harvested samples) · 3 pointer-only (licence)
-
I^3 Retriever: Incorporating Implicit Interaction in Pre-trained Language Models for Passage Retrieval 4 Jun 2023 · 2 repositories · arXiv:2306.02371Syntology community repositories only · 5 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 0 where Syntology's instrument failed) · 5 unverified (of 10 harvested samples)
-
PlaSma: Making Small Language Models Better Procedural Knowledge Models for (Counterfactual) Planning 31 May 2023 · 1 repository · arXiv:2305.19472Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)
-
Are Large Kernels Better Teachers than Transformers for ConvNets? 30 May 2023 · 1 repository · arXiv:2305.19412Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
Knowledge Distillation Performs Partial Variance Reduction 27 May 2023 · 1 repository · arXiv:2305.17581Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples)
-
Improving Knowledge Distillation via Regularizing Feature Norm and Direction 26 May 2023 · 1 repository · arXiv:2305.17007Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples) · 3 pointer-only (licence)
-
BK-SDM: A Lightweight, Fast, and Cheap Version of Stable Diffusion 25 May 2023 · 3 repositories · arXiv:2305.15798Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples) · 3 pointer-only (licence)
-
OVO: Open-Vocabulary Occupancy 25 May 2023 · 1 repository · arXiv:2305.16133Syntology official (archive's flag): 9 ran · 9 ran (of which 0 constructed an object rather than computing a result; 9 with no instrument failure: 0 honoured, 0 violated, 9 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 11 harvested samples) · 2 pointer-only (licence)
-
How to Distill your BERT: An Empirical Study on the Impact of Weight Initialisation and Distillation Objectives 24 May 2023 · 1 repository · arXiv:2305.15032Syntology official (archive's flag): 6 ran · 6 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 1 where Syntology's instrument failed) · 5 unverified (of 11 harvested samples)
-
NORM: Knowledge Distillation via N-to-One Representation Matching 23 May 2023 · 1 repository · arXiv:2305.13803Syntology official (archive's flag): 1 ran · 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 7 unverified; the one sample that ran constructed an object rather than computing a result (of 8 harvested samples)
-
Decoupled Kullback-Leibler Divergence Loss 23 May 2023 · 4 repositories · arXiv:2305.13948Syntology official (archive's flag): 4 ran · 11 ran (of which 1 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 6 where Syntology's instrument failed) · 0 unverified (of 11 harvested samples) · 4 pointer-only (licence)
-
Lion: Adversarial Distillation of Proprietary Large Language Models 22 May 2023 · 1 repository · arXiv:2305.12870Syntology official (archive's flag): 6 ran · 6 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 1 where Syntology's instrument failed) · 5 unverified (of 11 harvested samples) · 1 pointer-only (licence)
-
Is Synthetic Data From Diffusion Models Ready for Knowledge Distillation? 22 May 2023 · 1 repository · arXiv:2305.12954Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
Lifting the Curse of Capacity Gap in Distilling Language Models 20 May 2023 · 1 repository · arXiv:2305.12129Syntology official (archive's flag): 7 ran · 7 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 1 where Syntology's instrument failed) · 6 unverified (of 13 harvested samples)
-
Catch-Up Distillation: You Only Need to Train Once for Accelerating Sampling 18 May 2023 · 1 repository · arXiv:2305.10769Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples) · 2 pointer-only (licence)
-
AD-KD: Attribution-Driven Knowledge Distillation for Language Model Compression 17 May 2023 · 1 repository · arXiv:2305.10010Syntology official (archive's flag): 3 ran · 3 ran (of which 1 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 4 harvested samples) · 4 pointer-only (licence)
-
Tailoring Instructions to Student's Learning Levels Boosts Knowledge Distillation 16 May 2023 · 1 repository · arXiv:2305.09651Syntology official (archive's flag): 2 ran · 2 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples)
-
Improving Continual Relation Extraction by Distinguishing Analogous Semantics 11 May 2023 · 1 repository · arXiv:2305.06620Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
SUR-adapter: Enhancing Text-to-Image Pre-trained Diffusion Models with Large Language Models 9 May 2023 · 1 repository · arXiv:2305.05189Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)
-
FedNoRo: Towards Noise-Robust Federated Learning by Addressing Class Imbalance and Label Noise Heterogeneity 9 May 2023 · 3 repositories · arXiv:2305.05230Syntology official (archive's flag): 2 ran · 2 ran (of which 2 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified; every one of the 2 samples that ran constructed an object rather than computing a result (of 4 harvested samples) · 4 pointer-only (licence)
-
SCOTT: Self-Consistent Chain-of-Thought Distillation 3 May 2023 · 1 repository · arXiv:2305.01879Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
A Systematic Study of Knowledge Distillation for Natural Language Generation with Pseudo-Target Training 3 May 2023 · 1 repository · arXiv:2305.02031Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 4 harvested samples)
-
Class Attention Transfer Based Knowledge Distillation 25 Apr 2023 · 1 repository · arXiv:2304.12777Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified (of 4 harvested samples) · 4 pointer-only (licence)
-
Multi-Mode Online Knowledge Distillation for Self-Supervised Visual Representation Learning 13 Apr 2023 · 1 repository · arXiv:2304.06461Syntology 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; the one sample that ran constructed an object rather than computing a result (of 1 harvested sample)
-
Self-Distillation for Gaussian Process Regression and Classification 5 Apr 2023 · 1 repository · arXiv:2304.02641Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)
-
SimDistill: Simulated Multi-modal Distillation for BEV 3D Object Detection 29 Mar 2023 · 2 repositories · arXiv:2303.16818Syntology official (archive's flag): 10 ran · 10 ran (of which 0 constructed an object rather than computing a result; 10 with no instrument failure: 0 honoured, 0 violated, 10 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 10 harvested samples) · 3 pointer-only (licence)
-
UniDistill: A Universal Cross-Modality Knowledge Distillation Framework for 3D Object Detection in Bird's-Eye View 27 Mar 2023 · 1 repository · arXiv:2303.15083Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 2 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples)
-
Supervised Masked Knowledge Distillation for Few-Shot Transformers 25 Mar 2023 · 1 repository · arXiv:2303.15466Syntology official (archive's flag): 3 ran · 3 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples)
-
TeSLA: Test-Time Self-Learning With Automatic Adversarial Augmentation 17 Mar 2023 · 1 repository · arXiv:2303.09870Syntology official (archive's flag): 6 ran · 6 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 2 honoured, 0 violated, 3 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 6 harvested samples) · 2 pointer-only (licence)
-
Extending global-local view alignment for self-supervised learning with remote sensing imagery 12 Mar 2023 · 1 repository · arXiv:2303.06670Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 3 harvested samples)
-
OccDepth: A Depth-Aware Method for 3D Semantic Scene Completion 27 Feb 2023 · 1 repository · arXiv:2302.13540Syntology official (archive's flag): 5 ran · 5 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 6 harvested samples) · 2 pointer-only (licence)
-
Teacher Intervention: Improving Convergence of Quantization Aware Training for Ultra-Low Precision Transformers 23 Feb 2023 · 1 repository · arXiv:2302.11812Syntology official: no sample here; runs from other or unrecorded repositories · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
A framework for benchmarking class-out-of-distribution detection and its application to ImageNet 23 Feb 2023 · 1 repository · arXiv:2302.11893Syntology official (archive's flag): 13 ran · 13 ran (of which 0 constructed an object rather than computing a result; 13 with no instrument failure: 0 honoured, 0 violated, 13 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 15 harvested samples)
-
A Neural Span-Based Continual Named Entity Recognition Model 23 Feb 2023 · 1 repository · arXiv:2302.12200Syntology official (archive's flag): 10 ran · 10 ran (of which 0 constructed an object rather than computing a result; 10 with no instrument failure: 0 honoured, 0 violated, 10 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 11 harvested samples)
-
Jaccard Metric Losses: Optimizing the Jaccard Index with Soft Labels 11 Feb 2023 · 2 repositories · arXiv:2302.05666Syntology official (archive's flag): 1 ran · 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; the one sample that ran constructed an object rather than computing a result (of 1 harvested sample) · 1 pointer-only (licence)
-
Online Hyperparameter Optimization for Class-Incremental Learning 11 Jan 2023 · 1 repository · arXiv:2301.05032Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 3 unverified (of 4 harvested samples)
-
ERNIE 3.0 Tiny: Frustratingly Simple Method to Improve Task-Agnostic Distillation Generalization 9 Jan 2023 · 1 repository · arXiv:2301.03416Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 3 harvested samples)
-
NeRN -- Learning Neural Representations for Neural Networks 27 Dec 2022 · 1 repository · arXiv:2212.13554Syntology official (archive's flag): 5 ran · 5 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 6 harvested samples)
-
Gradient-based Intra-attention Pruning on Pre-trained Language Models 15 Dec 2022 · 1 repository · arXiv:2212.07634Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 3 harvested samples)
-
Curriculum Temperature for Knowledge Distillation 29 Nov 2022 · 1 repository · arXiv:2211.16231Syntology official (archive's flag): 8 ran · 8 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 5 where Syntology's instrument failed) · 7 unverified (of 15 harvested samples) · 2 pointer-only (licence)
-
Distilling Knowledge from Self-Supervised Teacher by Embedding Graph Alignment 23 Nov 2022 · 1 repository · arXiv:2211.13264Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples) · 2 pointer-only (licence)
-
Multi-Level Knowledge Distillation for Out-of-Distribution Detection in Text 21 Nov 2022 · 1 repository · arXiv:2211.11300Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 4 harvested samples)
-
Cross-Modality Knowledge Distillation Network for Monocular 3D Object Detection 14 Nov 2022 · 1 repository · arXiv:2211.07171Syntology official (archive's flag): 1 ran · 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified; the one sample that ran constructed an object rather than computing a result (of 2 harvested samples)
-
Efficient Large-scale Audio Tagging via Transformer-to-CNN Knowledge Distillation 9 Nov 2022 · 2 repositories · arXiv:2211.04772Syntology community repositories only · 2 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples) · 1 pointer-only (licence)
-
CoNMix for Source-free Single and Multi-target Domain Adaptation 7 Nov 2022 · 1 repository · arXiv:2211.03876Syntology official: harvested, nothing ran · 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 2 unverified (of 4 harvested samples) · 4 pointer-only (licence)
-
Gradient Knowledge Distillation for Pre-trained Language Models 2 Nov 2022 · 1 repository · arXiv:2211.01071Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 4 where Syntology's instrument failed) · 3 unverified (of 7 harvested samples) · 7 pointer-only (licence)
-
Geometric Knowledge Distillation: Topology Compression for Graph Neural Networks 24 Oct 2022 · 2 repositories · arXiv:2210.13014Syntology official (archive's flag): 1 ran · 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified; the one sample that ran constructed an object rather than computing a result (of 2 harvested samples) · 2 pointer-only (licence)
-
SA-MLP: Distilling Graph Knowledge from GNNs into Structure-Aware MLP 18 Oct 2022 · 4 repositories · arXiv:2210.09609Syntology community repositories only · 4 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 5 harvested samples)
-
Learning Generalizable Models for Vehicle Routing Problems via Knowledge Distillation 14 Oct 2022 · 1 repository · arXiv:2210.07686Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 1 honoured, 1 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 6 unverified (of 8 harvested samples)
-
EfficientVLM: Fast and Accurate Vision-Language Models via Knowledge Distillation and Modal-adaptive Pruning 14 Oct 2022 · 1 repository · arXiv:2210.07795Syntology official (archive's flag): 7 ran · 7 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 3 where Syntology's instrument failed) · 2 unverified (of 9 harvested samples) · 9 pointer-only (licence)
-
Decomposed Knowledge Distillation for Class-Incremental Semantic Segmentation 12 Oct 2022 · 1 repository · arXiv:2210.05941Syntology 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; the one sample that ran constructed an object rather than computing a result (of 1 harvested sample) · 1 pointer-only (licence)
-
Distill the Image to Nowhere: Inversion Knowledge Distillation for Multimodal Machine Translation 10 Oct 2022 · 1 repository · arXiv:2210.04468Syntology official (archive's flag): 4 ran · 4 ran (of which 2 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 4 where Syntology's instrument failed) · 1 unverified (of 5 harvested samples) · 5 pointer-only (licence)
-
Meta-DMoE: Adapting to Domain Shift by Meta-Distillation from Mixture-of-Experts 8 Oct 2022 · 1 repository · arXiv:2210.03885Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified (of 7 harvested samples)
-
Bi-directional Weakly Supervised Knowledge Distillation for Whole Slide Image Classification 7 Oct 2022 · 1 repository · arXiv:2210.03664Syntology official (archive's flag): 3 ran · 3 ran (of which 1 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 1 violated, 1 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples) · 3 pointer-only (licence)
-
Effective Self-supervised Pre-training on Low-compute Networks without Distillation 6 Oct 2022 · 1 repository · arXiv:2210.02808Syntology official (archive's flag): 6 ran · 6 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 3 where Syntology's instrument failed) · 3 unverified (of 9 harvested samples) · 3 pointer-only (licence)
-
Teaching Where to Look: Attention Similarity Knowledge Distillation for Low Resolution Face Recognition 29 Sep 2022 · 1 repository · arXiv:2209.14498Syntology official (archive's flag): 1 ran · 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; the one sample that ran constructed an object rather than computing a result (of 1 harvested sample)
-
Rethinking Resolution in the Context of Efficient Video Recognition 26 Sep 2022 · 1 repository · arXiv:2209.12797Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 5 harvested samples) · 2 pointer-only (licence)
-
Exploring Inconsistent Knowledge Distillation for Object Detection with Data Augmentation 20 Sep 2022 · 1 repository · arXiv:2209.09841Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 6 harvested samples) · 4 pointer-only (licence)
-
Switchable Online Knowledge Distillation 12 Sep 2022 · 1 repository · arXiv:2209.04996Syntology official (archive's flag): 10 ran · 10 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 1 violated, 5 with no contract checked; 4 where Syntology's instrument failed) · 3 unverified (of 13 harvested samples) · 3 pointer-only (licence)
-
Exploring Target Representations for Masked Autoencoders 8 Sep 2022 · 1 repository · arXiv:2209.03917Syntology official (archive's flag): 11 ran · 11 ran (of which 0 constructed an object rather than computing a result; 10 with no instrument failure: 1 honoured, 0 violated, 9 with no contract checked; 1 where Syntology's instrument failed) · 2 unverified (of 13 harvested samples) · 2 pointer-only (licence)
-
Disentangle and Remerge: Interventional Knowledge Distillation for Few-Shot Object Detection from A Conditional Causal Perspective 26 Aug 2022 · 1 repository · arXiv:2208.12681Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)
-
PANDA: Prompt Transfer Meets Knowledge Distillation for Efficient Model Adaptation 22 Aug 2022 · 1 repository · arXiv:2208.10160Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 3 harvested samples)
-
Multi-Granularity Distillation Scheme Towards Lightweight Semi-Supervised Semantic Segmentation 22 Aug 2022 · 1 repository · arXiv:2208.10169Syntology official (archive's flag): 9 ran · 9 ran (of which 0 constructed an object rather than computing a result; 9 with no instrument failure: 1 honoured, 1 violated, 7 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 9 harvested samples) · 2 pointer-only (licence)
-
MixSKD: Self-Knowledge Distillation from Mixup for Image Recognition 11 Aug 2022 · 1 repository · arXiv:2208.05768Syntology official (archive's flag): 3 ran · 3 ran (of which 3 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified; every one of the 3 samples that ran constructed an object rather than computing a result (of 4 harvested samples) · 4 pointer-only (licence)
-
Domain-invariant Feature Exploration for Domain Generalization 25 Jul 2022 · 1 repository · arXiv:2207.12020Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 6 harvested samples)
-
Few-Shot Class-Incremental Learning via Entropy-Regularized Data-Free Replay 22 Jul 2022 · 1 repository · arXiv:2207.11213Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 2 harvested samples)
-
Re2G: Retrieve, Rerank, Generate 13 Jul 2022 · 1 repository · arXiv:2207.06300Syntology official (archive's flag): 7 ran · 7 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 8 harvested samples) · 1 pointer-only (licence)
-
Open-Vocabulary Multi-Label Classification via Multi-Modal Knowledge Transfer 5 Jul 2022 · 1 repository · arXiv:2207.01887Syntology official (archive's flag): 5 ran · 5 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 3 where Syntology's instrument failed) · 2 unverified (of 7 harvested samples) · 2 pointer-only (licence)
-
Revisiting Label Smoothing and Knowledge Distillation Compatibility: What was Missing? 29 Jun 2022 · 1 repository · arXiv:2206.14532Syntology official (archive's flag): 10 ran · 10 ran (of which 0 constructed an object rather than computing a result; 9 with no instrument failure: 0 honoured, 0 violated, 9 with no contract checked; 1 where Syntology's instrument failed) · 6 unverified (of 16 harvested samples) · 1 pointer-only (licence)
-
One Reference Is Not Enough: Diverse Distillation with Reference Selection for Non-Autoregressive Translation 28 May 2022 · 1 repository · arXiv:2205.14333Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 3 harvested samples) · 3 pointer-only (licence)