Methods › General › Knowledge Distillation › Knowledge Distillation › Papers where code ran, page 1
Knowledge Distillation
Papers archive 2025-07-28
archive papers tagged: 3,071 · with a code link: 1,258 · where Syntology ran a sample: 320 (276 with a run with no instrument failure, 44 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (320 of 3,071 tagged: 276 with a run with no instrument failure, 44 where every run was a failure of Syntology's instrument)
Syntology We ran code from the paper's repository; we did not isolate this method inside it.
Page 1 of 4: papers 1 to 100 of the 320 tagged papers where Syntology ran at least one harvested sample (276 with a run with no instrument failure, 44 where every run was a failure of Syntology's instrument), newest first by the archive's date (ties by arXiv id). This is a filter on Syntology's record ordered by date only, not a ranking; a run is not a correctness claim. A paper missing from this list is not a recorded non-run: it may have no arXiv id, no harvested code, or only samples that have not run yet.
Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code, as “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. It is per sample and not a correctness claim. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from.
-
SeqPE: Transformer with Sequential Position Encoding 16 Jun 2025 · 1 repository · arXiv:2506.13277Syntology official (archive's flag): 9 ran · 9 ran (of which 0 constructed an object rather than computing a result; 7 with no instrument failure: 0 honoured, 2 violated, 5 with no contract checked; 2 where Syntology's instrument failed) · 3 unverified (of 12 harvested samples) · 12 pointer-only (licence)
-
Static Word Embeddings for Sentence Semantic Representation 5 Jun 2025 · 0 repositories · arXiv:2506.04624Syntology 18 ran (of which 0 constructed an object rather than computing a result; 18 with no instrument failure: 1 honoured, 0 violated, 17 with no contract checked; 0 where Syntology's instrument failed) · 4 unverified (of 22 harvested samples)
-
Deliberation on Priors: Trustworthy Reasoning of Large Language Models on Knowledge Graphs 21 May 2025 · 1 repository · arXiv:2505.15210Syntology official (archive's flag): 1 ran · 5 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 2 honoured, 0 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 9 unverified (of 14 harvested samples)
-
Efficient Multivariate Time Series Forecasting via Calibrated Language Models with Privileged Knowledge Distillation 4 May 2025 · 3 repositories · arXiv:2505.02138Syntology community repositories only · 7 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 1 honoured, 0 violated, 3 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified (of 7 harvested samples) · 2 pointer-only (licence)
-
Learning Occlusion-Robust Vision Transformers for Real-Time UAV Tracking 12 Apr 2025 · 1 repository · arXiv:2504.09228Syntology official (archive's flag): 1 ran · 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; the one sample that ran constructed an object rather than computing a result (of 1 harvested sample)
-
High Temporal Consistency through Semantic Similarity Propagation in Semi-Supervised Video Semantic Segmentation for Autonomous Flight 19 Mar 2025 · 1 repository · arXiv:2503.15676Syntology official (archive's flag): 25 ran · 25 ran (of which 15 constructed an object rather than computing a result; 20 with no instrument failure: 0 honoured, 0 violated, 20 with no contract checked; 5 where Syntology's instrument failed) · 14 unverified (of 39 harvested samples) · 39 pointer-only (licence)
-
LightGen: Efficient Image Generation through Knowledge Distillation and Direct Preference Optimization 11 Mar 2025 · 1 repository · arXiv:2503.08619Syntology official (archive's flag): 9 ran · 9 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 3 honoured, 0 violated, 2 with no contract checked; 4 where Syntology's instrument failed) · 1 unverified (of 10 harvested samples) · 3 pointer-only (licence)
-
Semantic Shift Estimation via Dual-Projection and Classifier Reconstruction for Exemplar-Free Class-Incremental Learning 7 Mar 2025 · 1 repository · arXiv:2503.05423Syntology official (archive's flag): 1 ran · 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; the one sample that ran constructed an object rather than computing a result (of 1 harvested sample) · 1 pointer-only (licence)
-
Temporal Separation with Entropy Regularization for Knowledge Distillation in Spiking Neural Networks 5 Mar 2025 · 0 repositories · arXiv:2503.03144Syntology 3 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 2 where Syntology's instrument failed) · 1 unverified (of 4 harvested samples)
-
Advantage-Guided Distillation for Preference Alignment in Small Language Models 25 Feb 2025 · 1 repository · arXiv:2502.17927Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples) · 3 pointer-only (licence)
-
Efficient AI in Practice: Training and Deployment of Efficient LLMs for Industry Applications 20 Feb 2025 · 0 repositories · arXiv:2502.14305Syntology 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 5 harvested samples)
-
Towards Unified Music Emotion Recognition across Dimensional and Categorical Models 6 Feb 2025 · 1 repository · arXiv:2502.03979Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 5 harvested samples)
-
MoVE-KD: Knowledge Distillation for VLMs with Mixture of Visual Encoders 3 Jan 2025 · 0 repositories · arXiv:2501.01709Syntology 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples)
-
Leveraging Large Language Models for Active Merchant Non-player Characters 15 Dec 2024 · 1 repository · arXiv:2412.11189Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 3 harvested samples) · 3 pointer-only (licence)
-
Wasserstein Distance Rivals Kullback-Leibler Divergence for Knowledge Distillation 11 Dec 2024 · 1 repository · arXiv:2412.08139Syntology 6 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 5 where Syntology's instrument failed) · 1 unverified (of 7 harvested samples) · 7 pointer-only (licence)
-
One-shot Federated Learning via Synthetic Distiller-Distillate Communication 6 Dec 2024 · 1 repository · arXiv:2412.05186Syntology official (archive's flag): 10 ran · 10 ran (of which 0 constructed an object rather than computing a result; 9 with no instrument failure: 1 honoured, 1 violated, 7 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 11 harvested samples)
-
Align-KD: Distilling Cross-Modal Alignment Knowledge for Mobile Vision-Language Model 2 Dec 2024 · 1 repository · arXiv:2412.01282Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 4 harvested samples) · 4 pointer-only (licence)
-
Exploring Feature-based Knowledge Distillation for Recommender System: A Frequency Perspective 16 Nov 2024 · 1 repository · arXiv:2411.10676Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 6 harvested samples)
-
LLM-Neo: Parameter Efficient Knowledge Distillation for Large Language Models 11 Nov 2024 · 2 repositories · arXiv:2411.06839Syntology 12 ran (of which 0 constructed an object rather than computing a result; 10 with no instrument failure: 0 honoured, 0 violated, 10 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 12 harvested samples) · 1 pointer-only (licence)
-
Over-parameterized Student Model via Tensor Decomposition Boosted Knowledge Distillation 10 Nov 2024 · 1 repository · arXiv:2411.06448Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 3 where Syntology's instrument failed) · 3 unverified (of 7 harvested samples)
-
Training on the Test Model: Contamination in Ranking Distillation 4 Nov 2024 · 1 repository · arXiv:2411.02284Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 4 unverified (of 8 harvested samples)
-
Mentor-KD: Making Small Language Models Better Multi-step Reasoners 11 Oct 2024 · 1 repository · arXiv:2410.09037Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)
-
Relational Diffusion Distillation for Efficient Image Generation 10 Oct 2024 · 1 repository · arXiv:2410.07679Syntology official (archive's flag): 6 ran · 6 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 5 where Syntology's instrument failed) · 0 unverified (of 6 harvested samples) · 2 pointer-only (licence)
-
Dataset Distillation via Knowledge Distillation: Towards Efficient Self-Supervised Pre-Training of Deep Networks 3 Oct 2024 · 1 repository · arXiv:2410.02116Syntology official (archive's flag): 14 ran · 14 ran (of which 4 constructed an object rather than computing a result; 12 with no instrument failure: 1 honoured, 0 violated, 11 with no contract checked; 2 where Syntology's instrument failed) · 3 unverified (of 17 harvested samples) · 17 pointer-only (licence)
-
PairDistill: Pairwise Relevance Distillation for Dense Retrieval 2 Oct 2024 · 1 repository · arXiv:2410.01383Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples) · 3 pointer-only (licence)
-
Neural-Symbolic Collaborative Distillation: Advancing Small Language Models for Complex Reasoning Tasks 20 Sep 2024 · 1 repository · arXiv:2409.13203Syntology official (archive's flag): 6 ran · 6 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 2 where Syntology's instrument failed) · 1 unverified (of 7 harvested samples) · 7 pointer-only (licence)
-
Sorbet: A Neuromorphic Hardware-Compatible Transformer-Based Spiking Language Model 4 Sep 2024 · 0 repositories · arXiv:2409.15298Syntology 4 ran (of which 3 constructed an object rather than computing a result; 4 with no instrument failure: 1 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 4 harvested samples) · 4 pointer-only (licence)
-
Unsupervised Domain Adaption Harnessing Vision-Language Pre-training 5 Aug 2024 · 1 repository · arXiv:2408.02192Syntology official (archive's flag): 6 ran · 6 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 3 where Syntology's instrument failed) · 7 unverified (of 13 harvested samples) · 5 pointer-only (licence)
-
Clover-2: Accurate Inference for Regressive Lightweight Speculative Decoding 1 Aug 2024 · 1 repository · arXiv:2408.00264Syntology 15 ran (of which 0 constructed an object rather than computing a result; 7 with no instrument failure: 0 honoured, 0 violated, 7 with no contract checked; 8 where Syntology's instrument failed) · 2 unverified (of 17 harvested samples) · 7 pointer-only (licence)
-
Pruning Large Language Models with Semi-Structural Adaptive Sparse Training 30 Jul 2024 · 1 repository · arXiv:2407.20584Syntology official (archive's flag): 6 ran · 6 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 8 harvested samples)
-
Towards A Generalizable Pathology Foundation Model via Unified Knowledge Distillation 26 Jul 2024 · 1 repository · arXiv:2407.18449Syntology 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
How to Train the Teacher Model for Effective Knowledge Distillation 25 Jul 2024 · 1 repository · arXiv:2407.18041Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
Self-Training with Direct Preference Optimization Improves Chain-of-Thought Reasoning 25 Jul 2024 · 1 repository · arXiv:2407.18248Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples)
-
OriGen:Enhancing RTL Code Generation with Code-to-Code Augmentation and Self-Reflection 23 Jul 2024 · 1 repository · arXiv:2407.16237Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 3 harvested samples) · 3 pointer-only (licence)
-
SeqMIA: Sequential-Metric Based Membership Inference Attack 21 Jul 2024 · 1 repository · arXiv:2407.15098Syntology official (archive's flag): 9 ran · 9 ran (of which 0 constructed an object rather than computing a result; 9 with no instrument failure: 0 honoured, 0 violated, 9 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 10 harvested samples) · 10 pointer-only (licence)
-
Bridge Past and Future: Overcoming Information Asymmetry in Incremental Object Detection 16 Jul 2024 · 1 repository · arXiv:2407.11499Syntology official (archive's flag): 6 ran · 6 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified (of 9 harvested samples) · 3 pointer-only (licence)
-
Accessing Vision Foundation Models at ImageNet-level Costs 15 Jul 2024 · 1 repository · arXiv:2407.10366Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 1 honoured, 0 violated, 2 with no contract checked; 1 where Syntology's instrument failed) · 6 unverified (of 10 harvested samples)
-
Reprogramming Distillation for Medical Foundation Models 9 Jul 2024 · 1 repository · arXiv:2407.06504Syntology official (archive's flag): 6 ran · 6 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 4 where Syntology's instrument failed) · 2 unverified (of 8 harvested samples) · 8 pointer-only (licence)
-
Leveraging Topological Guidance for Improved Knowledge Distillation 7 Jul 2024 · 1 repository · arXiv:2407.05316Syntology official (archive's flag): 14 ran · 14 ran (of which 0 constructed an object rather than computing a result; 11 with no instrument failure: 2 honoured, 2 violated, 7 with no contract checked; 3 where Syntology's instrument failed) · 2 unverified (of 16 harvested samples) · 16 pointer-only (licence)
-
Mind the Interference: Retaining Pre-trained Knowledge in Parameter Efficient Continual Learning of Vision-Language Models 7 Jul 2024 · 1 repository · arXiv:2407.05342Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 5 harvested samples) · 5 pointer-only (licence)
-
DASS: Distilled Audio State Space Models Are Stronger and More Duration-Scalable Learners 4 Jul 2024 · 1 repository · arXiv:2407.04082Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
Improving Zero-shot Generalization of Learned Prompts via Unsupervised Knowledge Distillation 3 Jul 2024 · 1 repository · arXiv:2407.03056Syntology official (archive's flag): 6 ran · 6 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 3 where Syntology's instrument failed) · 2 unverified (of 8 harvested samples) · 8 pointer-only (licence)
-
A Unified Framework for 3D Scene Understanding 3 Jul 2024 · 1 repository · arXiv:2407.03263Syntology official (archive's flag): 7 ran · 7 ran (of which 0 constructed an object rather than computing a result; 7 with no instrument failure: 0 honoured, 0 violated, 7 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 7 harvested samples)
-
Dual-Space Knowledge Distillation for Large Language Models 25 Jun 2024 · 1 repository · arXiv:2406.17328Syntology official (archive's flag): 2 ran · 2 ran (of which 2 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified; every one of the 2 samples that ran constructed an object rather than computing a result (of 3 harvested samples) · 3 pointer-only (licence)
-
Learning to Plan for Retrieval-Augmented Large Language Models from Knowledge Graphs 20 Jun 2024 · 1 repository · arXiv:2406.14282Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
From Instance Training to Instruction Learning: Task Adapters Generation from Instructions 18 Jun 2024 · 2 repositories · arXiv:2406.12382Syntology official (archive's flag): 6 ran · 8 ran (of which 2 constructed an object rather than computing a result; 8 with no instrument failure: 0 honoured, 0 violated, 8 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 10 harvested samples)
-
Improving the Training of Rectified Flows 30 May 2024 · 1 repository · arXiv:2405.20320Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
JiuZhang3.0: Efficiently Improving Mathematical Reasoning by Training Small Data Synthesis Models 23 May 2024 · 1 repository · arXiv:2405.14365Syntology official (archive's flag): 9 ran · 9 ran (of which 0 constructed an object rather than computing a result; 9 with no instrument failure: 0 honoured, 0 violated, 9 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified (of 12 harvested samples) · 12 pointer-only (licence)
-
Recurrent Early Exits for Federated Learning with Heterogeneous Clients 23 May 2024 · 1 repository · arXiv:2405.14791Syntology official (archive's flag): 9 ran · 9 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 4 where Syntology's instrument failed) · 11 unverified (of 20 harvested samples)
-
AMFD: Distillation via Adaptive Multimodal Fusion for Multispectral Pedestrian Detection 21 May 2024 · 1 repository · arXiv:2405.12944Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
Overcoming Data and Model Heterogeneities in Decentralized Federated Learning via Synthetic Anchors 19 May 2024 · 1 repository · arXiv:2405.11525Syntology 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 2 harvested samples) · 2 pointer-only (licence)
-
Distillation Matters: Empowering Sequential Recommenders to Match the Performance of Large Language Model 1 May 2024 · 1 repository · arXiv:2405.00338Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 3 harvested samples) · 3 pointer-only (licence)
-
GhostNetV3: Exploring the Training Strategies for Compact Models 17 Apr 2024 · 1 repository · arXiv:2404.11202Syntology 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples)
-
Digging into contrastive learning for robust depth estimation with diffusion models 15 Apr 2024 · 1 repository · arXiv:2404.09831Syntology official: harvested, nothing ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 3 harvested samples) · 1 pointer-only (licence)
-
Rethinking Transformer-Based Blind-Spot Network for Self-Supervised Image Denoising 11 Apr 2024 · 1 repository · arXiv:2404.07846Syntology official (archive's flag): 7 ran · 7 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 1 honoured, 0 violated, 4 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 7 harvested samples) · 7 pointer-only (licence)
-
Optimization Methods for Personalizing Large Language Models through Retrieval Augmentation 9 Apr 2024 · 1 repository · arXiv:2404.05970Syntology official (archive's flag): 8 ran · 8 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 5 where Syntology's instrument failed) · 0 unverified (of 8 harvested samples) · 8 pointer-only (licence)
-
Okay, Let's Do This! Modeling Event Coreference with Generated Rationales and Knowledge Distillation 4 Apr 2024 · 1 repository · arXiv:2404.03196Syntology official (archive's flag): 7 ran · 7 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 1 where Syntology's instrument failed) · 5 unverified (of 12 harvested samples) · 12 pointer-only (licence)
-
On the Surprising Efficacy of Distillation as an Alternative to Pre-Training Small Models 4 Apr 2024 · 1 repository · arXiv:2404.03263Syntology official (archive's flag): 4 ran · 4 ran (of which 3 constructed an object rather than computing a result; 4 with no instrument failure: 1 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 4 harvested samples)
-
Pre-trained Vision and Language Transformers Are Few-Shot Incremental Learners 2 Apr 2024 · 1 repository · arXiv:2404.02117Syntology official (archive's flag): 12 ran · 12 ran (of which 0 constructed an object rather than computing a result; 8 with no instrument failure: 0 honoured, 0 violated, 8 with no contract checked; 4 where Syntology's instrument failed) · 2 unverified (of 14 harvested samples) · 1 pointer-only (licence)
-
Weak-to-Strong 3D Object Detection with X-Ray Distillation 31 Mar 2024 · 1 repository · arXiv:2404.00679Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)
-
ECLIPSE: Efficient Continual Learning in Panoptic Segmentation with Visual Prompt Tuning 29 Mar 2024 · 1 repository · arXiv:2403.20126Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 4 harvested samples) · 4 pointer-only (licence)
-
SDXS: Real-Time One-Step Latent Diffusion Models with Image Conditions 25 Mar 2024 · 1 repository · arXiv:2403.16627Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples) · 1 pointer-only (licence)
-
HVDistill: Transferring Knowledge from Images to Point Clouds via Unsupervised Hybrid-View Distillation 18 Mar 2024 · 1 repository · arXiv:2403.11817Syntology official (archive's flag): 6 ran · 6 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 1 violated, 5 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 7 harvested samples) · 7 pointer-only (licence)
-
SpikeReveal: Unlocking Temporal Sequences from Real Blurry Inputs with Spike Streams 14 Mar 2024 · 3 repositories · arXiv:2403.09486Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 3 harvested samples) · 3 pointer-only (licence)
-
Recurrent Drafter for Fast Speculative Decoding in Large Language Models 14 Mar 2024 · 1 repository · arXiv:2403.09919Syntology official (archive's flag): 9 ran · 9 ran (of which 0 constructed an object rather than computing a result; 9 with no instrument failure: 0 honoured, 0 violated, 9 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 9 harvested samples)
-
MEND: Meta dEmonstratioN Distillation for Efficient and Effective In-Context Learning 11 Mar 2024 · 1 repository · arXiv:2403.06914Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 2 honoured, 2 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 4 harvested samples) · 4 pointer-only (licence)
-
AuG-KD: Anchor-Based Mixup Generation for Out-of-Domain Knowledge Distillation 11 Mar 2024 · 1 repository · arXiv:2403.07030Syntology official (archive's flag): 6 ran · 6 ran (of which 2 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 7 harvested samples)
-
Cooperative Classification and Rationalization for Graph Generalization 10 Mar 2024 · 1 repository · arXiv:2403.06239Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified (of 7 harvested samples) · 7 pointer-only (licence)
-
Self-Adapting Large Visual-Language Models to Edge Devices across Visual Modalities 7 Mar 2024 · 1 repository · arXiv:2403.04908Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 4 harvested samples) · 4 pointer-only (licence)
-
Logit Standardization in Knowledge Distillation 3 Mar 2024 · 1 repository · arXiv:2403.01427Syntology official (archive's flag): 1 ran · 2 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples) · 2 pointer-only (licence)
-
Align-to-Distill: Trainable Attention Alignment for Knowledge Distillation in Neural Machine Translation 3 Mar 2024 · 1 repository · arXiv:2403.01479Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 2 harvested samples) · 2 pointer-only (licence)
-
On the Road to Portability: Compressing End-to-End Motion Planner for Autonomous Driving 2 Mar 2024 · 1 repository · arXiv:2403.01238Syntology official (archive's flag): 8 ran · 8 ran (of which 5 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 2 where Syntology's instrument failed) · 6 unverified (of 14 harvested samples)
-
PromptMM: Multi-Modal Knowledge Distillation for Recommendation with Prompt-Tuning 27 Feb 2024 · 1 repository · arXiv:2402.17188Syntology official (archive's flag): 10 ran · 10 ran (of which 0 constructed an object rather than computing a result; 9 with no instrument failure: 1 honoured, 1 violated, 7 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 11 harvested samples) · 11 pointer-only (licence)
-
LLM Inference Unveiled: Survey and Roofline Model Insights 26 Feb 2024 · 2 repositories · arXiv:2402.16363Syntology official (archive's flag): 10 ran · 10 ran (of which 0 constructed an object rather than computing a result; 10 with no instrument failure: 0 honoured, 0 violated, 10 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 10 harvested samples)
-
PromptKD: Distilling Student-Friendly Knowledge for Generative Language Models via Prompt Tuning 20 Feb 2024 · 1 repository · arXiv:2402.12842Syntology official (archive's flag): 8 ran · 8 ran (of which 0 constructed an object rather than computing a result; 8 with no instrument failure: 0 honoured, 0 violated, 8 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 10 harvested samples)
-
Improve Cross-Architecture Generalization on Dataset Distillation 20 Feb 2024 · 1 repository · arXiv:2402.13007Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 4 harvested samples) · 4 pointer-only (licence)
-
Towards Cross-Tokenizer Distillation: the Universal Logit Distillation Loss for LLMs 19 Feb 2024 · 3 repositories · arXiv:2402.12030Syntology official (archive's flag): 6 ran · 14 ran (of which 0 constructed an object rather than computing a result; 14 with no instrument failure: 0 honoured, 0 violated, 14 with no contract checked; 0 where Syntology's instrument failed) · 5 unverified (of 19 harvested samples) · 8 pointer-only (licence)
-
Knowledge Distillation Based on Transformed Teacher Matching 17 Feb 2024 · 1 repository · arXiv:2402.11148Syntology official (archive's flag): 5 ran · 5 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 3 where Syntology's instrument failed) · 2 unverified (of 7 harvested samples) · 1 pointer-only (licence)
-
BitDistiller: Unleashing the Potential of Sub-4-Bit LLMs via Self-Distillation 16 Feb 2024 · 2 repositories · arXiv:2402.10631Syntology official (archive's flag): 8 ran · 8 ran (of which 0 constructed an object rather than computing a result; 7 with no instrument failure: 0 honoured, 1 violated, 6 with no contract checked; 1 where Syntology's instrument failed) · 7 unverified (of 15 harvested samples) · 3 pointer-only (licence)
-
NutePrune: Efficient Progressive Pruning with Numerous Teachers for Large Language Models 15 Feb 2024 · 1 repository · arXiv:2402.09773Syntology official (archive's flag): 9 ran · 9 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 4 where Syntology's instrument failed) · 7 unverified (of 16 harvested samples) · 16 pointer-only (licence)
-
Beyond Answers: Transferring Reasoning Capabilities to Smaller LLMs Using Multi-Teacher Knowledge Distillation 7 Feb 2024 · 1 repository · arXiv:2402.04616Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)
-
Vision Superalignment: Weak-to-Strong Generalization for Vision Foundation Models 6 Feb 2024 · 1 repository · arXiv:2402.03749Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 2 where Syntology's instrument failed) · 2 unverified (of 6 harvested samples) · 6 pointer-only (licence)
-
LLaMP: Large Language Model Made Powerful for High-fidelity Materials Knowledge Retrieval and Distillation 30 Jan 2024 · 1 repository · arXiv:2401.17244Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
Rethinking Centered Kernel Alignment in Knowledge Distillation 22 Jan 2024 · 1 repository · arXiv:2401.11824Syntology official (archive's flag): 5 ran · 5 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 6 harvested samples) · 6 pointer-only (licence)
-
Large Language Models are Efficient Learners of Noise-Robust Speech Recognition 19 Jan 2024 · 1 repository · arXiv:2401.10446Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 1 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)
-
Bayes Conditional Distribution Estimation for Knowledge Distillation Based on Conditional Mutual Information 16 Jan 2024 · 1 repository · arXiv:2401.08732Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples) · 3 pointer-only (licence)
-
Translate-Distill: Learning Cross-Language Dense Retrieval by Translation and Distillation 9 Jan 2024 · 1 repository · arXiv:2401.04810Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
SecFormer: Fast and Accurate Privacy-Preserving Inference for Transformer Models via SMPC 1 Jan 2024 · 1 repository · arXiv:2401.00793Syntology official: harvested, nothing ran · 2 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 3 harvested samples) · 3 pointer-only (licence)
-
Curriculum-scheduled Knowledge Distillation from Multiple Pre-trained Teachers for Multi-domain Sequential Recommendation 1 Jan 2024 · 1 repository · arXiv:2401.00797Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)
-
FerKD: Surgical Label Adaptation for Efficient Distillation 29 Dec 2023 · 1 repository · arXiv:2312.17473Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)
-
TinySAM: Pushing the Envelope for Efficient Segment Anything Model 21 Dec 2023 · 2 repositories · arXiv:2312.13789Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 2 where Syntology's instrument failed) · 4 unverified (of 7 harvested samples) · 6 pointer-only (licence)
-
Federated Learning with Extremely Noisy Clients via Negative Distillation 20 Dec 2023 · 1 repository · arXiv:2312.12703Syntology official (archive's flag): 14 ran · 14 ran (of which 0 constructed an object rather than computing a result; 9 with no instrument failure: 1 honoured, 0 violated, 8 with no contract checked; 5 where Syntology's instrument failed) · 3 unverified (of 17 harvested samples) · 17 pointer-only (licence)
-
Distilling Autoregressive Models to Obtain High-Performance Non-Autoregressive Solvers for Vehicle Routing Problems with Faster Inference Speed 19 Dec 2023 · 1 repository · arXiv:2312.12469Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 1 unverified (of 3 harvested samples) · 3 pointer-only (licence)
-
Faster Diffusion: Rethinking the Role of the Encoder for Diffusion Model Inference 15 Dec 2023 · 1 repository · arXiv:2312.09608Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples)
-
Augmentation-Free Dense Contrastive Knowledge Distillation for Efficient Semantic Segmentation 7 Dec 2023 · 1 repository · arXiv:2312.04168Syntology official (archive's flag): 1 ran · 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 7 unverified; the one sample that ran constructed an object rather than computing a result (of 8 harvested samples)
-
Language Model Knowledge Distillation for Efficient Question Answering in Spanish 7 Dec 2023 · 1 repository · arXiv:2312.04193Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples) · 2 pointer-only (licence)
-
LightGaussian: Unbounded 3D Gaussian Compression with 15x Reduction and 200+ FPS 28 Nov 2023 · 1 repository · arXiv:2311.17245Syntology official (archive's flag): 17 ran · 17 ran (of which 1 constructed an object rather than computing a result; 3 with no instrument failure: 2 honoured, 0 violated, 1 with no contract checked; 14 where Syntology's instrument failed) · 5 unverified (of 22 harvested samples) · 22 pointer-only (licence)
-
Efficient and Robust Jet Tagging at the LHC with Knowledge Distillation 23 Nov 2023 · 1 repository · arXiv:2311.14160Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 3 harvested samples) · 3 pointer-only (licence)
-
FreeKD: Knowledge Distillation via Semantic Frequency Prompt 20 Nov 2023 · 1 repository · arXiv:2311.12079Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)
-
Multistage Collaborative Knowledge Distillation from a Large Language Model for Semi-Supervised Sequence Generation 15 Nov 2023 · 1 repository · arXiv:2311.08640Syntology official (archive's flag): 5 ran · 5 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 2 honoured, 1 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 5 harvested samples) · 5 pointer-only (licence)