Methods › General › Knowledge Distillation › Knowledge Distillation › Papers, page 12

Knowledge Distillation

Papers archive 2025-07-28

archive papers tagged: 3,071 · with a code link: 1,258 · where Syntology ran a sample: 320 (276 with a run with no instrument failure, 44 where every run was a failure of Syntology's instrument) Syntology

Show: all tagged papersonly where code ran (320 of 3,071 tagged: 276 with a run with no instrument failure, 44 where every run was a failure of Syntology's instrument)

Page 12 of 31: papers 1,101 to 1,200 of 3,071, newest first by the archive's date (ties by slug), in archive order.

Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code, as “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. It is per sample and not a correctness claim. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from.

• Language Model Knowledge Distillation for Efficient Question Answering in Spanish
  7 Dec 2023 · 1 repository · arXiv:2312.04193
  Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples) · 2 pointer-only (licence)
• Contrastive Learning-Based Spectral Knowledge Distillation for Multi-Modality and Missing Modality Scenarios in Semantic Segmentation
  4 Dec 2023 · 0 repositories · arXiv:2312.02240
• Enhancing and Adapting in the Clinic: Source-free Unsupervised Domain Adaptation for Medical Image Enhancement
  3 Dec 2023 · 1 repository · arXiv:2312.01338
• Dual-Teacher De-biasing Distillation Framework for Multi-domain Fake News Detection
  2 Dec 2023 · 1 repository · arXiv:2312.01006
• S2P3: Self-Supervised Polarimetric Pose Prediction
  2 Dec 2023 · 0 repositories · arXiv:2312.01105
• Generalized Robot 3D Vision-Language Model with Fast Rendering and Pre-Training Vision-Language Alignment
  1 Dec 2023 · 1 repository · arXiv:2312.00663
• Compression of end-to-end non-autoregressive image-to-speech system for low-resourced devices
  30 Nov 2023 · 0 repositories · arXiv:2312.00174
• IAG: Induction-Augmented Generation Framework for Answering Reasoning Questions
  30 Nov 2023 · 0 repositories · arXiv:2311.18397
• Continual Learning for Image Segmentation with Dynamic Query
  29 Nov 2023 · 1 repository · arXiv:2311.17450
• LayerCollapse: Adaptive compression of neural networks
  29 Nov 2023 · 0 repositories · arXiv:2311.17943
• Propagate & Distill: Towards Effective Graph Learners Using Propagation-Embracing MLPs
  29 Nov 2023 · 0 repositories · arXiv:2311.17781
• DiffusionTalker: Personalization and Acceleration for Speech-Driven 3D Face Diffuser
  28 Nov 2023 · 0 repositories · arXiv:2311.16565
• FedAL: Black-Box Federated Knowledge Distillation Enabled by Adversarial Learning
  28 Nov 2023 · 0 repositories · arXiv:2311.16584
• LightGaussian: Unbounded 3D Gaussian Compression with 15x Reduction and 200+ FPS
  28 Nov 2023 · 1 repository · arXiv:2311.17245
  Syntology official (archive's flag): 17 ran · 17 ran (of which 1 constructed an object rather than computing a result; 3 with no instrument failure: 2 honoured, 0 violated, 1 with no contract checked; 14 where Syntology's instrument failed) · 5 unverified (of 22 harvested samples) · 22 pointer-only (licence)
• PEA-Diffusion: Parameter-Efficient Adapter with Knowledge Distillation in non-English Text-to-Image Generation
  28 Nov 2023 · 1 repository · arXiv:2311.17086
• UFIN: Universal Feature Interaction Network for Multi-Domain Click-Through Rate Prediction
  27 Nov 2023 · 1 repository · arXiv:2311.15493
• Double Reverse Regularization Network Based on Self-Knowledge Distillation for SAR Object Classification
  26 Nov 2023 · 0 repositories · arXiv:2311.15231
• Unlearning via Sparse Representations
  26 Nov 2023 · 0 repositories · arXiv:2311.15268
• Wired Perspectives: Multi-View Wire Art Embraces Generative AI
  26 Nov 2023 · 0 repositories · arXiv:2311.15421
• Cosine Similarity Knowledge Distillation for Individual Class Information Transfer
  24 Nov 2023 · 0 repositories · arXiv:2311.14307
• Maximizing Discrimination Capability of Knowledge Distillation with Energy Function
  24 Nov 2023 · 0 repositories · arXiv:2311.14334
• Bridging Classical and Quantum Machine Learning: Knowledge Transfer From Classical to Quantum Neural Networks Using Knowledge Distillation
  23 Nov 2023 · 0 repositories · arXiv:2311.13810
• Education distillation:getting student models to learn in shcools
  23 Nov 2023 · 0 repositories · arXiv:2311.13811
• Efficient and Robust Jet Tagging at the LHC with Knowledge Distillation
  23 Nov 2023 · 1 repository · arXiv:2311.14160
  Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 3 harvested samples) · 3 pointer-only (licence)
• Knowledge Distillation Based Semantic Communications For Multiple Users
  23 Nov 2023 · 0 repositories · arXiv:2311.13789
• Robustness-Reinforced Knowledge Distillation with Correlation Distance and Network Pruning
  23 Nov 2023 · 0 repositories · arXiv:2311.13934
• Efficient Transformer Knowledge Distillation: A Performance Review
  22 Nov 2023 · 0 repositories · arXiv:2311.13657
• EA-KD: Entropy-based Adaptive Knowledge Distillation
  22 Nov 2023 · 0 repositories · arXiv:2311.13621
• Point, Segment and Count: A Generalized Framework for Object Counting
  21 Nov 2023 · 1 repository · arXiv:2311.12386
• FreeKD: Knowledge Distillation via Semantic Frequency Prompt
  20 Nov 2023 · 1 repository · arXiv:2311.12079
  Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)
• Unveiling the Unseen Potential of Graph Learning through MLPs: Effective Graph Learners Using Propagation-Embracing MLPs
  20 Nov 2023 · 0 repositories · arXiv:2311.11759
• LightBTSeg: A lightweight breast tumor segmentation model using ultrasound images via dual-path joint knowledge distillation
  18 Nov 2023 · 0 repositories · arXiv:2311.11086
• Semi-supervised ViT knowledge distillation network with style transfer normalization for colorectal liver metastases survival prediction
  17 Nov 2023 · 0 repositories · arXiv:2311.10305
• A Knowledge Distillation Approach for Sepsis Outcome Prediction from Multivariate Clinical Time Series
  16 Nov 2023 · 0 repositories · arXiv:2311.09566
• Multistage Collaborative Knowledge Distillation from a Large Language Model for Semi-Supervised Sequence Generation
  15 Nov 2023 · 1 repository · arXiv:2311.08640
  Syntology official (archive's flag): 5 ran · 5 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 2 honoured, 1 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 5 harvested samples) · 5 pointer-only (licence)
• Batch Selection and Communication for Active Learning with Edge Labeling
  14 Nov 2023 · 0 repositories · arXiv:2311.08053
• Unlock the Power: Competitive Distillation for Multi-Modal Large Language Models
  14 Nov 2023 · 0 repositories · arXiv:2311.08213
• On Elastic Language Models
  13 Nov 2023 · 0 repositories · arXiv:2311.07204
• Teach me with a Whisper: Enhancing Large Language Models for Analyzing Spoken Transcripts using Speech Embeddings
  13 Nov 2023 · 0 repositories · arXiv:2311.07014
• Quantized Distillation: Optimizing Driver Activity Recognition Models for Resource-Constrained Environments
  10 Nov 2023 · 1 repository · arXiv:2311.05970
• DONUT-hole: DONUT Sparsification by Harnessing Knowledge and Optimizing Learning Efficiency
  9 Nov 2023 · 0 repositories · arXiv:2311.05778
• Object-centric Cross-modal Feature Distillation for Event-based Object Detection
  9 Nov 2023 · 0 repositories · arXiv:2311.05494
• Text Representation Distillation via Information Bottleneck Principle
  9 Nov 2023 · 1 repository · arXiv:2311.05472
• Supervised domain adaptation for building extraction from off-nadir aerial images
  7 Nov 2023 · 0 repositories · arXiv:2311.03867
• Data exploitation: multi-task learning of object detection and semantic segmentation on partially annotated data
  7 Nov 2023 · 1 repository · arXiv:2311.04040
• Reducing Spatial Fitting Error in Distillation of Denoising Diffusion Models
  7 Nov 2023 · 1 repository · arXiv:2311.03830
• What is Lost in Knowledge Distillation?
  7 Nov 2023 · 0 repositories · arXiv:2311.04142
• Asymmetric Masked Distillation for Pre-Training Small Foundation Models
  6 Nov 2023 · 0 repositories · arXiv:2311.03149
• Cross-Level Distillation and Feature Denoising for Cross-Domain Few-Shot Classification
  4 Nov 2023 · 1 repository · arXiv:2311.02392
• Comparative Knowledge Distillation
  3 Nov 2023 · 1 repository · arXiv:2311.02253
• Data-Free Distillation of Language Model by Text-to-Text Transfer
  3 Nov 2023 · 0 repositories · arXiv:2311.01689
• An Efficient Detection and Control System for Underwater Docking using Machine Learning and Realistic Simulation: A Comprehensive Approach
  2 Nov 2023 · 0 repositories · arXiv:2311.01522
• Distilling Out-of-Distribution Robustness from Vision-Language Foundation Models
  2 Nov 2023 · 1 repository · arXiv:2311.01441
  Syntology official (archive's flag): 1 ran · 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; the one sample that ran constructed an object rather than computing a result (of 1 harvested sample)
• Multilingual DistilWhisper: Efficient Distillation of Multi-task Speech Models via Language-Specific Experts
  2 Nov 2023 · 1 repository · arXiv:2311.01070
• Low-latency Real-time Voice Conversion on CPU
  1 Nov 2023 · 1 repository · arXiv:2311.00873
• NEO-KD: Knowledge-Distillation-Based Adversarial Training for Robust Multi-Exit Neural Networks
  1 Nov 2023 · 0 repositories · arXiv:2311.00428
• AMLNet: Adversarial Mutual Learning Neural Network for Non-AutoRegressive Multi-Horizon Time Series Forecasting
  30 Oct 2023 · 1 repository · arXiv:2310.19289
• MUST: A Multilingual Student-Teacher Learning approach for low-resource speech recognition
  29 Oct 2023 · 0 repositories · arXiv:2310.18865
• RCKD: Response-Based Cross-Task Knowledge Distillation for Pathological Image Analysis
  29 Oct 2023 · 0 repositories
• Discourse Structures Guided Fine-grained Propaganda Identification
  28 Oct 2023 · 1 repository · arXiv:2310.18544
• Efficient Object Detection in Optical Remote Sensing Imagery via Attention-based Feature Distillation
  28 Oct 2023 · 0 repositories · arXiv:2310.18676
• ODM3D: Alleviating Foreground Sparsity for Semi-Supervised Monocular 3D Object Detection
  28 Oct 2023 · 1 repository · arXiv:2310.18620
• Towards a Unified Conversational Recommendation System: Multi-task Learning via Contextualized Knowledge Distillation
  27 Oct 2023 · 1 repository · arXiv:2310.18119
• Fantastic Gains and Where to Find Them: On the Existence and Prospect of General Knowledge Transfer between Any Pretrained Model
  26 Oct 2023 · 1 repository · arXiv:2310.17653
• torchdistill Meets Hugging Face Libraries for Reproducible, Coding-Free Deep Learning Studies: A Case Study on NLP
  26 Oct 2023 · 1 repository · arXiv:2310.17644
• Understanding the Effects of Projectors in Knowledge Distillation
  26 Oct 2023 · 1 repository · arXiv:2310.17183
• SonoSAMTrack -- Segment and Track Anything on Ultrasound Images
  25 Oct 2023 · 0 repositories · arXiv:2310.16872
• ABKD: Graph Neural Network Compression with Attention-Based Knowledge Distillation
  24 Oct 2023 · 0 repositories · arXiv:2310.15938
• Cross-feature Contrastive Loss for Decentralized Deep Learning on Heterogeneous Data
  24 Oct 2023 · 1 repository · arXiv:2310.15890
• Dynamic Convolutional Neural Networks as Efficient Pre-trained Audio Models
  24 Oct 2023 · 1 repository · arXiv:2310.15648
• Wakening Past Concepts without Past Data: Class-Incremental Learning from Online Placebos
  24 Oct 2023 · 0 repositories · arXiv:2310.16115
• MCC-KD: Multi-CoT Consistent Knowledge Distillation
  23 Oct 2023 · 1 repository · arXiv:2310.14747
  Syntology official (archive's flag): 5 ran · 5 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 7 harvested samples) · 7 pointer-only (licence)
• Leveraging Complementary Attention maps in vision transformers for OCT image analysis
  21 Oct 2023 · 0 repositories · arXiv:2310.14005
• DistillCSE: Distilled Contrastive Learning for Sentence Embeddings
  20 Oct 2023 · 1 repository · arXiv:2310.13499
• Enhancing Abstractiveness of Summarization Models through Calibrated Distillation
  20 Oct 2023 · 0 repositories · arXiv:2310.13760
• GenDistiller: Distilling Pre-trained Language Models based on Generative Models
  20 Oct 2023 · 0 repositories · arXiv:2310.13418
• MonoSKD: General Distillation Framework for Monocular 3D Object Detection via Spearman Correlation Coefficient
  17 Oct 2023 · 1 repository · arXiv:2310.11316
• Leveraging Knowledge Distillation for Efficient Deep Reinforcement Learning in Resource-Constrained Environments
  16 Oct 2023 · 1 repository · arXiv:2310.10170
• A Comparative Analysis of Task-Agnostic Distillation Methods for Compressing Transformer Language Models
  13 Oct 2023 · 0 repositories · arXiv:2310.08797
• Dialogue Chain-of-Thought Distillation for Commonsense-aware Conversational Agents
  13 Oct 2023 · 1 repository · arXiv:2310.09343
  Syntology official: no sample here; runs from other or unrecorded repositories · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 2 harvested samples)
• Revisiting Multi-modal 3D Semantic Segmentation in Real-world Autonomous Driving
  13 Oct 2023 · 0 repositories · arXiv:2310.08826
• DistillSpec: Improving Speculative Decoding via Knowledge Distillation
  12 Oct 2023 · 0 repositories · arXiv:2310.08461
• Transport-Hub-Aware Spatial-Temporal Adaptive Graph Transformer for Traffic Flow Prediction
  12 Oct 2023 · 1 repository · arXiv:2310.08328
• A Discrepancy Aware Framework for Robust Anomaly Detection
  11 Oct 2023 · 1 repository · arXiv:2310.07585
• DASpeech: Directed Acyclic Transformer for Fast and High-quality Speech-to-Speech Translation
  11 Oct 2023 · 1 repository · arXiv:2310.07403
  Syntology official (archive's flag): 5 ran · 5 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 7 harvested samples) · 7 pointer-only (licence)
• Distilling Efficient Vision Transformers from CNNs for Semantic Segmentation
  11 Oct 2023 · 0 repositories · arXiv:2310.07265
• Online Speculative Decoding
  11 Oct 2023 · 1 repository · arXiv:2310.07177
  Syntology official (archive's flag): 11 ran · 11 ran (of which 0 constructed an object rather than computing a result; 9 with no instrument failure: 0 honoured, 0 violated, 9 with no contract checked; 2 where Syntology's instrument failed) · 2 unverified (of 13 harvested samples) · 13 pointer-only (licence)
• Distillation Improves Visual Place Recognition for Low Quality Images
  10 Oct 2023 · 1 repository · arXiv:2310.06906
• Knowledge Distillation for Anomaly Detection
  9 Oct 2023 · 0 repositories · arXiv:2310.06047
• Applying Knowledge Distillation to Improve Weed Mapping With Drones
  8 Oct 2023 · 1 repository
• DED: Diagnostic Evidence Distillation for acne severity grading on face images
  5 Oct 2023 · 1 repository
• LumiNet: The Bright Side of Perceptual Knowledge Distillation
  5 Oct 2023 · 1 repository · arXiv:2310.03669
• Heterogeneous Federated Learning Using Knowledge Codistillation
  4 Oct 2023 · 0 repositories · arXiv:2310.02549
• I²KD-SLU: An Intra-Inter Knowledge Distillation Framework for Zero-Shot Cross-Lingual Spoken Language Understanding
  4 Oct 2023 · 0 repositories · arXiv:2310.02594
• Talking Models: Distill Pre-trained Knowledge to Downstream Models via Interactive Communication
  4 Oct 2023 · 0 repositories · arXiv:2310.03188
• Can a student Large Language Model perform as well as it's teacher?
  3 Oct 2023 · 0 repositories · arXiv:2310.02421
• SEA: Sparse Linear Attention with Estimated Attention Mask
  3 Oct 2023 · 1 repository · arXiv:2310.01777
  Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 2 harvested samples) · 2 pointer-only (licence)
• Distilling Influences to Mitigate Prediction Churn in Graph Neural Networks
  2 Oct 2023 · 1 repository · arXiv:2310.00946
• Learnable Cross-modal Knowledge Distillation for Multi-modal Learning with Missing Modality
  2 Oct 2023 · 0 repositories · arXiv:2310.01035
• Towards Fixing Clever-Hans Predictors with Counterfactual Knowledge Distillation
  2 Oct 2023 · 0 repositories · arXiv:2310.01011