Browse State-of-the-Art › Knowledge Distillation › Papers, page 21

Knowledge Distillation

Papers archive 2025-07-28

archive papers tagged: 4,240 · with a code link: 1,740 · where Syntology ran a sample: 451 (380 with a run with no instrument failure, 71 where every run was a failure of Syntology's instrument) Syntology

Show: all tagged papersonly where code ran (451 of 4,240 tagged: 380 with a run with no instrument failure, 71 where every run was a failure of Syntology's instrument)

Page 21 of 43: papers 2,001 to 2,100 of 4,240, in archive order: by repositories listed in the archive (most first), then newest first, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers that list no repository come after every paper that lists one.

Papers without a page here are shown as plain text. A Syntology line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the figure “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code); hover it for the repositories the samples that ran came from. Abstracts are on each paper's page.

• On Accelerating Edge AI: Optimizing Resource-Constrained Environments
  25 Jan 2025 0 repositories listed
• Pre-trained Model Guided Mixture Knowledge Distillation for Adversarial Federated Learning
  25 Jan 2025 0 repositories listed
• Multimodal Prescriptive Deep Learning
  24 Jan 2025 0 repositories listed
• Remining Hard Negatives for Generative Pseudo Labeled Domain Adaptation
  24 Jan 2025 0 repositories listed
• Unlearning Clients, Features and Samples in Vertical Federated Learning
  23 Jan 2025 0 repositories listed
• EchoLM: Accelerating LLM Serving with Real-time Knowledge Distillation
  22 Jan 2025 0 repositories listed
• Extracting General-use Transformers for Low-resource Languages via Knowledge Distillation
  22 Jan 2025 0 repositories listed
• LiT: Delving into a Simplified Linear Diffusion Transformer for Image Generation
  22 Jan 2025 0 repositories listed
• Toward Model-centric Heterogeneous Federated Graph Learning: A Knowledge-driven Approach
  22 Jan 2025 0 repositories listed
• DNA 1.0 Technical Report
  18 Jan 2025 0 repositories listed
• Learning to reconstruct signals with inexact sensing operator via knowledge distillation
  18 Jan 2025 0 repositories listed
• Enhancing Generalization in Chain of Thought Reasoning for Smaller Models
  16 Jan 2025 0 repositories listed
• Knowledge Distillation for Image Restoration : Simultaneous Learning from Degraded and Clean Images
  16 Jan 2025 0 repositories listed
• Soft Knowledge Distillation with Multi-Dimensional Cross-Net Attention for Image Restoration Models Compression
  16 Jan 2025 0 repositories listed
• Feature-based One-For-All: A Universal Framework for Heterogeneous Knowledge Distillation
  15 Jan 2025 0 repositories listed Syntology 13 ran (of which 8 constructed an object rather than computing a result; 9 with no instrument failure: 1 honoured, 0 violated, 8 with no contract checked; 4 where Syntology's instrument failed) · 3 unverified (of 16 harvested samples)
• Balance Divergence for Knowledge Distillation
  14 Jan 2025 0 repositories listed
• Dual Scale-aware Adaptive Masked Knowledge Distillation for Object Detection
  13 Jan 2025 0 repositories listed
• Knowledge Distillation and Enhanced Subdomain Adaptation Using Graph Convolutional Network for Resource-Constrained Bearing Fault Diagnosis
  13 Jan 2025 0 repositories listed
• Research on the Online Update Method for Retrieval-Augmented Generation (RAG) Model with Incremental Learning
  13 Jan 2025 0 repositories listed
• Rethinking Knowledge in Distillation: An In-context Sample Retrieval Perspective
  13 Jan 2025 0 repositories listed
• Application of Vision-Language Model to Pedestrians Behavior and Scene Understanding in Autonomous Driving
  12 Jan 2025 0 repositories listed
• Overcoming Language Priors for Visual Question Answering Based on Knowledge Distillation
  10 Jan 2025 0 repositories listed
• Enhancing Scene Classification in Cloudy Image Scenarios: A Collaborative Transfer Method with Information Regulation Mechanism using Optical Cloud-Covered and SAR Remote Sensing Images
  8 Jan 2025 0 repositories listed
• Federated Fine-Tuning of LLMs: Framework Comparison and Research Directions
  8 Jan 2025 0 repositories listed
• Generative Dataset Distillation Based on Self-knowledge Distillation
  8 Jan 2025 0 repositories listed
• Comprehensive Pathological Image Segmentation via Teacher Aggregation for Tumor Microenvironment Analysis
  6 Jan 2025 0 repositories listed
• Knowledge Distillation with Adapted Weight
  6 Jan 2025 0 repositories listed
• Strategic Fusion Optimizes Transformer Compression
  5 Jan 2025 0 repositories listed
• Distillation-Enhanced Physical Adversarial Attacks
  4 Jan 2025 0 repositories listed
• Prepending or Cross-Attention for Speech-to-Text? An Empirical Comparison
  4 Jan 2025 0 repositories listed
• MoVE-KD: Knowledge Distillation for VLMs with Mixture of Visual Encoders
  3 Jan 2025 0 repositories listed Syntology 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples)
• DiagrammaticLearning: A Graphical Language for Compositional Training Regimes
  2 Jan 2025 0 repositories listed
• ADU: Adaptive Detection of Unknown Categories in Black-Box Domain Adaptation
  1 Jan 2025 0 repositories listed
• BiM-VFI: Bidirectional Motion Field-Guided Frame Interpolation for Video with Non-uniform Motions
  1 Jan 2025 0 repositories listed
• CoMBO: Conflict Mitigation via Branched Optimization for Class Incremental Segmentation
  1 Jan 2025 0 repositories listed
• Distilling Monocular Foundation Model for Fine-grained Depth Completion
  1 Jan 2025 0 repositories listed
• Distilling Spatially-Heterogeneous Distortion Perception for Blind Image Quality Assessment
  1 Jan 2025 0 repositories listed
• LENS-XAI: Redefining Lightweight and Explainable Network Security through Knowledge Distillation and Variational Autoencoders for Scalable Intrusion Detection in Cybersecurity
  1 Jan 2025 0 repositories listed
• Random Conditioning for Diffusion Model Compression with Distillation
  1 Jan 2025 0 repositories listed
• Simplification Is All You Need against Out-of-Distribution Overconfidence
  1 Jan 2025 0 repositories listed
• Targeted Forgetting of Image Subgroups in CLIP Models
  1 Jan 2025 0 repositories listed
• Tripartite Weight-Space Ensemble for Few-Shot Class-Incremental Learning
  1 Jan 2025 0 repositories listed
• VL2Lite: Task-Specific Knowledge Distillation from Large Vision-Language Models to Lightweight Networks
  1 Jan 2025 0 repositories listed
• Pan-infection Foundation Framework Enables Multiple Pathogen Prediction
  31 Dec 2024 0 repositories listed
• ECG-guided individual identification via PPG
  30 Dec 2024 0 repositories listed
• Improving Acoustic Scene Classification in Low-Resource Conditions
  30 Dec 2024 0 repositories listed
• Temporal reasoning for timeline summarisation in social media
  30 Dec 2024 0 repositories listed
• Injecting Explainability and Lightweight Design into Weakly Supervised Video Anomaly Detection Systems
  28 Dec 2024 0 repositories listed
• Feature Alignment-Based Knowledge Distillation for Efficient Compression of Large Language Models
  27 Dec 2024 0 repositories listed
• HTR-JAND: Handwritten Text Recognition with Joint Attention Network and Knowledge Distillation
  24 Dec 2024 0 repositories listed
• Better Knowledge Enhancement for Privacy-Preserving Cross-Project Defect Prediction
  23 Dec 2024 0 repositories listed
• Exploiting Label Skewness for Spiking Neural Networks in Federated Learning
  23 Dec 2024 0 repositories listed
• CBNN: 3-Party Secure Framework for Customized Binary Neural Networks Inference
  21 Dec 2024 0 repositories listed
• Distilling Large Language Models for Efficient Clinical Information Extraction
  21 Dec 2024 0 repositories listed
• A New Method to Capturing Compositional Knowledge in Linguistic Space
  20 Dec 2024 0 repositories listed
• BabyHGRN: Exploring RNNs for Sample-Efficient Training of Language Models
  20 Dec 2024 0 repositories listed
• SCKD: Semi-Supervised Cross-Modality Knowledge Distillation for 4D Radar Object Detection
  19 Dec 2024 0 repositories listed
• Self-Evolution Knowledge Distillation for LLM-based Machine Translation
  19 Dec 2024 0 repositories listed
• Uncertainty-Guided Cross Attention Ensemble Mean Teacher for Semi-supervised Medical Image Segmentation
  19 Dec 2024 0 repositories listed
• Canine EEG Helps Human: Cross-Species and Cross-Modality Epileptic Seizure Detection via Multi-Space Alignment
  18 Dec 2024 0 repositories listed
• On Explaining Knowledge Distillation: Measuring and Visualising the Knowledge Transfer Process
  18 Dec 2024 0 repositories listed
• On the Compression of Language Models for Code: An Empirical Study on CodeBERT
  18 Dec 2024 0 repositories listed
• Efficient Speech Command Recognition Leveraging Spiking Neural Network and Curriculum Learning-based Knowledge Distillation
  17 Dec 2024 0 repositories listed
• Entire-Space Variational Information Exploitation for Post-Click Conversion Rate Prediction
  17 Dec 2024 0 repositories listed
• In-Context Learning Distillation for Efficient Few-Shot Fine-Tuning
  17 Dec 2024 0 repositories listed
• Modality-Inconsistent Continual Learning of Multimodal Large Language Models
  17 Dec 2024 0 repositories listed
• PromptDet: A Lightweight 3D Object Detection Framework with LiDAR Prompts
  17 Dec 2024 0 repositories listed
• Split Knowledge Distillation for Large Models in IoT: Architecture, Challenges, and Solutions
  17 Dec 2024 0 repositories listed
• Neural Collapse Inspired Knowledge Distillation
  16 Dec 2024 0 repositories listed
• Active Large Language Model-based Knowledge Distillation for Session-based Recommendation
  15 Dec 2024 0 repositories listed
• Knowledge Migration Framework for Smart Contract Vulnerability Detection
  15 Dec 2024 0 repositories listed
• On Distilling the Displacement Knowledge for Few-Shot Class-Incremental Learning
  15 Dec 2024 0 repositories listed
• ProFe: Communication-Efficient Decentralized Federated Learning via Distillation and Prototypes
  15 Dec 2024 0 repositories listed
• Wearable Accelerometer Foundation Models for Health via Knowledge Distillation
  15 Dec 2024 0 repositories listed
• Can Students Beyond The Teacher? Distilling Knowledge from Teacher's Bias
  13 Dec 2024 0 repositories listed
• LLM Distillation for Efficient Few-Shot Multiple Choice Question Answering
  13 Dec 2024 0 repositories listed
• ScaleOT: Privacy-utility-scalable Offsite-tuning with Dynamic LayerReplace and Selective Rank Compression
  13 Dec 2024 0 repositories listed
• A Theoretical Analysis of Soft-Label vs Hard-Label Training in Neural Networks
  12 Dec 2024 0 repositories listed
• All You Need in Knowledge Distillation Is a Tailored Coordinate System
  12 Dec 2024 0 repositories listed
• Optimising TinyML with Quantization and Distillation of Transformer and Mamba Models for Indoor Localisation on Edge Devices
  12 Dec 2024 0 repositories listed
• SnapGen: Taming High-Resolution Text-to-Image Models for Mobile Devices with Efficient Architectures and Training
  12 Dec 2024 0 repositories listed
• DAKD: Data Augmentation and Knowledge Distillation using Diffusion Models for SAR Oil Spill Segmentation
  11 Dec 2024 0 repositories listed
• Efficient Gravitational Wave Parameter Estimation via Knowledge Distillation: A ResNet1D-IAF Approach
  11 Dec 2024 0 repositories listed
• TT-MPD: Test Time Model Pruning and Distillation
  10 Dec 2024 0 repositories listed
• U-Know-DiffPAN: An Uncertainty-aware Knowledge Distillation Diffusion Framework with Details Enhancement for PAN-Sharpening
  9 Dec 2024 0 repositories listed
• Domain-Specific Translation with Open-Source Large Language Models: Resource-Oriented Analysis
  8 Dec 2024 0 repositories listed
• Enhancing Content Representation for AR Image Quality Assessment Using Knowledge Distillation
  8 Dec 2024 0 repositories listed
• Neighborhood Commonality-aware Evolution Network for Continuous Generalized Category Discovery
  7 Dec 2024 0 repositories listed
• BEExformer: A Fast Inferencing Transformer Architecture via Binarization with Multiple Early Exits
  6 Dec 2024 0 repositories listed
• CCS: Continuous Learning for Customized Incremental Wireless Sensing Services
  6 Dec 2024 0 repositories listed
• Diffusion-Augmented Coreset Expansion for Scalable Dataset Distillation
  5 Dec 2024 0 repositories listed
• Expanding Deep Learning-based Sensing Systems with Multi-Source Knowledge Transfer
  5 Dec 2024 0 repositories listed
• Distillation of Diffusion Features for Semantic Correspondence
  4 Dec 2024 0 repositories listed
• Enhancing CLIP Conceptual Embedding through Knowledge Distillation
  4 Dec 2024 0 repositories listed
• Multi-Branch Mutual-Distillation Transformer for EEG-Based Seizure Subtype Classification
  4 Dec 2024 0 repositories listed
• Local vs. Global: Local Land-Use and Land-Cover Models Deliver Higher Quality Maps
  1 Dec 2024 0 repositories listed
• QABISAR: Query-Article Bipartite Interactions for Statutory Article Retrieval
  1 Dec 2024 0 repositories listed
• Continuous Concepts Removal in Text-to-image Diffusion Models
  30 Nov 2024 0 repositories listed
• Toward Fair Graph Neural Networks Via Dual-Teacher Knowledge Distillation
  30 Nov 2024 0 repositories listed
• Reverse Thinking Makes LLMs Stronger Reasoners
  29 Nov 2024 0 repositories listed

Syntology lines on 2 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced; each line links to that paper's sample list. Syntology's record for this page has not changed since 2026-09-28, the first build that kept a record date for it; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.