Browse State-of-the-Art › Knowledge Distillation › Papers, page 20

Knowledge Distillation

Papers archive 2025-07-28

archive papers tagged: 4,240 · with a code link: 1,740 · where Syntology ran a sample: 451 (380 with a run with no instrument failure, 71 where every run was a failure of Syntology's instrument) Syntology

Show: all tagged papersonly where code ran (451 of 4,240 tagged: 380 with a run with no instrument failure, 71 where every run was a failure of Syntology's instrument)

Page 20 of 43: papers 1,901 to 2,000 of 4,240, in archive order: by repositories listed in the archive (most first), then newest first, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers that list no repository come after every paper that lists one.

Papers without a page here are shown as plain text. A Syntology line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the figure “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code); hover it for the repositories the samples that ran came from. Abstracts are on each paper's page.

• Improving Acoustic Scene Classification with City Features
  21 Mar 2025 0 repositories listed
• Efficient Intent-Based Filtering for Multi-Party Conversations Using Knowledge Distillation from LLMs
  21 Mar 2025 0 repositories listed
• Efficient Knowledge Distillation via Curriculum Extraction
  21 Mar 2025 0 repositories listed
• InhibiDistilbert: Knowledge Distillation for a ReLU and Addition-based Transformer
  20 Mar 2025 0 repositories listed
• Advancing Deep Learning through Probability Engineering: A Pragmatic Paradigm for Modern AI
  19 Mar 2025 0 repositories listed
• Distilling 3D distinctive local descriptors for 6D pose estimation
  19 Mar 2025 0 repositories listed
• KoGNER: A Novel Framework for Knowledge Graph Distillation on Biomedical Named Entity Recognition
  19 Mar 2025 0 repositories listed
• Ensemble Knowledge Distillation for Machine Learning Interatomic Potentials
  18 Mar 2025 0 repositories listed
• SCJD: Sparse Correlation and Joint Distillation for Efficient 3D Human Pose Estimation
  18 Mar 2025 0 repositories listed
• Uncertainty-Aware Knowledge Distillation for Compact and Efficient 6DoF Pose Estimation
  17 Mar 2025 0 repositories listed
• Creating a Good Teacher for Knowledge Distillation in Acoustic Scene Classification
  14 Mar 2025 0 repositories listed
• Enabling Weak Client Participation via On-device Knowledge Distillation in Heterogenous Federated Learning
  14 Mar 2025 0 repositories listed
• CleverDistiller: Simple and Spatially Consistent Cross-modal Distillation
  12 Mar 2025 0 repositories listed
• Unified Locomotion Transformer with Simultaneous Sim-to-Real Transfer for Quadrupeds
  12 Mar 2025 0 repositories listed
• Vi-LAD: Vision-Language Attention Distillation for Socially-Aware Robot Navigation in Dynamic Environments
  12 Mar 2025 0 repositories listed
• xVLM2Vec: Adapting LVLM-based embedding models to multilinguality using Self-Knowledge Distillation
  12 Mar 2025 0 repositories listed
• ADROIT: A Self-Supervised Framework for Learning Robust Representations for Active Learning
  10 Mar 2025 0 repositories listed
• CoT-Drive: Efficient Motion Forecasting for Autonomous Driving with LLMs and Chain-of-Thought Prompting
  10 Mar 2025 0 repositories listed
• Distilling Knowledge into Quantum Vision Transformers for Biomedical Image Classification
  10 Mar 2025 0 repositories listed
• PTMs-TSCIL Pre-Trained Models Based Class-Incremental Learning
  10 Mar 2025 0 repositories listed
• Task-Specific Knowledge Distillation from the Vision Foundation Model for Enhanced Medical Image Segmentation
  10 Mar 2025 0 repositories listed
• Training Domain Draft Models for Speculative Decoding: Best Practices and Insights
  10 Mar 2025 0 repositories listed
• Asymmetric Decision-Making in Online Knowledge Distillation:Unifying Consensus and Divergence
  9 Mar 2025 0 repositories listed
• Causality Enhanced Origin-Destination Flow Prediction in Data-Scarce Cities
  9 Mar 2025 0 repositories listed
• HFedCKD: Toward Robust Heterogeneous Federated Learning via Data-free Knowledge Distillation and Two-way Contrast
  9 Mar 2025 0 repositories listed
• Small Vision-Language Models: A Survey on Compact Architectures and Techniques
  9 Mar 2025 0 repositories listed
• ACAM-KD: Adaptive and Cooperative Attention Masking for Knowledge Distillation
  8 Mar 2025 0 repositories listed
• Improving SAM for Camouflaged Object Detection via Dual Stream Adapters
  8 Mar 2025 0 repositories listed
• No Forgetting Learning: Memory-free Continual Learning
  6 Mar 2025 0 repositories listed
• Lightweight Embedded FPGA Deployment of Learned Image Compression with Knowledge Distillation and Hybrid Quantization
  5 Mar 2025 0 repositories listed
• Temporal Separation with Entropy Regularization for Knowledge Distillation in Spiking Neural Networks
  5 Mar 2025 0 repositories listed Syntology 3 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 2 where Syntology's instrument failed) · 1 unverified (of 4 harvested samples)
• Rapid Bone Scintigraphy Enhancement via Semantic Prior Distillation from Segment Anything Model
  4 Mar 2025 0 repositories listed
• DILEMMA: Joint LLM Quantization and Distributed LLM Inference Over Edge Computing Systems
  3 Mar 2025 0 repositories listed
• Mamba base PKD for efficient knowledge compression
  3 Mar 2025 0 repositories listed
• VRM: Knowledge Distillation via Virtual Relation Matching
  28 Feb 2025 0 repositories listed Syntology 3 ran (of which 1 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 1 violated, 1 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples) · 3 pointer-only (licence)
• Beyond the Tip of Efficiency: Uncovering the Submerged Threats of Jailbreak Attacks in Small Language Models
  27 Feb 2025 0 repositories listed
• Granite Embedding Models
  27 Feb 2025 0 repositories listed
• Investigating and Enhancing Vision-Audio Capability in Omnimodal Large Language Models
  27 Feb 2025 0 repositories listed
• Lightweight Contrastive Distilled Hashing for Online Cross-modal Retrieval
  27 Feb 2025 0 repositories listed
• SEKI: Self-Evolution and Knowledge Inspiration based Neural Architecture Search via Large Language Models
  27 Feb 2025 0 repositories listed
• XCOMPS: A Multilingual Benchmark of Conceptual Minimal Pairs
  27 Feb 2025 0 repositories listed
• Winning Big with Small Models: Knowledge Distillation vs. Self-Training for Reducing Hallucination in QA Agents
  26 Feb 2025 0 repositories listed
• AfroXLMR-Comet: Multilingual Knowledge Distillation with Attention Matching for Low-Resource languages
  25 Feb 2025 0 repositories listed
• A Transformer-in-Transformer Network Utilizing Knowledge Distillation for Image Recognition
  24 Feb 2025 0 repositories listed
• CoT2Align: Cross-Chain of Thought Distillation via Optimal Transport Alignment for Language Models with Different Tokenizers
  24 Feb 2025 0 repositories listed
• Implicit Word Reordering with Knowledge Distillation for Cross-Lingual Dependency Parsing
  24 Feb 2025 0 repositories listed
• Improving the Transferability of Adversarial Examples by Inverse Knowledge Distillation
  24 Feb 2025 0 repositories listed
• Knowledge Distillation with Training Wheels
  24 Feb 2025 0 repositories listed
• PQDAST: Depth-Aware Arbitrary Style Transfer for Games via Perceptual Quality-Guided Distillation
  24 Feb 2025 0 repositories listed
• EDocNet: Efficient Datasheet Layout Analysis Based on Focus and Global Knowledge Distillation
  23 Feb 2025 0 repositories listed
• PPC-GPT: Federated Task-Specific Compression of Large Language Models via Pruning and Chain-of-Thought Distillation
  21 Feb 2025 0 repositories listed
• Designing Parameter and Compute Efficient Diffusion Transformers using Distillation
  20 Feb 2025 0 repositories listed
• Efficient AI in Practice: Training and Deployment of Efficient LLMs for Industry Applications
  20 Feb 2025 0 repositories listed Syntology 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 5 harvested samples)
• Modifying Final Splits of Classification Tree for Fine-tuning Subpopulation Target in Policy Making
  20 Feb 2025 0 repositories listed
• Self-supervised Monocular Depth Estimation Robust to Reflective Surface Leveraged by Triplet Mining
  20 Feb 2025 0 repositories listed
• TimeDistill: Efficient Long-Term Time Series Forecasting with MLP via Cross-Architecture Distillation
  20 Feb 2025 0 repositories listed
• Vision Foundation Models in Medical Image Analysis: Advances and Challenges
  20 Feb 2025 0 repositories listed
• Capturing Rich Behavior Representations: A Dynamic Action Semantic-Aware Graph Transformer for Video Captioning
  19 Feb 2025 0 repositories listed
• Dynamic Activation with Knowledge Distillation for Energy-Efficient Spiking NN Ensembles
  19 Feb 2025 0 repositories listed
• MambaLiteSR: Image Super-Resolution with Low-Rank Mamba using Knowledge Distillation
  19 Feb 2025 0 repositories listed
• Enhancing Semi-supervised Learning with Zero-shot Pseudolabels
  18 Feb 2025 0 repositories listed
• Every Expert Matters: Towards Effective Knowledge Distillation for Mixture-of-Experts Language Models
  18 Feb 2025 0 repositories listed
• Integrating Arithmetic Learning Improves Mathematical Reasoning in Smaller Models
  18 Feb 2025 0 repositories listed
• NaturalReasoning: Reasoning in the Wild with 2.8M Challenging Questions
  18 Feb 2025 0 repositories listed
• Leveraging Conditional Mutual Information to Improve Large Language Model Fine-Tuning For Classification
  16 Feb 2025 0 repositories listed
• Smoothing Out Hallucinations: Mitigating LLM Hallucination with Smoothed Knowledge Distillation
  16 Feb 2025 0 repositories listed
• CLoCKDistill: Consistent Location-and-Context-aware Knowledge Distillation for DETRs
  15 Feb 2025 0 repositories listed
• LLM-driven Knowledge Distillation for Dynamic Text-Attributed Graphs
  15 Feb 2025 0 repositories listed
• AIDE: Agentically Improve Visual Language Model with Domain Experts
  13 Feb 2025 0 repositories listed
• LLM Pretraining with Continuous Concepts
  12 Feb 2025 0 repositories listed
• Life-Code: Central Dogma Modeling with Multi-Omics Sequence Unification
  11 Feb 2025 0 repositories listed
• Optimizing Knowledge Distillation in Transformers: Enabling Multi-Head Attention without Alignment Barriers
  11 Feb 2025 0 repositories listed
• Vision-Language Models for Edge Networks: A Comprehensive Survey
  11 Feb 2025 0 repositories listed
• Progressive Collaborative and Semantic Knowledge Fusion for Generative Recommendation
  10 Feb 2025 0 repositories listed
• Rationalization Models for Text-to-SQL
  10 Feb 2025 0 repositories listed
• Contrastive Representation Distillation via Multi-Scale Feature Decoupling
  9 Feb 2025 0 repositories listed
• Synergistic Effects of Knowledge Distillation and Structured Pruning for Self-Supervised Speech Models
  9 Feb 2025 0 repositories listed
• ATLAS: Autoformalizing Theorems through Lifting, Augmentation, and Synthesis of Data
  8 Feb 2025 0 repositories listed Syntology 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples)
• Demystifying Catastrophic Forgetting in Two-Stage Incremental Object Detector
  8 Feb 2025 0 repositories listed
• BOLT: Bootstrap Long Chain-of-Thought in Language Models without Distillation
  6 Feb 2025 0 repositories listed
• Revisiting Intermediate-Layer Matching in Knowledge Distillation: Layer-Selection Strategy Doesn't Matter (Much)
  6 Feb 2025 0 repositories listed
• A Unified Knowledge-Distillation and Semi-Supervised Learning Framework to Improve Industrial Ads Delivery Systems
  5 Feb 2025 0 repositories listed
• Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons
  5 Feb 2025 0 repositories listed
• A Framework for Double-Blind Federated Adaptation of Foundation Models
  3 Feb 2025 0 repositories listed
• MIND: Modality-Informed Knowledge Distillation Framework for Multimodal Clinical Prediction Tasks
  3 Feb 2025 0 repositories listed
• A method for estimating forest carbon storage distribution density via artificial intelligence generated content model
  2 Feb 2025 0 repositories listed
• Role of Mixup in Topological Persistence Based Knowledge Distillation for Wearable Sensor Data
  2 Feb 2025 0 repositories listed
• VLM-Assisted Continual learning for Visual Question Answering in Self-Driving
  2 Feb 2025 0 repositories listed
• Mini-ResEmoteNet: Leveraging Knowledge Distillation for Human-Centered Design
  30 Jan 2025 0 repositories listed
• Rethinking the Upsampling Layer in Hyperspectral Image Super Resolution
  30 Jan 2025 0 repositories listed
• RL-based Query Rewriting with Distilled LLM for online E-Commerce Systems
  29 Jan 2025 0 repositories listed
• A Contrastive Teacher-Student Framework for Novelty Detection under Style Shifts
  28 Jan 2025 0 repositories listed
• Efficient Knowledge Distillation of SAM for Medical Image Segmentation
  28 Jan 2025 0 repositories listed
• FedEFM: Federated Endovascular Foundation Model with Unseen Data
  28 Jan 2025 0 repositories listed
• Heterogeneity-aware Personalized Federated Learning via Adaptive Dual-Agent Reinforcement Learning
  28 Jan 2025 0 repositories listed
• TAID: Temporally Adaptive Interpolated Distillation for Efficient Knowledge Transfer in Language Models
  28 Jan 2025 0 repositories listed
• Target-driven Self-Distillation for Partial Observed Trajectories Forecasting
  28 Jan 2025 0 repositories listed
• PISCO: Pretty Simple Compression for Retrieval-Augmented Generation
  27 Jan 2025 0 repositories listed
• Scaling Large Vision-Language Models for Enhanced Multimodal Comprehension In Biomedical Image Analysis
  26 Jan 2025 0 repositories listed
• Graph-Based Cross-Domain Knowledge Distillation for Cross-Dataset Text-to-Image Person Retrieval
  25 Jan 2025 0 repositories listed

Syntology lines on 4 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced; each line links to that paper's sample list. Syntology's record for this page has not changed since 2026-09-28, the first build that kept a record date for it; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.