Browse State-of-the-Art › Knowledge Distillation › Papers, page 29

Knowledge Distillation

Papers archive 2025-07-28

archive papers tagged: 4,240 · with a code link: 1,740 · where Syntology ran a sample: 451 (380 with a run with no instrument failure, 71 where every run was a failure of Syntology's instrument) Syntology

Show: all tagged papersonly where code ran (451 of 4,240 tagged: 380 with a run with no instrument failure, 71 where every run was a failure of Syntology's instrument)

Page 29 of 43: papers 2,801 to 2,900 of 4,240, in archive order: by repositories listed in the archive (most first), then newest first, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers that list no repository come after every paper that lists one.

Papers without a page here are shown as plain text. A Syntology line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the figure “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code); hover it for the repositories the samples that ran came from. Abstracts are on each paper's page.

• Exploring Multi-Modal Contextual Knowledge for Open-Vocabulary Object Detection
  30 Aug 2023 0 repositories listed
• Improving Knowledge Distillation for BERT Models: Loss Functions, Mapping Methods, and Weight Tuning
  26 Aug 2023 0 repositories listed
• 3D Face Alignment Through Fusion of Head Pose Information and Features
  25 Aug 2023 0 repositories listed
• REFT: Resource-Efficient Federated Training Framework for Heterogeneous and Resource-Constrained Environments
  25 Aug 2023 0 repositories listed
• Self-Supervised Representation Learning with Cross-Context Learning between Global and Hypercolumn Features
  25 Aug 2023 0 repositories listed
• DLIP: Distilling Language-Image Pre-training
  24 Aug 2023 0 repositories listed
• Fall Detection using Knowledge Distillation Based Long short-term memory for Offline Embedded and Low Power Devices
  24 Aug 2023 0 repositories listed
• Efficient Controllable Multi-Task Architectures
  22 Aug 2023 0 repositories listed
• Multimodal Locally Enhanced Transformer for Continuous Sign Language Recognition
  22 Aug 2023 0 repositories listed
• Representation Disparity-aware Distillation for 3D Object Detection
  20 Aug 2023 0 repositories listed
• CCFace: Classification Consistency for Low-Resolution Face Recognition
  18 Aug 2023 0 repositories listed
• Unlimited Knowledge Distillation for Action Recognition in the Dark
  18 Aug 2023 0 repositories listed
• Learning Lightweight Object Detectors via Multi-Teacher Progressive Distillation
  17 Aug 2023 0 repositories listed
• Learning Through Guidance: Knowledge Distillation for Endoscopic Image Classification
  17 Aug 2023 0 repositories listed
• Radio2Text: Streaming Speech Recognition Using mmWave Radio Signals
  16 Aug 2023 0 repositories listed
• A Survey on Model Compression for Large Language Models
  15 Aug 2023 0 repositories listed
• Distilling Knowledge from Resource Management Algorithms to Neural Networks: A Unified Training Assistance Approach
  15 Aug 2023 0 repositories listed
• Continual Face Forgery Detection via Historical Distribution Preserving
  11 Aug 2023 0 repositories listed
• Towards General and Fast Video Derain via Knowledge Distillation
  10 Aug 2023 0 repositories listed
• FPGA Resource-aware Structured Pruning for Real-Time Neural Networks
  9 Aug 2023 0 repositories listed
• Sci-CoT: Leveraging Large Language Models for Enhanced Knowledge Distillation in Small Models for Scientific QA
  9 Aug 2023 0 repositories listed
• Teacher-Student Architecture for Knowledge Distillation: A Survey
  8 Aug 2023 0 repositories listed
• Adapter-based Selective Knowledge Distillation for Federated Multi-domain Meeting Summarization
  7 Aug 2023 0 repositories listed
• Class Incremental Learning with Self-Supervised Pre-Training and Prototype Learning
  4 Aug 2023 0 repositories listed
• Scene-aware Human Pose Generation using Transformer
  4 Aug 2023 0 repositories listed
• A vision transformer-based framework for knowledge transfer from multi-modal to mono-modal lymphoma subtyping models
  2 Aug 2023 0 repositories listed
• Leveraging Expert Models for Training Deep Neural Networks in Scarce Data Domains: Application to Offline Handwritten Signature Verification
  2 Aug 2023 0 repositories listed
• Three Factors to Improve Out-of-Distribution Detection
  2 Aug 2023 0 repositories listed
• Towards Better Query Classification with Multi-Expert Knowledge Condensation in JD Ads Search
  2 Aug 2023 0 repositories listed
• Ada-DQA: Adaptive Diverse Quality-aware Feature Acquisition for Video Quality Assessment
  1 Aug 2023 0 repositories listed
• Federated Learning for Data and Model Heterogeneity in Medical Imaging
  31 Jul 2023 0 repositories listed
• Sampling to Distill: Knowledge Transfer from Open-World Data
  31 Jul 2023 0 repositories listed
• UPFL: Unsupervised Personalized Federated Learning towards New Clients
  29 Jul 2023 0 repositories listed
• Incrementally-Computable Neural Networks: Efficient Inference for Dynamic Inputs
  27 Jul 2023 0 repositories listed
• Mitigating Cross-client GANs-based Attack in Federated Learning
  25 Jul 2023 0 repositories listed
• A Good Student is Cooperative and Reliable: CNN-Transformer Collaborative Learning for Semantic Segmentation
  24 Jul 2023 0 repositories listed
• HeteFedRec: Federated Recommender Systems with Model Heterogeneity
  24 Jul 2023 0 repositories listed
• Distribution Shift Matters for Knowledge Distillation with Webly Collected Images
  21 Jul 2023 0 repositories listed
• Model Compression Methods for YOLOv5: A Review
  21 Jul 2023 0 repositories listed
• Quantized Feature Distillation for Network Quantization
  20 Jul 2023 0 repositories listed
• Knowledge Distillation for Object Detection: from generic to remote sensing datasets
  18 Jul 2023 0 repositories listed
• Teach model to answer questions after comprehending the document
  18 Jul 2023 0 repositories listed
• Domain Knowledge Distillation from Large Language Model: An Empirical Study in the Autonomous Driving Domain
  17 Jul 2023 0 repositories listed
• A Survey of Techniques for Optimizing Transformer Inference
  16 Jul 2023 0 repositories listed
• Cross-Lingual NER for Financial Transaction Data in Low-Resource Languages
  16 Jul 2023 0 repositories listed
• MinT: Boosting Generalization in Mathematical Reasoning via Multi-View Fine-Tuning
  16 Jul 2023 0 repositories listed
• Intuitive Access to Smartphone Settings Using Relevance Model Trained by Contrastive Learning
  15 Jul 2023 0 repositories listed
• SoccerKDNet: A Knowledge Distillation Framework for Action Recognition in Soccer Videos
  15 Jul 2023 0 repositories listed
• DreamTeacher: Pretraining Image Backbones with Deep Generative Models
  14 Jul 2023 0 repositories listed
• A metric learning approach for endoscopic kidney stone identification
  13 Jul 2023 0 repositories listed
• The Staged Knowledge Distillation in Video Classification: Harmonizing Student Progress by a Complementary Weakly Supervised Framework
  11 Jul 2023 0 repositories listed
• Contextual Affinity Distillation for Image Anomaly Detection
  6 Jul 2023 0 repositories listed
• On-Device Constrained Self-Supervised Speech Representation Learning for Keyword Spotting via Knowledge Distillation
  6 Jul 2023 0 repositories listed
• Distilling Missing Modality Knowledge from Ultrasound for Endometriosis Diagnosis with Magnetic Resonance Images
  5 Jul 2023 0 repositories listed
• KDSTM: Neural Semi-supervised Topic Modeling with Knowledge Distillation
  4 Jul 2023 0 repositories listed Syntology 6 ran (of which 1 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 8 harvested samples)
• Review helps learn better: Temporal Supervised Knowledge Distillation
  3 Jul 2023 0 repositories listed
• Shared Growth of Graph Neural Networks via Prompted Free-direction Knowledge Distillation
  2 Jul 2023 0 repositories listed
• Long-Tailed Continual Learning For Visual Food Recognition
  1 Jul 2023 0 repositories listed
• Streaming egocentric action anticipation: An evaluation scheme and approach
  29 Jun 2023 0 repositories listed
• Understanding the Overfitting of the Episodic Meta-training
  29 Jun 2023 0 repositories listed
• A Dimensional Structure based Knowledge Distillation Method for Cross-Modal Learning
  28 Jun 2023 0 repositories listed
• Exploring Dual Model Knowledge Distillation for Anomaly Detection
  27 Jun 2023 0 repositories listed
• Reducing the gap between streaming and non-streaming Transducer-based ASR by adaptive two-stage knowledge distillation
  27 Jun 2023 0 repositories listed
• Shoggoth: Towards Efficient Edge-Cloud Collaborative Real-Time Video Inference via Adaptive Online Learning
  27 Jun 2023 0 repositories listed
• Accelerating Molecular Graph Neural Networks via Knowledge Distillation
  26 Jun 2023 0 repositories listed
• Cross Architecture Distillation for Face Recognition
  26 Jun 2023 0 repositories listed
• Federated Learning on Non-iid Data via Local and Global Distillation
  26 Jun 2023 0 repositories listed
• Enhancing Mapless Trajectory Prediction through Knowledge Distillation
  25 Jun 2023 0 repositories listed
• Feature Adversarial Distillation for Point Cloud Classification
  25 Jun 2023 0 repositories listed
• On-Policy Distillation of Language Models: Learning from Self-Generated Mistakes
  23 Jun 2023 0 repositories listed
• Knowledge Distillation via Token-level Relationship Graph
  20 Jun 2023 0 repositories listed
• Recent Advances in Direct Speech-to-text Translation
  20 Jun 2023 0 repositories listed
• Categories of Response-Based, Feature-Based, and Relation-Based Knowledge Distillation
  19 Jun 2023 0 repositories listed
• FSAR: Federated Skeleton-based Action Recognition with Adaptive Topology Structure and Knowledge Distillation
  19 Jun 2023 0 repositories listed
• Semi-Supervised Learning for Multi-Label Cardiovascular Diseases Prediction:A Multi-Dataset Study
  18 Jun 2023 0 repositories listed
• Knowledge Distillation for Efficient Audio-Visual Video Captioning
  16 Jun 2023 0 repositories listed
• Squeezing nnU-Nets with Knowledge Distillation for On-Board Cloud Detection
  16 Jun 2023 0 repositories listed
• Self-Knowledge Distillation for Surgical Phase Recognition
  15 Jun 2023 0 repositories listed
• Heterogeneous Continual Learning
  14 Jun 2023 0 repositories listed
• Enhanced Multimodal Representation Learning with Cross-modal KD
  13 Jun 2023 0 repositories listed
• Improving Frame-level Classifier for Word Timings with Non-peaky CTC in End-to-End Automatic Speech Recognition
  9 Jun 2023 0 repositories listed
• BOOT: Data-free Distillation of Denoising Diffusion Models with Bootstrapping
  8 Jun 2023 0 repositories listed
• Population-Based Evolutionary Gaming for Unsupervised Person Re-identification
  8 Jun 2023 0 repositories listed
• The economic trade-offs of large language models: A case study
  8 Jun 2023 0 repositories listed
• Faithful Knowledge Distillation
  7 Jun 2023 0 repositories listed
• Zero shot framework for satellite image restoration
  5 Jun 2023 0 repositories listed
• Modular Transformers: Compressing Transformers into Modularized Layers for Flexible Efficient Inference
  4 Jun 2023 0 repositories listed
• Privacy Distillation: Reducing Re-identification Risk of Multimodal Diffusion Models
  2 Jun 2023 0 repositories listed
• Speech Translation with Foundation Models and Optimal Transport: UPC at IWSLT23
  2 Jun 2023 0 repositories listed
• Improved Cross-Lingual Transfer Learning For Automatic Speech Translation
  1 Jun 2023 0 repositories listed
• Accurate and Structured Pruning for Efficient Automatic Speech Recognition
  31 May 2023 0 repositories listed
• A Recipe for Efficient SBIR Models: Combining Relative Triplet Loss with Batch Normalization and Knowledge Distillation
  30 May 2023 0 repositories listed
• KEYword based Sampling (KEYS) for Large Language Models
  30 May 2023 0 repositories listed
• Research on Multilingual News Clustering Based on Cross-Language Word Embeddings
  30 May 2023 0 repositories listed
• GripRank: Bridging the Gap between Retrieval and Generation via the Generative Knowledge Improved Passage Ranking
  29 May 2023 0 repositories listed
• ConaCLIP: Exploring Distillation of Fully-Connected Knowledge Interaction Graph for Lightweight Text-Image Retrieval
  28 May 2023 0 repositories listed
• ABC-KD: Attention-Based-Compression Knowledge Distillation for Deep Learning-Based Noise Suppression
  26 May 2023 0 repositories listed
• Collective Knowledge Graph Completion with Mutual Knowledge Distillation
  25 May 2023 0 repositories listed
• Cross-Lingual Knowledge Distillation for Answer Sentence Selection in Low-Resource Languages
  25 May 2023 0 repositories listed
• Fairness Continual Learning Approach to Semantic Scene Understanding in Open-World Environments
  25 May 2023 0 repositories listed

Syntology lines on 1 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced; each line links to that paper's sample list. Syntology's record for this page has not changed since 2026-09-28, the first build that kept a record date for it; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.