Browse State-of-the-Art › Knowledge Distillation › Papers, page 19
Knowledge Distillation
Papers archive 2025-07-28
archive papers tagged: 4,240 · with a code link: 1,740 · where Syntology ran a sample: 451 (380 with a run with no instrument failure, 71 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (451 of 4,240 tagged: 380 with a run with no instrument failure, 71 where every run was a failure of Syntology's instrument)
Page 19 of 43: papers 1,801 to 1,900 of 4,240, in archive order: by repositories listed in the archive (most first), then newest first, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers that list no repository come after every paper that lists one.
Papers without a page here are shown as plain text. A Syntology line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the figure “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code); hover it for the repositories the samples that ran came from. Abstracts are on each paper's page.
-
An Efficient Private GPT Never Autoregressively Decodes21 May 2025 0 repositories listed
-
MentalMAC: Enhancing Large Language Models for Detecting Mental Manipulation via Multi-Task Anti-Curriculum Distillation21 May 2025 0 repositories listed
-
Bridge the Gap between Past and Future: Siamese Model Optimization for Context-Aware Document Ranking20 May 2025 0 repositories listed
-
Ground-V: Teaching VLMs to Ground Complex Instructions in Pixels20 May 2025 0 repositories listed
-
Improved Methods for Model Pruning and Knowledge Distillation20 May 2025 0 repositories listed
-
Interpretable Traces, Unexpected Outcomes: Investigating the Disconnect in Trace-Based Knowledge Distillation20 May 2025 0 repositories listed
-
Bridging the Modality Gap: Enhancing Channel Prediction with Semantically Aligned LLMs and Knowledge Distillation19 May 2025 0 repositories listed
-
ORQA: A Benchmark and Foundation Model for Holistic Operating Room Modeling19 May 2025 0 repositories listed
-
Why Knowledge Distillation Works in Generative Models: A Minimal Working Explanation19 May 2025 0 repositories listed
-
LAMeTA: Intent-Aware Agentic Network Optimization via a Large AI Model-Empowered Two-Stage Approach18 May 2025 0 repositories listed
-
SSR: Enhancing Depth Perception in Vision-Language Models via Rationale-Guided Spatial Reasoning18 May 2025 0 repositories listed
-
Denoising Mutual Knowledge Distillation in Bi-Directional Multiple Instance Learning17 May 2025 0 repositories listed
-
FiGKD: Fine-Grained Knowledge Distillation via High-Frequency Detail Transfer17 May 2025 0 repositories listed
-
Bidirectional Distillation: A Mixed-Play Framework for Multi-Agent Generalizable Behaviors16 May 2025 0 repositories listed
-
Semantically-Aware Game Image Quality Assessment16 May 2025 0 repositories listed
-
Advancing Multiple Instance Learning with Continual Learning for Whole Slide Imaging15 May 2025 0 repositories listed
-
DCSNet: A Lightweight Knowledge Distillation-Based Model with Explainable AI for Lung Cancer Diagnosis from Histopathological Images14 May 2025 0 repositories listed
-
Fusing Bidirectional Chains of Thought and Reward Mechanisms A Method for Enhancing Question-Answering Capabilities of Large Language Models for Chinese Intangible Cultural Heritage13 May 2025 0 repositories listed
-
Low-Complexity Inference in Continual Learning via Compressed Knowledge Transfer13 May 2025 0 repositories listed
-
MoKD: Multi-Task Optimization for Knowledge Distillation13 May 2025 0 repositories listed
-
An Extra RMSNorm is All You Need for Fine Tuning to 1.58 Bits12 May 2025 0 repositories listed
-
Channel Fingerprint Construction for Massive MIMO: A Deep Conditional Generative Approach12 May 2025 0 repositories listed
-
KDH-MLTC: Knowledge Distillation for Healthcare Multi-Label Text Classification12 May 2025 0 repositories listed
-
Ranking-aware Continual Learning for LiDAR Place Recognition12 May 2025 0 repositories listed
-
Knowledge Distillation for Enhancing Walmart E-commerce Search Relevance Using Large Language Models11 May 2025 0 repositories listed
-
Human in the Latent Loop (HILL): Interactively Guiding Model Training Through Human Intuition9 May 2025 0 repositories listed
-
Robust & Precise Knowledge Distillation-based Novel Context-Aware Predictor for Disease Detection in Brain and Gastrointestinal9 May 2025 0 repositories listed
-
Federated Deconfounding and Debiasing Learning for Out-of-Distribution Generalization8 May 2025 0 repositories listed
-
Theoretical Guarantees for LT-TTD: A Unified Transformer-based Architecture for Two-Level Ranking Systems7 May 2025 0 repositories listed
-
Action Spotting and Precise Event Detection in Sports: Datasets, Methods, and Challenges6 May 2025 0 repositories listed
-
Artificial Behavior Intelligence: Technology, Challenges, and Future Directions6 May 2025 0 repositories listed
-
Image Recognition with Online Lightweight Vision Transformer: A Survey6 May 2025 0 repositories listed
-
Knowledge Distillation for Speech Denoising by Latent Representation Alignment with Cosine Distance6 May 2025 0 repositories listed
-
SepALM: Audio Language Models Are Error Correctors for Robust Speech Separation6 May 2025 0 repositories listed
-
AKD : Adversarial Knowledge Distillation For Large Language Models Alignment on Coding tasks5 May 2025 0 repositories listed
-
End-to-end fully-binarized network design: from Generic Learned Thermometer to Block Pruning5 May 2025 0 repositories listed
-
Optimizing LLMs for Resource-Constrained Environments: A Survey of Model Compression Techniques5 May 2025 0 repositories listed
-
Segment Any RGB-Thermal Model with Language-aided Distillation4 May 2025 0 repositories listed
-
High-Fidelity Pseudo-label Generation by Large Language Models for Training Robust Radiology Report Classifiers3 May 2025 0 repositories listed
-
Llama-Nemotron: Efficient Reasoning Models2 May 2025 0 repositories listed
-
Toward Data-centric Directed Graph Learning: An Entropy-driven Approach2 May 2025 0 repositories listed
-
Uncertainty-Aware Multi-Expert Knowledge Distillation for Imbalanced Disease Grading1 May 2025 0 repositories listed
-
CAE-DFKD: Bridging the Transferability Gap in Data-Free Knowledge Distillation30 Apr 2025 0 repositories listed
-
How to Backdoor the Knowledge Distillation30 Apr 2025 0 repositories listed
-
Federated One-Shot Learning with Data Privacy and Objective-Hiding29 Apr 2025 0 repositories listed
-
Head-Tail-Aware KL Divergence in Knowledge Distillation for Spiking Neural Networks29 Apr 2025 0 repositories listed
-
SAM-Guided Robust Representation Learning for One-Shot 3D Medical Image Segmentation29 Apr 2025 0 repositories listed
-
The Estimation of Continual Causal Effect for Dataset Shifting Streams29 Apr 2025 0 repositories listed
-
Trace-of-Thought Prompting: Investigating Prompt-Based Knowledge Distillation Through Question Decomposition29 Apr 2025 0 repositories listed
-
Knowledge Distillation of Domain-adapted LLMs for Question-Answering in Telecom28 Apr 2025 0 repositories listed
-
Breaking the Modality Barrier: Universal Embedding Learning with Multimodal LLMs24 Apr 2025 0 repositories listed
-
Does Knowledge Distillation Matter for Large Language Model based Bundle Generation?24 Apr 2025 0 repositories listed
-
Unified Attacks to Large Language Model Watermarks: Spoofing and Scrubbing in Unauthorized Knowledge Distillation24 Apr 2025 0 repositories listed
-
Emo Pillars: Knowledge Distillation to Support Fine-Grained Context-Aware and Context-Less Emotion Classification23 Apr 2025 0 repositories listed
-
Knowledge Distillation and Dataset Distillation of Large Language Models: Emerging Trends, Challenges, and Future Directions20 Apr 2025 0 repositories listed
-
Turbo2K: Towards Ultra-Efficient and High-Quality 2K Video Synthesis20 Apr 2025 0 repositories listed
-
Empirical Evaluation of Knowledge Distillation from Transformers to Subquadratic Language Models19 Apr 2025 0 repositories listed
-
Feature Alignment and Representation Transfer in Knowledge Distillation for Large Language Models18 Apr 2025 0 repositories listed
-
From Large to Super-Tiny: End-to-End Optimization for Cost-Efficient LLMs18 Apr 2025 0 repositories listed
-
Scaling Laws for Data-Efficient Visual Transfer Learning17 Apr 2025 0 repositories listed
-
Transferable Deployment of Semantic Edge Inference Systems via Unsupervised Domain Adaption16 Apr 2025 0 repositories listed
-
Efficient Hybrid Language Model Compression through Group-Aware SSM Pruning15 Apr 2025 0 repositories listed
-
Can LLMs Revolutionize the Design of Explainable and Efficient TinyML Models?13 Apr 2025 0 repositories listed
-
Optimizing Multi-Gateway LoRaWAN via Cloud-Edge Collaboration and Knowledge Distillation13 Apr 2025 0 repositories listed
-
Knowledge Distillation for Multimodal Egocentric Action Recognition Robust to Missing Modalities11 Apr 2025 0 repositories listed
-
Knowledge Distillation for Underwater Feature Extraction and Matching via GAN-synthesized Images11 Apr 2025 0 repositories listed
-
Distilling Knowledge from Heterogeneous Architectures for Semantic Segmentation10 Apr 2025 0 repositories listed
-
ThermoStereoRT: Thermal Stereo Matching in Real Time via Knowledge Distillation and Attention-based Refinement10 Apr 2025 0 repositories listed
-
Towards Unconstrained 2D Pose Estimation of the Human Spine10 Apr 2025 0 repositories listed
-
WK-Pnet: FM-Based Positioning via Wavelet Packet Decomposition and Knowledge Distillation10 Apr 2025 0 repositories listed
-
Teaching pathology foundation models to accurately predict gene expression with parameter efficient knowledge transfer9 Apr 2025 0 repositories listed
-
Resource-Efficient Beam Prediction in mmWave Communications with Multimodal Realistic Simulation Framework7 Apr 2025 0 repositories listed
-
A Novel Algorithm for Personalized Federated Learning: Knowledge Distillation with Weighted Combination Loss6 Apr 2025 0 repositories listed
-
Corrected with the Latest Version: Make Robust Asynchronous Federated Learning Possible5 Apr 2025 0 repositories listed
-
Agglomerating Large Vision Encoders via Distillation for VFSS Segmentation3 Apr 2025 0 repositories listed
-
Causal Self-supervised Pretrained Frontend with Predictive Code for Speech Separation3 Apr 2025 0 repositories listed
-
Marine Saliency Segmenter: Object-Focused Conditional Diffusion with Region-Level Semantic Knowledge Distillation3 Apr 2025 0 repositories listed
-
UNDO: Understanding Distillation as Optimization3 Apr 2025 0 repositories listed
-
A Novel Approach To Implementing Knowledge Distillation In Tsetlin Machines2 Apr 2025 0 repositories listed
-
KD²M: An unifying framework for feature knowledge distillation2 Apr 2025 0 repositories listed
-
Random Conditioning with Distillation for Data-Efficient Diffusion Model Compression2 Apr 2025 0 repositories listed
-
Style over Substance: Distilled Language Models Reason Via Stylistic Replication2 Apr 2025 0 repositories listed
-
Adversarial Curriculum Graph-Free Knowledge Distillation for Graph Neural Networks1 Apr 2025 0 repositories listed
-
Global Intervention and Distillation for Federated Out-of-Distribution Generalization1 Apr 2025 0 repositories listed
-
OccludeNeRF: Geometric-aware 3D Scene Inpainting with Collaborative Score Distillation in NeRF1 Apr 2025 0 repositories listed
-
A Plasticity-Aware Method for Continual Self-Supervised Learning in Remote Sensing31 Mar 2025 0 repositories listed
-
Crossmodal Knowledge Distillation with WordNet-Relaxed Text Embeddings for Robust Image Classification31 Mar 2025 0 repositories listed
-
Is LLM the Silver Bullet to Low-Resource Languages Machine Translation?31 Mar 2025 0 repositories listed
-
Unimodal-driven Distillation in Multimodal Emotion Recognition with Dynamic Fusion31 Mar 2025 0 repositories listed
-
Efficient Verified Machine Unlearning For Distillation28 Mar 2025 0 repositories listed
-
Intrinsic Image Decomposition for Robust Self-supervised Monocular Depth Estimation on Reflective Surfaces28 Mar 2025 0 repositories listed
-
Alleviating LLM-based Generative Retrieval Hallucination in Alipay Search27 Mar 2025 0 repositories listed
-
Delving Deep into Semantic Relation Distillation27 Mar 2025 0 repositories listed
-
DuckSegmentation: A segmentation model based on the AnYue Hemp Duck Dataset27 Mar 2025 0 repositories listed
-
MoLe-VLA: Dynamic Layer-skipping Vision Language Action Model via Mixture-of-Layers for Efficient Robot Manipulation26 Mar 2025 0 repositories listed
-
Small Object Detection: A Comprehensive Survey on Challenges, Techniques and Real-World Applications26 Mar 2025 0 repositories listed
-
Plug-and-Play Interpretable Responsible Text-to-Image Generation via Dual-Space Multi-facet Concept Control24 Mar 2025 0 repositories listed
-
CustomKD: Customizing Large Vision Foundation for Edge Model Improvement via Knowledge Distillation23 Mar 2025 0 repositories listed
-
FedSKD: Aggregation-free Model-heterogeneous Federated Learning using Multi-dimensional Similarity Knowledge Distillation23 Mar 2025 0 repositories listed
-
OmniScience: A Domain-Specialized LLM for Scientific Reasoning and Discovery22 Mar 2025 0 repositories listed