Methods › General › Knowledge Distillation › Knowledge Distillation › Papers, page 14

Knowledge Distillation

Papers archive 2025-07-28

archive papers tagged: 3,071 · with a code link: 1,258 · where Syntology ran a sample: 320 (276 with a run with no instrument failure, 44 where every run was a failure of Syntology's instrument) Syntology

Show: all tagged papersonly where code ran (320 of 3,071 tagged: 276 with a run with no instrument failure, 44 where every run was a failure of Syntology's instrument)

Page 14 of 31: papers 1,301 to 1,400 of 3,071, newest first by the archive's date (ties by slug), in archive order.

Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code, as “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. It is per sample and not a correctness claim. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from.

• VQGraph: Rethinking Graph Representation Space for Bridging GNNs and MLPs
  4 Aug 2023 · 1 repository · arXiv:2308.02117
  Syntology official (archive's flag): 23 ran · 23 ran (of which 1 constructed an object rather than computing a result; 10 with no instrument failure: 1 honoured, 4 violated, 5 with no contract checked; 13 where Syntology's instrument failed) · 7 unverified (of 30 harvested samples) · 30 pointer-only (licence)
• A vision transformer-based framework for knowledge transfer from multi-modal to mono-modal lymphoma subtyping models
  2 Aug 2023 · 0 repositories · arXiv:2308.01328
• Beyond Generic: Enhancing Image Captioning with Real-World Knowledge using Vision-Language Pre-Training Model
  2 Aug 2023 · 1 repository · arXiv:2308.01126
• Improved Knowledge Distillation for Crowd Counting on IoT Device
  2 Aug 2023 · 1 repository
• Leveraging Expert Models for Training Deep Neural Networks in Scarce Data Domains: Application to Offline Handwritten Signature Verification
  2 Aug 2023 · 0 repositories · arXiv:2308.01136
• Towards Better Query Classification with Multi-Expert Knowledge Condensation in JD Ads Search
  2 Aug 2023 · 0 repositories · arXiv:2308.01098
• Ada-DQA: Adaptive Diverse Quality-aware Feature Acquisition for Video Quality Assessment
  1 Aug 2023 · 0 repositories · arXiv:2308.00729
• NormKD: Normalized Logits for Knowledge Distillation
  1 Aug 2023 · 1 repository · arXiv:2308.00520
• Online Prototype Learning for Online Continual Learning
  1 Aug 2023 · 1 repository · arXiv:2308.00301
  Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
• Federated Learning for Data and Model Heterogeneity in Medical Imaging
  31 Jul 2023 · 0 repositories · arXiv:2308.00155
• Sampling to Distill: Knowledge Transfer from Open-World Data
  31 Jul 2023 · 0 repositories · arXiv:2307.16601
• Subspace Distillation for Continual Learning
  31 Jul 2023 · 1 repository · arXiv:2307.16419
• UPFL: Unsupervised Personalized Federated Learning towards New Clients
  29 Jul 2023 · 0 repositories · arXiv:2307.15994
• f-Divergence Minimization for Sequence-Level Knowledge Distillation
  27 Jul 2023 · 1 repository · arXiv:2307.15190
  Syntology official (archive's flag): 8 ran · 8 ran (of which 0 constructed an object rather than computing a result; 8 with no instrument failure: 0 honoured, 0 violated, 8 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 9 harvested samples) · 9 pointer-only (licence)
• Fitting Auditory Filterbanks with Multiresolution Neural Networks
  25 Jul 2023 · 2 repositories · arXiv:2307.13821
• Mitigating Cross-client GANs-based Attack in Federated Learning
  25 Jul 2023 · 0 repositories · arXiv:2307.13314
• A Good Student is Cooperative and Reliable: CNN-Transformer Collaborative Learning for Semantic Segmentation
  24 Jul 2023 · 0 repositories · arXiv:2307.12574
• HeteFedRec: Federated Recommender Systems with Model Heterogeneity
  24 Jul 2023 · 0 repositories · arXiv:2307.12810
• Distribution Shift Matters for Knowledge Distillation with Webly Collected Images
  21 Jul 2023 · 0 repositories · arXiv:2307.11469
• DPM-OT: A New Diffusion Probabilistic Model Based on Optimal Transport
  21 Jul 2023 · 1 repository · arXiv:2307.11308
  Syntology official (archive's flag): 9 ran · 9 ran (of which 0 constructed an object rather than computing a result; 7 with no instrument failure: 1 honoured, 0 violated, 6 with no contract checked; 2 where Syntology's instrument failed) · 4 unverified (of 13 harvested samples) · 13 pointer-only (licence)
• Cluster-aware Semi-supervised Learning: Relational Knowledge Distillation Provably Learns Clustering
  20 Jul 2023 · 1 repository · arXiv:2307.11030
  Syntology 15 ran (of which 3 constructed an object rather than computing a result; 14 with no instrument failure: 0 honoured, 0 violated, 14 with no contract checked; 1 where Syntology's instrument failed) · 3 unverified (of 18 harvested samples) · 5 pointer-only (licence)
• Quantized Feature Distillation for Network Quantization
  20 Jul 2023 · 0 repositories · arXiv:2307.10638
• Reverse Knowledge Distillation: Training a Large Model using a Small One for Retinal Image Matching on Limited Data
  20 Jul 2023 · 1 repository · arXiv:2307.10698
• LightPath: Lightweight and Scalable Path Representation Learning
  19 Jul 2023 · 1 repository · arXiv:2307.10171
• Class-relation Knowledge Distillation for Novel Class Discovery
  18 Jul 2023 · 2 repositories · arXiv:2307.09158
  Syntology official: harvested, nothing ran · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 3 harvested samples) · 1 pointer-only (licence)
• Knowledge Distillation for Object Detection: from generic to remote sensing datasets
  18 Jul 2023 · 0 repositories · arXiv:2307.09264
• Teach model to answer questions after comprehending the document
  18 Jul 2023 · 0 repositories · arXiv:2307.08931
• Cumulative Spatial Knowledge Distillation for Vision Transformers
  17 Jul 2023 · 1 repository · arXiv:2307.08500
  Syntology official: harvested, nothing ran · 0 ran · 2 unverified (of 2 harvested samples)
• Domain Knowledge Distillation from Large Language Model: An Empirical Study in the Autonomous Driving Domain
  17 Jul 2023 · 0 repositories · arXiv:2307.11769
• Improving End-to-End Speech Translation by Imitation-Based Knowledge Distillation with Synthetic Transcripts
  17 Jul 2023 · 1 repository · arXiv:2307.08426
• Cross-Lingual NER for Financial Transaction Data in Low-Resource Languages
  16 Jul 2023 · 0 repositories · arXiv:2307.08714
• MinT: Boosting Generalization in Mathematical Reasoning via Multi-View Fine-Tuning
  16 Jul 2023 · 0 repositories · arXiv:2307.07951
• Intuitive Access to Smartphone Settings Using Relevance Model Trained by Contrastive Learning
  15 Jul 2023 · 0 repositories · arXiv:2307.09177
• SoccerKDNet: A Knowledge Distillation Framework for Action Recognition in Soccer Videos
  15 Jul 2023 · 0 repositories · arXiv:2307.07768
• Learning to Retrieve In-Context Examples for Large Language Models
  14 Jul 2023 · 2 repositories · arXiv:2307.07164
• Multimodal Distillation for Egocentric Action Recognition
  14 Jul 2023 · 1 repository · arXiv:2307.07483
  Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples)
• A metric learning approach for endoscopic kidney stone identification
  13 Jul 2023 · 0 repositories · arXiv:2307.07046
• Regression-Oriented Knowledge Distillation for Lightweight Ship Orientation Angle Prediction with Optical Remote Sensing Images
  13 Jul 2023 · 1 repository · arXiv:2307.06566
• The Staged Knowledge Distillation in Video Classification: Harmonizing Student Progress by a Complementary Weakly Supervised Framework
  11 Jul 2023 · 0 repositories · arXiv:2307.05201
• Customizing Synthetic Data for Data-Free Student Learning
  10 Jul 2023 · 1 repository · arXiv:2307.04542
• mCLIP: Multilingual CLIP via Cross-lingual Transfer
  10 Jul 2023 · 1 repository
• CMDFusion: Bidirectional Fusion Network with Cross-modality Knowledge Distillation for LIDAR Semantic Segmentation
  9 Jul 2023 · 1 repository · arXiv:2307.04091
• Distilling Universal and Joint Knowledge for Cross-Domain Model Compression on Time Series Data
  7 Jul 2023 · 1 repository · arXiv:2307.03347
• Contextual Affinity Distillation for Image Anomaly Detection
  6 Jul 2023 · 0 repositories · arXiv:2307.03101
• On-Device Constrained Self-Supervised Speech Representation Learning for Keyword Spotting via Knowledge Distillation
  6 Jul 2023 · 0 repositories · arXiv:2307.02720
• Distilling Missing Modality Knowledge from Ultrasound for Endometriosis Diagnosis with Magnetic Resonance Images
  5 Jul 2023 · 0 repositories · arXiv:2307.02000
• MDViT: Multi-domain Vision Transformer for Small Medical Image Segmentation Datasets
  5 Jul 2023 · 2 repositories · arXiv:2307.02100
• KDSTM: Neural Semi-supervised Topic Modeling with Knowledge Distillation
  4 Jul 2023 · 0 repositories · arXiv:2307.01878
  Syntology 6 ran (of which 1 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 8 harvested samples)
• Review helps learn better: Temporal Supervised Knowledge Distillation
  3 Jul 2023 · 0 repositories · arXiv:2307.00811
• Shared Growth of Graph Neural Networks via Prompted Free-direction Knowledge Distillation
  2 Jul 2023 · 0 repositories · arXiv:2307.00534
• Long-Tailed Continual Learning For Visual Food Recognition
  1 Jul 2023 · 0 repositories · arXiv:2307.00183
• Quantization Variation: A New Perspective on Training Transformers with Low-Bit Precision
  1 Jul 2023 · 2 repositories · arXiv:2307.00331
• Audio Embeddings as Teachers for Music Classification
  30 Jun 2023 · 1 repository · arXiv:2306.17424
• NaturalInversion: Data-Free Image Synthesis Improving Real-World Consistency
  29 Jun 2023 · 1 repository · arXiv:2306.16661
  Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified (of 4 harvested samples) · 4 pointer-only (licence)
• Streaming egocentric action anticipation: An evaluation scheme and approach
  29 Jun 2023 · 0 repositories · arXiv:2306.16682
• Understanding the Overfitting of the Episodic Meta-training
  29 Jun 2023 · 0 repositories · arXiv:2306.16873
• A Dimensional Structure based Knowledge Distillation Method for Cross-Modal Learning
  28 Jun 2023 · 0 repositories · arXiv:2306.15977
• Mitigating Accuracy-Robustness Trade-off via Balanced Multi-Teacher Adversarial Distillation
  28 Jun 2023 · 1 repository · arXiv:2306.16170
  Syntology official (archive's flag): 1 ran · 2 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples) · 2 pointer-only (licence)
• Exploring Dual Model Knowledge Distillation for Anomaly Detection
  27 Jun 2023 · 0 repositories
• Reducing the gap between streaming and non-streaming Transducer-based ASR by adaptive two-stage knowledge distillation
  27 Jun 2023 · 0 repositories · arXiv:2306.15171
• Shoggoth: Towards Efficient Edge-Cloud Collaborative Real-Time Video Inference via Adaptive Online Learning
  27 Jun 2023 · 0 repositories · arXiv:2306.15333
• Accelerating Molecular Graph Neural Networks via Knowledge Distillation
  26 Jun 2023 · 0 repositories · arXiv:2306.14818
• Cross Architecture Distillation for Face Recognition
  26 Jun 2023 · 0 repositories · arXiv:2306.14662
• Federated Learning on Non-iid Data via Local and Global Distillation
  26 Jun 2023 · 0 repositories · arXiv:2306.14443
• Enhancing Mapless Trajectory Prediction through Knowledge Distillation
  25 Jun 2023 · 0 repositories · arXiv:2306.14177
• Feature Adversarial Distillation for Point Cloud Classification
  25 Jun 2023 · 0 repositories · arXiv:2306.14221
• On-Policy Distillation of Language Models: Learning from Self-Generated Mistakes
  23 Jun 2023 · 0 repositories · arXiv:2306.13649
• Depth and DOF Cues Make A Better Defocus Blur Detector
  20 Jun 2023 · 1 repository · arXiv:2306.11334
• Knowledge Distillation via Token-level Relationship Graph
  20 Jun 2023 · 0 repositories · arXiv:2306.12442
• Categories of Response-Based, Feature-Based, and Relation-Based Knowledge Distillation
  19 Jun 2023 · 0 repositories · arXiv:2306.10687
• FSAR: Federated Skeleton-based Action Recognition with Adaptive Topology Structure and Knowledge Distillation
  19 Jun 2023 · 0 repositories · arXiv:2306.11046
• Semi-Supervised Learning for Multi-Label Cardiovascular Diseases Prediction:A Multi-Dataset Study
  18 Jun 2023 · 0 repositories · arXiv:2306.10494
• Coaching a Teachable Student
  16 Jun 2023 · 1 repository · arXiv:2306.10014
  Syntology official: harvested, nothing ran · 0 ran · 4 unverified (of 4 harvested samples)
• Knowledge Distillation for Efficient Audio-Visual Video Captioning
  16 Jun 2023 · 0 repositories · arXiv:2306.09947
• MixedTeacher : Knowledge Distillation for fast inference textural anomaly detection
  16 Jun 2023 · 1 repository · arXiv:2306.09859
• Squeezing nnU-Nets with Knowledge Distillation for On-Board Cloud Detection
  16 Jun 2023 · 0 repositories · arXiv:2306.09886
• Bridging the Gap between Decision and Logits in Decision-based Knowledge Distillation for Pre-trained Language Models
  15 Jun 2023 · 1 repository · arXiv:2306.08909
  Syntology official (archive's flag): 1 ran · 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; the one sample that ran constructed an object rather than computing a result (of 1 harvested sample) · 1 pointer-only (licence)
• Self-Knowledge Distillation for Surgical Phase Recognition
  15 Jun 2023 · 0 repositories · arXiv:2306.08961
• Heterogeneous Continual Learning
  14 Jun 2023 · 0 repositories · arXiv:2306.08593
• BPKD: Boundary Privileged Knowledge Distillation For Semantic Segmentation
  13 Jun 2023 · 1 repository · arXiv:2306.08075
• Enhanced Multimodal Representation Learning with Cross-modal KD
  13 Jun 2023 · 0 repositories · arXiv:2306.07646
• Adaptive Multi-Teacher Knowledge Distillation with Meta-Learning
  11 Jun 2023 · 1 repository · arXiv:2306.06634
  Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
• Are Intermediate Layers and Labels Really Necessary? A General Language Model Distillation Method
  11 Jun 2023 · 1 repository · arXiv:2306.06625
• EaSyGuide : ESG Issue Identification Framework leveraging Abilities of Generative Large Language Models
  11 Jun 2023 · 1 repository · arXiv:2306.06662
• GKD: A General Knowledge Distillation Framework for Large-scale Pre-trained Language Model
  11 Jun 2023 · 1 repository · arXiv:2306.06629
• RankFormer: Listwise Learning-to-Rank Using Listwide Labels
  9 Jun 2023 · 1 repository · arXiv:2306.05808
• BOOT: Data-free Distillation of Denoising Diffusion Models with Bootstrapping
  8 Jun 2023 · 0 repositories · arXiv:2306.05544
• Population-Based Evolutionary Gaming for Unsupervised Person Re-identification
  8 Jun 2023 · 0 repositories · arXiv:2306.05236
• The economic trade-offs of large language models: A case study
  8 Jun 2023 · 0 repositories · arXiv:2306.07402
• Model-Based Reinforcement Learning with Multi-Task Offline Pretraining
  6 Jun 2023 · 1 repository · arXiv:2306.03360
• Joint Pre-training and Local Re-training: Transferable Representation Learning on Multi-source Knowledge Graphs
  5 Jun 2023 · 1 repository · arXiv:2306.02679
• Unveiling the Two-Faced Truth: Disentangling Morphed Identities for Face Morphing Detection
  5 Jun 2023 · 1 repository · arXiv:2306.03002
• Zero shot framework for satellite image restoration
  5 Jun 2023 · 0 repositories · arXiv:2306.02921
• I^3 Retriever: Incorporating Implicit Interaction in Pre-trained Language Models for Passage Retrieval
  4 Jun 2023 · 2 repositories · arXiv:2306.02371
  Syntology community repositories only · 5 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 0 where Syntology's instrument failed) · 5 unverified (of 10 harvested samples)
• Modular Transformers: Compressing Transformers into Modularized Layers for Flexible Efficient Inference
  4 Jun 2023 · 0 repositories · arXiv:2306.02379
• Revisiting Data-Free Knowledge Distillation with Poisoned Teachers
  4 Jun 2023 · 1 repository · arXiv:2306.02368
  Syntology official (archive's flag): 6 ran · 6 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 2 where Syntology's instrument failed) · 1 unverified (of 7 harvested samples) · 3 pointer-only (licence)
• Deep Classifier Mimicry without Data Access
  3 Jun 2023 · 1 repository · arXiv:2306.02090
• Evolving Knowledge Mining for Class Incremental Segmentation
  3 Jun 2023 · 1 repository · arXiv:2306.02027
• Group channel pruning and spatial attention distilling for object detection
  2 Jun 2023 · 1 repository · arXiv:2306.01526
• Speech Translation with Foundation Models and Optimal Transport: UPC at IWSLT23
  2 Jun 2023 · 0 repositories · arXiv:2306.01327