Methods › General › Knowledge Distillation › Knowledge Distillation › Papers, page 22

Knowledge Distillation

Papers archive 2025-07-28

archive papers tagged: 3,071 · with a code link: 1,258 · where Syntology ran a sample: 320 (276 with a run with no instrument failure, 44 where every run was a failure of Syntology's instrument) Syntology

Show: all tagged papersonly where code ran (320 of 3,071 tagged: 276 with a run with no instrument failure, 44 where every run was a failure of Syntology's instrument)

Page 22 of 31: papers 2,101 to 2,200 of 3,071, newest first by the archive's date (ties by slug), in archive order.

Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code, as “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. It is per sample and not a correctness claim. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from.

• Cross-Modal Perceptionist: Can Face Geometry be Gleaned from Voices?
  18 Mar 2022 · 1 repository · arXiv:2203.09824
• Delta Distillation for Efficient Video Processing
  17 Mar 2022 · 1 repository · arXiv:2203.09594
• Fine-tuning Global Model via Data-Free Knowledge Distillation for Non-IID Federated Learning
  17 Mar 2022 · 1 repository · arXiv:2203.09249
  Syntology official: harvested, nothing ran · 0 ran · 1 unverified (of 1 harvested sample)
• When Chosen Wisely, More Data Is What You Need: A Universal Sample-Efficient Strategy For Data Augmentation
  17 Mar 2022 · 1 repository · arXiv:2203.09391
• Decoupled Knowledge Distillation
  16 Mar 2022 · 1 repository · arXiv:2203.08679
  Syntology official (archive's flag): 6 ran · 6 ran (of which 2 constructed an object rather than computing a result; 3 with no instrument failure: 1 honoured, 0 violated, 2 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified (of 6 harvested samples) · 6 pointer-only (licence)
• Graph Flow: Cross-layer Graph Flow Distillation for Dual Efficient Medical Image Segmentation
  16 Mar 2022 · 1 repository · arXiv:2203.08667
• Sample, Translate, Recombine: Leveraging Audio Alignments for Data Augmentation in End-to-end Speech Translation
  16 Mar 2022 · 0 repositories · arXiv:2203.08757
• SC2 Benchmark: Supervised Compression for Split Computing
  16 Mar 2022 · 1 repository · arXiv:2203.08875
• SATS: Self-Attention Transfer for Continual Semantic Segmentation
  15 Mar 2022 · 1 repository · arXiv:2203.07667
• On the benefits of knowledge distillation for adversarial robustness
  14 Mar 2022 · 0 repositories · arXiv:2203.07159
• CEKD:Cross Ensemble Knowledge Distillation for Augmented Fine-grained Data
  13 Mar 2022 · 0 repositories · arXiv:2203.06551
• CMKD: CNN/Transformer-Based Cross-Model Knowledge Distillation for Audio Classification
  13 Mar 2022 · 2 repositories · arXiv:2203.06760
• Enabling Multimodal Generation on CLIP via Vision-Language Knowledge Distillation
  12 Mar 2022 · 0 repositories · arXiv:2203.06386
• Wavelet Knowledge Distillation: Towards Efficient Image-to-Image Translation
  12 Mar 2022 · 0 repositories · arXiv:2203.06321
• Deep Class Incremental Learning from Decentralized Data
  11 Mar 2022 · 0 repositories · arXiv:2203.05984
• Medical Image Segmentation on MRI Images with Missing Modalities: A Review
  11 Mar 2022 · 0 repositories · arXiv:2203.06217
• Improving Neural ODEs via Knowledge Distillation
  10 Mar 2022 · 0 repositories · arXiv:2203.05103
• Knowledge Distillation as Efficient Pre-training: Faster Convergence, Higher Data-efficiency, and Better Transferability
  10 Mar 2022 · 1 repository · arXiv:2203.05180
  Syntology official (archive's flag): 9 ran · 9 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 6 where Syntology's instrument failed) · 4 unverified (of 13 harvested samples) · 3 pointer-only (licence)
• Membership Privacy Protection for Image Translation Models via Adversarial Knowledge Distillation
  10 Mar 2022 · 0 repositories · arXiv:2203.05212
• Model-Architecture Co-Design for High Performance Temporal GNN Inference on FPGA
  10 Mar 2022 · 1 repository · arXiv:2203.05095
• Prediction-Guided Distillation for Dense Object Detection
  10 Mar 2022 · 1 repository · arXiv:2203.05469
• Representation Compensation Networks for Continual Semantic Segmentation
  10 Mar 2022 · 1 repository · arXiv:2203.05402
  Syntology official: harvested, nothing ran · 0 ran · 1 unverified (of 1 harvested sample)
• Efficient Sub-structured Knowledge Distillation
  9 Mar 2022 · 1 repository · arXiv:2203.04825
• Overcoming Catastrophic Forgetting beyond Continual Learning: Balanced Training for Neural Machine Translation
  8 Mar 2022 · 1 repository · arXiv:2203.03910
• PyNET-QxQ: An Efficient PyNET Variant for QxQ Bayer Pattern Demosaicing in CMOS Image Sensors
  8 Mar 2022 · 1 repository · arXiv:2203.04314
• Multi-trial Neural Architecture Search with Lottery Tickets
  8 Mar 2022 · 0 repositories · arXiv:2203.04300
• Enhance Language Identification using Dual-mode Model with Knowledge Distillation
  7 Mar 2022 · 1 repository · arXiv:2203.03218
• Student Becomes Decathlon Master in Retinal Vessel Segmentation via Dual-teacher Multi-target Domain Adaptation
  7 Mar 2022 · 1 repository · arXiv:2203.03631
• Consistent Representation Learning for Continual Relation Extraction
  5 Mar 2022 · 1 repository · arXiv:2203.02721
  Syntology official (archive's flag): 5 ran · 7 ran (of which 4 constructed an object rather than computing a result; 6 with no instrument failure: 2 honoured, 0 violated, 4 with no contract checked; 1 where Syntology's instrument failed) · 5 unverified (of 12 harvested samples) · 12 pointer-only (licence)
• Better Supervisory Signals by Observing Learning Paths
  4 Mar 2022 · 1 repository · arXiv:2203.02485
  Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 1 honoured, 2 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 5 harvested samples)
• X-Trans2Cap: Cross-Modal Knowledge Transfer using Transformer for 3D Dense Captioning
  2 Mar 2022 · 1 repository · arXiv:2203.00843
• Dual Embodied-Symbolic Concept Representations for Deep Learning
  1 Mar 2022 · 0 repositories · arXiv:2203.00600
• Self-Supervised Vision Transformers Learn Visual Concepts in Histopathology
  1 Mar 2022 · 1 repository · arXiv:2203.00585
• TransKD: Transformer Knowledge Distillation for Efficient Semantic Segmentation
  27 Feb 2022 · 2 repositories · arXiv:2202.13393
• Content-Variant Reference Image Quality Assessment via Knowledge Distillation
  26 Feb 2022 · 1 repository · arXiv:2202.13123
  Syntology official (archive's flag): 5 ran · 5 ran (of which 5 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified; every one of the 5 samples that ran constructed an object rather than computing a result (of 7 harvested samples)
• Bridging the Gap Between Patient-specific and Patient-independent Seizure Prediction via Knowledge Distillation
  25 Feb 2022 · 0 repositories · arXiv:2202.12598
• Joint Answering and Explanation for Visual Commonsense Reasoning
  25 Feb 2022 · 1 repository · arXiv:2202.12626
• Learn From the Past: Experience Ensemble Knowledge Distillation
  25 Feb 2022 · 0 repositories · arXiv:2202.12488
• Efficient Video Segmentation Models with Per-frame Inference
  24 Feb 2022 · 0 repositories · arXiv:2202.12427
• Multi-Teacher Knowledge Distillation for Incremental Implicitly-Refined Classification
  23 Feb 2022 · 0 repositories · arXiv:2202.11384
• Distilled Neural Networks for Efficient Learning to Rank
  22 Feb 2022 · 1 repository · arXiv:2202.10728
• A Novel Architecture Slimming Method for Network Pruning and Knowledge Distillation
  21 Feb 2022 · 0 repositories · arXiv:2202.10461
• Cross-Task Knowledge Distillation in Multi-Task Recommendation
  20 Feb 2022 · 0 repositories · arXiv:2202.09852
• Knowledge Distillation with Deep Supervision
  16 Feb 2022 · 0 repositories · arXiv:2202.07846
• EdgeFormer: A Parameter-Efficient Transformer for On-Device Seq2seq Generation
  16 Feb 2022 · 1 repository · arXiv:2202.07959
  Syntology official: no sample here; runs from other or unrecorded repositories · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 3 harvested samples)
• FAMIE: A Fast Active Learning Framework for Multilingual Information Extraction
  16 Feb 2022 · 1 repository · arXiv:2202.08316
• Meta Knowledge Distillation
  16 Feb 2022 · 0 repositories · arXiv:2202.07940
• No One Left Behind: Inclusive Federated Learning over Heterogeneous Devices
  16 Feb 2022 · 0 repositories · arXiv:2202.08036
• AI can evolve without labels: self-evolving vision transformer for chest X-ray diagnosis through knowledge distillation
  13 Feb 2022 · 0 repositories · arXiv:2202.06431
• Uni-Retriever: Towards Learning The Unified Embedding Based Retriever in Bing Sponsored Search
  13 Feb 2022 · 0 repositories · arXiv:2202.06212
• Tiny Object Tracking: A Large-scale Dataset and A Baseline
  11 Feb 2022 · 1 repository · arXiv:2202.05659
• Distillation with Contrast is All You Need for Self-Supervised Point Cloud Representation Learning
  9 Feb 2022 · 0 repositories · arXiv:2202.04241
• Point-Level Region Contrast for Object Detection Pre-Training
  9 Feb 2022 · 1 repository · arXiv:2202.04639
  Syntology official (archive's flag): 1 ran · 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified; the one sample that ran constructed an object rather than computing a result (of 4 harvested samples) · 4 pointer-only (licence)
• Exploring Inter-Channel Correlation for Diversity-preserved KnowledgeDistillation
  8 Feb 2022 · 1 repository · arXiv:2202.03680
  Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples) · 2 pointer-only (licence)
• Adaptive Mixing of Auxiliary Losses in Supervised Learning
  7 Feb 2022 · 1 repository · arXiv:2202.03250
• Measuring and Reducing Model Update Regression in Structured Prediction for NLP
  7 Feb 2022 · 0 repositories · arXiv:2202.02976
• Bootstrapped Representation Learning for Skeleton-Based Action Recognition
  4 Feb 2022 · 0 repositories · arXiv:2202.02232
• Cross domain knowledge compression in realtime optical flow prediction on ultrasound sequences
  4 Feb 2022 · 0 repositories
• Iterative Self Knowledge Distillation -- From Pothole Classification to Fine-Grained and COVID Recognition
  4 Feb 2022 · 0 repositories · arXiv:2202.02265
• Local Feature Matching with Transformers for low-end devices
  1 Feb 2022 · 1 repository · arXiv:2202.00770
• Deep-Disaster: Unsupervised Disaster Detection and Localization Using Visual Data
  31 Jan 2022 · 1 repository · arXiv:2202.00050
• Improving Robustness by Enhancing Weak Subnets
  30 Jan 2022 · 1 repository · arXiv:2201.12765
  Syntology official (archive's flag): 2 ran · 2 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples) · 2 pointer-only (licence)
• Win the Lottery Ticket via Fourier Analysis: Frequencies Guided Network Pruning
  30 Jan 2022 · 0 repositories · arXiv:2201.12712
• Global-Reasoned Multi-Task Learning Model for Surgical Scene Understanding
  28 Jan 2022 · 2 repositories · arXiv:2201.11957
  Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 7 unverified (of 8 harvested samples) · 8 pointer-only (licence)
• Dynamic Rectification Knowledge Distillation
  27 Jan 2022 · 1 repository · arXiv:2201.11319
• Adaptive Instance Distillation for Object Detection in Autonomous Driving
  26 Jan 2022 · 0 repositories · arXiv:2201.11097
• Anomaly Detection via Reverse Distillation from One-Class Embedding
  26 Jan 2022 · 5 repositories · arXiv:2201.10703
  Syntology official (archive's flag): 2 ran · 14 ran (of which 8 constructed an object rather than computing a result; 10 with no instrument failure: 0 honoured, 0 violated, 10 with no contract checked; 4 where Syntology's instrument failed) · 4 unverified (of 18 harvested samples) · 15 pointer-only (licence)
• One Student Knows All Experts Know: From Sparse to Dense
  26 Jan 2022 · 0 repositories · arXiv:2201.10890
• Attentive Task Interaction Network for Multi-Task Learning
  25 Jan 2022 · 1 repository · arXiv:2201.10649
• Jointly Learning Knowledge Embedding and Neighborhood Consensus with Relational Knowledge Distillation for Entity Alignment
  25 Jan 2022 · 0 repositories · arXiv:2201.11249
• Federated Unlearning with Knowledge Distillation
  24 Jan 2022 · 0 repositories · arXiv:2201.09441
• AutoDistill: an End-to-End Framework to Explore and Distill Hardware-Efficient Language Models
  21 Jan 2022 · 0 repositories · arXiv:2201.08539
• Can Model Compression Improve NLP Fairness
  21 Jan 2022 · 0 repositories · arXiv:2201.08542
• Image-to-Video Re-Identification via Mutual Discriminative Knowledge Transfer
  21 Jan 2022 · 0 repositories · arXiv:2201.08887
• UKD: Debiasing Conversion Rate Estimation via Uncertainty-regularized Knowledge Distillation
  20 Jan 2022 · 0 repositories · arXiv:2201.08024
• Continual Coarse-to-Fine Domain Adaptation in Semantic Segmentation
  18 Jan 2022 · 1 repository · arXiv:2201.06974
• Cross-modal Contrastive Distillation for Instructional Activity Anticipation
  18 Jan 2022 · 0 repositories · arXiv:2201.06734
• It's All in the Head: Representation Knowledge Distillation through Classifier Sharing
  18 Jan 2022 · 1 repository · arXiv:2201.06945
• Knowledge Distillation as Self-Supervised Learning
  17 Jan 2022 · 0 repositories
• CL-ReKD: Cross-lingual Knowledge Distillation for Multilingual Retrieval Question Answering
  16 Jan 2022 · 0 repositories
• KD-VLP: Improving End-to-End Vision-and-Language Pretraining with Object Knowledge Distillation
  16 Jan 2022 · 0 repositories
• Learning Cross-Lingual IR from an English Retriever
  16 Jan 2022 · 0 repositories
• Nearest Neighbor Knowledge Distillation for Neural Machine Translation
  16 Jan 2022 · 0 repositories
• Re2G: Retrieve, Rerank, Generate
  16 Jan 2022 · 0 repositories
• Transferring Knowledge from Structure-aware Self-attention Language Model to Sequence-to-Sequence Semantic Parsing
  16 Jan 2022 · 0 repositories
• Tree Knowledge Distillation for Compressing Transformer-Based Language Models
  16 Jan 2022 · 0 repositories
• SimReg: Regression as a Simple Yet Effective Tool for Self-supervised Knowledge Distillation
  13 Jan 2022 · 1 repository · arXiv:2201.05131
  Syntology official (archive's flag): 13 ran · 13 ran (of which 0 constructed an object rather than computing a result; 10 with no instrument failure: 0 honoured, 0 violated, 10 with no contract checked; 3 where Syntology's instrument failed) · 1 unverified (of 14 harvested samples) · 2 pointer-only (licence)
• Technical Report for ICCV 2021 Challenge SSLAD-Track3B: Transformers Are Better Continual Learners
  13 Jan 2022 · 0 repositories · arXiv:2201.04924
• On Exploring Pose Estimation as an Auxiliary Learning Task for Visible-Infrared Person Re-identification
  11 Jan 2022 · 1 repository · arXiv:2201.03859
• FedDTG:Federated Data-Free Knowledge Distillation via Three-Player Generative Adversarial Networks
  10 Jan 2022 · 0 repositories · arXiv:2201.03169
• Robust and Resource-Efficient Data-Free Knowledge Distillation by Generative Pseudo Replay
  9 Jan 2022 · 1 repository · arXiv:2201.03019
  Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
• Two-Pass End-to-End ASR Model Compression
  8 Jan 2022 · 0 repositories · arXiv:2201.02741
• Microdosing: Knowledge Distillation for GAN based Compression
  7 Jan 2022 · 0 repositories · arXiv:2201.02624
• Class-Incremental Continual Learning into the eXtended DER-verse
  3 Jan 2022 · 1 repository · arXiv:2201.00766
• Which Student is Best? A Comprehensive Knowledge Distillation Exam for Task-Specific BERT Models
  3 Jan 2022 · 0 repositories · arXiv:2201.00558
• Class Similarity Weighted Knowledge Distillation for Continual Semantic Segmentation
  1 Jan 2022 · 0 repositories
• Distillation Using Oracle Queries for Transformer-Based Human-Object Interaction Detection
  1 Jan 2022 · 0 repositories
• Image Restoration using Feature-guidance
  1 Jan 2022 · 0 repositories · arXiv:2201.00187
• Learn From Others and Be Yourself in Heterogeneous Federated Learning
  1 Jan 2022 · 1 repository
• Performance-Aware Mutual Knowledge Distillation for Improving Neural Architecture Search
  1 Jan 2022 · 0 repositories