Methods › General › Knowledge Distillation › STD
Spatial-Channel Token Distillation
STD
Introduced by Yanxi Li et al. in Spatial-Channel Token Distillation for Vision MLPs
archive 2025-07-28 Description, source and code snippet are the archive's method entry.
The Spatial-Channel Token Distillation method is proposed to improve the spatial and channel mixing from a novel knowledge distillation (KD) perspective. To be specific, we design a special KD mechanism for MLP-like Vision Models called Spatial-channel Token Distillation (STD), which improves the information mixing in both the spatial and channel dimensions of MLP blocks. Instead of modifying the mixing operations themselves, STD adds spatial and channel tokens to image patches. After forward propagation, the tokens are concatenated for distillation with the teachers’ responses as targets. Each token works as an aggregator of its dimension. The objective of them is to encourage each mixing operation to extract maximal task-related information from their specific dimension.
Papers archive 2025-07-28
30 shown of 32, newest first. Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code; it is per sample and not a correctness claim.
-
Geo-Registration of Terrestrial LiDAR Point Clouds with Satellite Images without GNSS 8 Jul 2025 · 0 repositories · arXiv:2507.05999
-
Sparse-to-Dense: A Free Lunch for Lossless Acceleration of Video Understanding in LLMs 25 May 2025 · 0 repositories · arXiv:2505.19155
-
RE-TRIP : Reflectivity Instance Augmented Triangle Descriptor for 3D Place Recognition 22 May 2025 · 1 repository · arXiv:2505.16165
-
A New Paradigm in IBR Modeling for Power Flow and Short Circuit Analysis 14 Apr 2025 · 0 repositories · arXiv:2504.10181
-
DualQuat-LOAM: LiDAR Odometry and Mapping parameterized on Dual Quaternions 7 Apr 2025 · 1 repository
-
GAA-TSO: Geometry-Aware Assisted Depth Completion for Transparent and Specular Objects 21 Mar 2025 · 0 repositories · arXiv:2503.17106
-
Multimodal AI on Wound Images and Clinical Notes for Home Patient Referral 22 Jan 2025 · 0 repositories · arXiv:2501.13247
-
MHGNet: Multi-Heterogeneous Graph Neural Network for Traffic Prediction 7 Jan 2025 · 1 repository · arXiv:2501.03635
-
Leveraging Prompt Learning and Pause Encoding for Alzheimer's Disease Detection 9 Dec 2024 · 0 repositories · arXiv:2412.06259
-
BEST-STD: Bidirectional Mamba-Enhanced Speech Tokenization for Spoken Term Detection 21 Nov 2024 · 1 repository · arXiv:2411.14100
-
Spotlight Text Detector: Spotlight on Candidate Regions Like a Camera 25 Sep 2024 · 0 repositories · arXiv:2409.16820
-
Fairness Under Cover: Evaluating the Impact of Occlusions on Demographic Bias in Facial Recognition 19 Aug 2024 · 1 repository · arXiv:2408.10175
-
IFTD: Image Feature Triangle Descriptor for Loop Detection in Driving Scenes 12 Jun 2024 · 1 repository · arXiv:2406.07937
-
Excess Delay from GDP: Measurement and Causal Analysis 18 May 2024 · 0 repositories · arXiv:2405.11211
-
Adapting an Artificial Intelligence Sexually Transmitted Diseases Symptom Checker Tool for Mpox Detection: The HeHealth Experience 23 Apr 2024 · 0 repositories · arXiv:2404.16885
-
On Extending the Automatic Test Markup Language (ATML) for Machine Learning 4 Apr 2024 · 0 repositories · arXiv:2404.03769
-
Disturbance Ratio for Optimal Multi-Event Classification in Power Distribution Networks 18 Feb 2024 · 0 repositories · arXiv:2402.11668
-
Data Quality Matters: Suicide Intention Detection on Social Media Posts Using RoBERTa-CNN 3 Feb 2024 · 0 repositories · arXiv:2402.02262
-
Bootstrap Your Own Variance 6 Dec 2023 · 0 repositories · arXiv:2312.03213
-
Uncertainty quantification for deep learning-based schemes for solving high-dimensional backward stochastic differential equations 5 Oct 2023 · 0 repositories · arXiv:2310.03393
-
ShaDocFormer: A Shadow-Attentive Threshold Detector With Cascaded Fusion Refiner for Document Shadow Removal 13 Sep 2023 · 1 repository · arXiv:2309.06670
-
Spatial Transform Decoupling for Oriented Object Detection 21 Aug 2023 · 1 repository · arXiv:2308.10561
-
Markerless Motion Tracking with Noisy Video and IMU Data 12 May 2023 · 1 repository
-
Spatiotemporal Regularized Tucker Decomposition Approach for Traffic Data Imputation 11 May 2023 · 0 repositories · arXiv:2305.06563
-
Transformer-based encoder-encoder architecture for Spoken Term Detection 2 Nov 2022 · 0 repositories · arXiv:2211.01089
-
Exploiting prompt learning with pre-trained language models for Alzheimer's Disease detection 29 Oct 2022 · 1 repository · arXiv:2210.16539
-
Spoken Term Detection and Relevance Score Estimation using Dot-Product of Pronunciation Embeddings 21 Oct 2022 · 0 repositories · arXiv:2210.11895
-
STD: Stable Triangle Descriptor for 3D place recognition 26 Sep 2022 · 1 repository · arXiv:2209.12435
-
Partial annotations for the segmentation of large structures with low annotation cost 25 Sep 2022 · 0 repositories · arXiv:2209.12216
-
Text Growing on Leaf 7 Sep 2022 · 0 repositories · arXiv:2209.03016
Tasks archive 2025-07-28
20 shown of 56 tasks the archive attaches to papers tagged with this method, by distinct papers. A task without a page in the catalog is plain text.
Usage over time archive 2025-07-28
Components: the archive holds no method-to-method composition, so PwC's Components table cannot be rebuilt; the Papers list carries no Results column for the same reason (the archive does not join its leaderboard rows to method tags).
Categories archive 2025-07-28
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections