Methods › General › Attention Mechanisms › LSH Attention
Locality Sensitive Hashing Attention
LSH Attention
archive 2025-07-28 Description, source and code snippet are the archive's method entry.
LSH Attention, or Locality Sensitive Hashing Attention is a replacement for dot-product attention with one that uses locality-sensitive hashing, changing its complexity from O(L²) to O(LlogL), where L is the length of the sequence. LSH refers to a family of functions (known as LSH families) to hash data points into buckets so that data points near each other are located in the same buckets with high probability, while data points far from each other are likely to be in different buckets. It was proposed as part of the Reformer architecture.
Papers archive 2025-07-28
22 shown of 22, newest first. Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code; it is per sample and not a correctness claim.
-
Cardioformer: Advancing AI in ECG Analysis with Multi-Granularity Patching and ResNet 8 May 2025 · 1 repository · arXiv:2505.05538
-
Fast-Powerformer: A Memory-Efficient Transformer for Accurate Mid-Term Wind Power Forecasting 15 Apr 2025 · 0 repositories · arXiv:2504.10923
-
ReFormer: Generating Radio Fakes for Data Augmentation 31 Dec 2024 · 0 repositories · arXiv:2501.00282
-
GLMHA A Guided Low-rank Multi-Head Self-Attention for Efficient Image Restoration and Spectral Reconstruction 1 Oct 2024 · 0 repositories · arXiv:2410.00380
-
Masked Face Recognition with Generative-to-Discriminative Representations 27 May 2024 · 0 repositories · arXiv:2405.16761
-
A novel transformer-based approach for soil temperature prediction 20 Nov 2023 · 0 repositories · arXiv:2311.11626
-
LegalRelectra: Mixed-domain Language Modeling for Long-range Legal Text Comprehension 16 Dec 2022 · 0 repositories · arXiv:2212.08204
-
FECAM: Frequency Enhanced Channel Attention Mechanism for Time Series Forecasting 2 Dec 2022 · 1 repository · arXiv:2212.01209
-
Non-stationary Transformers: Exploring the Stationarity in Time Series Forecasting 28 May 2022 · 2 repositories · arXiv:2205.14415
-
Discovering material information using hierarchical Reformer model on financial regulatory filings 28 Mar 2022 · 0 repositories · arXiv:2204.05979
-
Dynamic Token Normalization Improves Vision Transformers 5 Dec 2021 · 1 repository · arXiv:2112.02624Syntology ran 1 of 1 samples · 0 unverified · 1 pointer-only (licence)
-
Hierarchical Transformers Are More Efficient Language Models 26 Oct 2021 · 3 repositories · arXiv:2110.13711Syntology ran 2 of 4 samples · 2 unverified · 2 pointer-only (licence)
-
End-to-End User Behavior Retrieval in Click-Through RatePrediction Model 10 Aug 2021 · 1 repository · arXiv:2108.04468
-
ReFormer: The Relational Transformer for Image Captioning 29 Jul 2021 · 1 repository · arXiv:2107.14178
-
A Practical Survey on Faster and Lighter Transformers 26 Mar 2021 · 0 repositories · arXiv:2103.14636
-
ReAssert: Deep Learning for Assert Generation 19 Nov 2020 · 0 repositories · arXiv:2011.09784
-
Learning to Unknot 28 Oct 2020 · 0 repositories · arXiv:2010.16263
-
Robustification of Segmentation Models Against Adversarial Perturbations In Medical Imaging 23 Sep 2020 · 0 repositories · arXiv:2009.11090
-
Efficient Transformers: A Survey 14 Sep 2020 · 0 repositories · arXiv:2009.06732
-
Segmenting Scientific Abstracts into Discourse Categories: A Deep Learning-Based Approach for Sparse Labeled Data 11 May 2020 · 1 repository · arXiv:2005.05414
-
Neural Machine Translation with Joint Representation 16 Feb 2020 · 1 repository · arXiv:2002.06546
-
Reformer: The Efficient Transformer 13 Jan 2020 · 10 repositories · arXiv:2001.04451Syntology ran 6 of 8 samples · 2 unverified
Tasks archive 2025-07-28
20 shown of 50 tasks the archive attaches to papers tagged with this method, by distinct papers. A task without a page in the catalog is plain text.
Usage over time archive 2025-07-28
Components: the archive holds no method-to-method composition, so PwC's Components table cannot be rebuilt; the Papers list carries no Results column for the same reason (the archive does not join its leaderboard rows to method tags).
Categories archive 2025-07-28
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections