Methods › General › Attention Modules › LAMA
Low-Rank Factorization-based Multi-Head Attention
LAMA
archive 2025-07-28 Description, source and code snippet are the archive's method entry.
Low-Rank Factorization-based Multi-head Attention Mechanism, or LAMA, is a type of attention module that uses low-rank factorization to reduce computational complexity. It uses low-rank bilinear pooling to construct a structured sentence representation that attends to multiple aspects of a sentence.
In Syntology the paper matched by title, arXiv:2410.21111, held, no code (no_code; paper_only). The lookup matched a paper by its title, arXiv:2410.21111, not a method entry. The archive credits no paper with an arXiv id for this method, so whether this answer (about arXiv:2410.21111) is about this method is not checked; it does not say whether this method has code.
Syntology's have check for this name (free, it answers coverage only), read 2026-10-05; ask it again live. A level is the served verification level of that one answer; nothing here is summed across methods.
Papers archive 2025-07-28
archive papers tagged: 42 · with a code link: 21 · where Syntology ran a sample: 4 (3 with a run with no instrument failure, 1 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (4 of 42 tagged: 3 with a run with no instrument failure, 1 where every run was a failure of Syntology's instrument)
Page 1 of 1: papers 1 to 42 of 42, newest first by the archive's date (ties by slug), in archive order.
Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code, as “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. It is per sample and not a correctness claim. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from.
-
HumanDreamer: Generating Controllable Human-Motion Videos via Decoupled Generation 31 Mar 2025 · 0 repositories · arXiv:2503.24026
-
SenseExpo: Efficient Autonomous Exploration with Prediction Information from Lightweight Neural Networks 20 Mar 2025 · 0 repositories · arXiv:2503.16000
-
One Mind, Many Tongues: A Deep Dive into Language-Agnostic Knowledge Neurons in Large Language Models 26 Nov 2024 · 0 repositories · arXiv:2411.17401
-
LAMA: Stable Dual-Domain Deep Reconstruction For Sparse-View CT 28 Oct 2024 · 0 repositories · arXiv:2410.21111
-
Discovering Leitmotifs in Multidimensional Time Series 16 Oct 2024 · 1 repository · arXiv:2410.12293
-
Consolidating LAMA with Best-First Width Search 26 Apr 2024 · 0 repositories · arXiv:2404.17648
-
Return to Tradition: Learning Reliable Heuristics with Classical Machine Learning 25 Mar 2024 · 1 repository · arXiv:2403.16508
-
Take Care of Your Prompt Bias! Investigating and Mitigating Prompt Bias in Factual Knowledge Extraction 15 Mar 2024 · 1 repository · arXiv:2403.09963
-
The Cost of Compression: Investigating the Impact of Compression on Parametric Knowledge in Language Models 1 Dec 2023 · 1 repository · arXiv:2312.00960Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 2 harvested samples) · 2 pointer-only (licence)
-
The minimal computational substrate of fluid intelligence 14 Aug 2023 · 0 repositories · arXiv:2308.07039
-
DLAMA: A Framework for Curating Culturally Diverse Facts for Probing the Knowledge of Pretrained Language Models 8 Jun 2023 · 1 repository · arXiv:2306.05076
-
Learned Alternating Minimization Algorithm for Dual-domain Sparse-View CT Reconstruction 5 Jun 2023 · 1 repository · arXiv:2306.02644
-
Locomotion-Action-Manipulation: Synthesizing Human-Scene Interactions in Complex 3D Environments 9 Jan 2023 · 0 repositories · arXiv:2301.02667
-
Rethinking Fast Fourier Convolution in Image Inpainting 1 Jan 2023 · 0 repositories
-
In-context Learning Distillation: Transferring Few-shot Learning Ability of Pre-trained Language Models 20 Dec 2022 · 0 repositories · arXiv:2212.10670
-
Context Variance Evaluation of Pretrained Language Models for Prompt-based Biomedical Knowledge Probing 18 Nov 2022 · 0 repositories · arXiv:2211.10265
-
SPE: Symmetrical Prompt Enhancement for Fact Probing 14 Nov 2022 · 0 repositories · arXiv:2211.07078
-
KAMEL : Knowledge Analysis with Multitoken Entities in Language Models 1 Nov 2022 · 1 repository
-
InforMask: Unsupervised Informative Masking for Language Model Pretraining 21 Oct 2022 · 1 repository · arXiv:2210.11771Syntology official: harvested, nothing ran · 0 ran · 1 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
The Effectiveness of Masked Language Modeling and Adapters for Factual Knowledge Injection 3 Oct 2022 · 1 repository · arXiv:2210.00907
-
Inpainting at Modern Camera Resolution by Guided PatchMatch with Auto-Curation 6 Aug 2022 · 0 repositories · arXiv:2208.03552
-
GLaMa: Joint Spatial and Frequency Loss for General Image Inpainting 15 May 2022 · 0 repositories · arXiv:2205.07162
-
Comparison of CoModGANs, LaMa and GLIDE for Art Inpainting- Completing M.C Escher's Print Gallery 3 May 2022 · 0 repositories · arXiv:2205.01741
-
Meta-learning via Language Model In-context Tuning 16 Nov 2021 · 0 repositories
-
SPE: Symmetrical Prompt Enhancement for Factual Knowledge Retrieval 16 Oct 2021 · 0 repositories
-
Meta-learning via Language Model In-context Tuning 15 Oct 2021 · 1 repository · arXiv:2110.07814
-
Rewire-then-Probe: A Contrastive Recipe for Probing Biomedical Knowledge of Pre-trained Language Models 15 Oct 2021 · 1 repository · arXiv:2110.08173
-
P-Adapters: Robustly Extracting Factual Information from Language Models with Diverse Prompts 14 Oct 2021 · 1 repository · arXiv:2110.07280
-
Resolution-robust Large Mask Inpainting with Fourier Convolutions 15 Sep 2021 · 8 repositories · arXiv:2109.07161Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 4 harvested samples)
-
No Need to Know Everything! Efficiently Augmenting Language Models With External Knowledge 3 Sep 2021 · 0 repositories
-
How to Query Language Models? 4 Aug 2021 · 1 repository · arXiv:2108.01928
-
How to Query Language Models? 16 May 2021 · 0 repositories
-
Understanding by Understanding Not: Modeling Negation in Language Models 7 May 2021 · 1 repository · arXiv:2105.03519
-
Factual Probing Is [MASK]: Learning vs. Learning to Recall 12 Apr 2021 · 2 repositories · arXiv:2104.05240Syntology official: harvested, nothing ran · 0 ran · 1 unverified (of 1 harvested sample)
-
Detecting Log Anomalies with Multi-Head Attention (LAMA) 7 Jan 2021 · 0 repositories · arXiv:2101.02392
-
Image Synthesis From Layout With Locality-Aware Mask Adaption 1 Jan 2021 · 1 repository
-
Pretrain Knowledge-Aware Language Models 1 Jan 2021 · 0 repositories
-
KgPLM: Knowledge-guided Language Model Pre-training via Generative and Discriminative Learning 7 Dec 2020 · 0 repositories · arXiv:2012.03551
-
AutoPrompt: Eliciting Knowledge from Language Models with Automatically Generated Prompts 29 Oct 2020 · 5 repositories · arXiv:2010.15980Syntology official (archive's flag): 2 ran · 3 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples) · 1 pointer-only (licence)
-
Knowledge Graph Based Synthetic Corpus Generation for Knowledge-Enhanced Language Model Pre-training 23 Oct 2020 · 1 repository · arXiv:2010.12688
-
Efficient Black-Box Planning Using Macro-Actions with Focused Effects 28 Apr 2020 · 2 repositories · arXiv:2004.13242Syntology official (archive's flag): 8 ran · 8 ran (of which 0 constructed an object rather than computing a result; 8 with no instrument failure: 0 honoured, 0 violated, 8 with no contract checked; 0 where Syntology's instrument failed) · 5 unverified (of 13 harvested samples)
-
Low Rank Factorization for Compact Multi-Head Self-Attention 26 Nov 2019 · 1 repository · arXiv:1912.00835
Tasks archive 2025-07-28
20 shown of 56 tasks the archive attaches to papers tagged with this method, by distinct papers. A task without a page in the catalog is plain text.
Usage over time archive 2025-07-28
Components: the archive holds no method-to-method composition, so PwC's Components table cannot be rebuilt; the Papers list carries no Results column for the same reason (the archive does not join its leaderboard rows to method tags).
Categories archive 2025-07-28
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections