Methods › General › Attention Modules › Graph Self-Attention
Graph Self-Attention
archive 2025-07-28 Description, source and code snippet are the archive's method entry.
Graph Self-Attention (GSA) is a self-attention module used in the BP-Transformer architecture, and is based on the graph attentional layer.
For a given node u, we update its representation according to its neighbour nodes, formulated as hᵤ ←GSA(𝒢, hᵘ).
Let A(u) denote the set of the neighbour nodes of u in 𝒢, GSA(𝒢, hᵘ) is detailed as follows:
Aᵘ = concat({hᵥ | v ∈𝒜(u)})
Qᵘᵢ = HₖW^Qᵢ,Kᵢᵘ = AᵘWᴷᵢ,Vᵘᵢ = AᵘWᵢⱽ
headᵘᵢ = softmax(QᵘᵢKᵢᵘᵀ/(√(d)))Vᵢᵘ
GSA(𝒢, hᵘ) = [headᵘ₁, …, headᵘₕ]Wᴼ
where d is the dimension of h, and W^Qᵢ, Wᴷᵢ and Wⱽᵢ are trainable parameters of the i-th attention head.
In Syntology name not resolved (unknown_name). The lookup matched no method, paper or venue by this name; that asserts nothing about whether code exists.
Near matches the lookup lists, each a different name: Attention Graphons; Power Law Graph Attention; Hop Graph Attention (HGA); Omni Self-Attention (OSA); self-modulating attention; Orthogonal Self-Attention; Local Self-Attention Block; Self-Graph Reasoning (SGR).
Syntology's have check for this name (free, it answers coverage only), read 2026-10-05; ask it again live. A level is the served verification level of that one answer; nothing here is summed across methods.
Papers archive 2025-07-28
archive papers tagged: 64 · with a code link: 19 · where Syntology ran a sample: 3 (3 with a run with no instrument failure, 0 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (3 of 64 tagged: 3 with a run with no instrument failure, 0 where every run was a failure of Syntology's instrument)
Page 1 of 1: papers 1 to 64 of 64, newest first by the archive's date (ties by slug), in archive order.
Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code, as “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. It is per sample and not a correctness claim. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from.
-
The Hype Index: an NLP-driven Measure of Market News Attention 30 May 2025 · 0 repositories · arXiv:2506.06329
-
Model Editing with Graph-Based External Memory 23 May 2025 · 0 repositories · arXiv:2505.18343
-
Exploring the Innovation Opportunities for Pre-trained Models 21 May 2025 · 0 repositories · arXiv:2505.15790
-
RL in Name Only? Analyzing the Structural Assumptions in RL post-training for LLMs 19 May 2025 · 0 repositories · arXiv:2505.13697
-
Comparative Analysis of Evolutionary Algorithms for Energy-Aware Production Scheduling 22 Apr 2025 · 0 repositories · arXiv:2504.15672
-
Beyond the Hype: Embeddings vs. Prompting for Multiclass Classification Tasks 5 Apr 2025 · 0 repositories · arXiv:2504.04277
-
What the F*ck Is Artificial General Intelligence? 31 Mar 2025 · 0 repositories · arXiv:2503.23923
-
Bridging Evolutionary Multiobjective Optimization and GPU Acceleration via Tensorization 26 Mar 2025 · 2 repositories · arXiv:2503.20286
-
Guidelines For The Choice Of The Baseline in XAI Attribution Methods 25 Mar 2025 · 1 repository · arXiv:2503.19813
-
The Imitation Game According To Turing 29 Jan 2025 · 0 repositories · arXiv:2501.17629
-
Why These Documents? Explainable Generative Retrieval with Hierarchical Category Paths 8 Nov 2024 · 1 repository · arXiv:2411.05572
-
Danoliteracy of Generative, Large Language Models 30 Oct 2024 · 0 repositories · arXiv:2410.22839
-
Misrepresented Technological Solutions in Imagined Futures: The Origins and Dangers of AI Hype in the Research Community 8 Aug 2024 · 0 repositories · arXiv:2408.15244
-
Decoding Knowledge Claims: The Evaluation of Scientific Publication Contributions through Semantic Analysis 26 Jul 2024 · 0 repositories · arXiv:2407.18646
-
Continuous fake media detection: adapting deepfake detectors to new generative techniques 12 Jun 2024 · 0 repositories · arXiv:2406.08171
-
HYPE: Hyperbolic Entailment Filtering for Underspecified Images and Texts 26 Apr 2024 · 1 repository · arXiv:2404.17507
-
AI Safety: Necessary, but insufficient and possibly problematic 26 Mar 2024 · 0 repositories · arXiv:2403.17419
-
SGHormer: An Energy-Saving Graph Transformer Driven by Spikes 26 Mar 2024 · 1 repository · arXiv:2403.17656
-
The Interplay of Learning, Analytics, and Artificial Intelligence in Education: A Vision for Hybrid Intelligence 24 Mar 2024 · 0 repositories · arXiv:2403.16081
-
Are you a robot? Detecting Autonomous Vehicles from Behavior Analysis 14 Mar 2024 · 0 repositories · arXiv:2403.09571
-
Assessing the Reasoning Abilities of ChatGPT in the Context of Claim Verification 16 Feb 2024 · 0 repositories · arXiv:2402.10735
-
An end-to-end attention-based approach for learning on graphs 16 Feb 2024 · 1 repository · arXiv:2402.10793
-
Investigating Out-of-Distribution Generalization of GNNs: An Architecture Perspective 13 Feb 2024 · 0 repositories · arXiv:2402.08228
-
LightGCN: Evaluated and Enhanced 17 Dec 2023 · 1 repository · arXiv:2312.16183
-
Neither hype nor gloom do DNNs justice 8 Dec 2023 · 0 repositories · arXiv:2312.05355
-
Hypothesis Network Planned Exploration for Rapid Meta-Reinforcement Learning Adaptation 7 Nov 2023 · 0 repositories · arXiv:2311.03701
-
HyPE: Attention with Hyperbolic Biases for Relative Positional Encoding 30 Oct 2023 · 0 repositories · arXiv:2310.19676
-
Web3 Meets AI Marketplace: Exploring Opportunities, Analyzing Challenges, and Suggesting Solutions 29 Oct 2023 · 0 repositories · arXiv:2310.19099
-
Does Artificial Intelligence benefit UK businesses? An empirical study of the impact of AI on productivity 6 Oct 2023 · 0 repositories · arXiv:2310.05985
-
Circle Feature Graphormer: Can Circle Features Stimulate Graph Transformer? 11 Sep 2023 · 1 repository · arXiv:2309.06574
-
Wisdom of the Crowds or Ignorance of the Masses? A data-driven guide to WSB 18 Aug 2023 · 0 repositories · arXiv:2308.09485
-
Proposing a conceptual framework: social media listening for public health behavior 30 Jul 2023 · 0 repositories · arXiv:2308.02037
-
Amplifying Limitations, Harms and Risks of Large Language Models 6 Jul 2023 · 0 repositories · arXiv:2307.04821
-
Learning to Prompt in the Classroom to Understand AI Limits: A pilot study 4 Jul 2023 · 0 repositories · arXiv:2307.01540
-
Wearable-based Fair and Accurate Pain Assessment Using Multi-Attribute Fairness Loss in Convolutional Neural Networks 3 Jul 2023 · 0 repositories · arXiv:2307.05333
-
Social Media Emotions and IPO Returns 21 Jun 2023 · 0 repositories · arXiv:2306.12602
-
Conversational Process Modeling: Can Generative AI Empower Domain Experts in Creating and Redesigning Process Models? 19 Apr 2023 · 1 repository · arXiv:2304.11065
-
The Shaky Foundations of Clinical Foundation Models: A Survey of Large Language Models and Foundation Models for EMRs 22 Mar 2023 · 2 repositories · arXiv:2303.12961
-
ChatGPT may Pass the Bar Exam soon, but has a Long Way to Go for the LexGLUE benchmark 9 Mar 2023 · 1 repository · arXiv:2304.12202
-
Because Every Sensor Is Unique, so Is Every Pair: Handling Dynamicity in Traffic Forecasting 20 Feb 2023 · 1 repository · arXiv:2302.09956
-
Democratization of Retail Trading: Can Reddit's WallStreetBets Outperform Investment Bank Analysts? 31 Dec 2022 · 0 repositories · arXiv:2301.00170
-
HyPe: Better Pre-trained Language Model Fine-tuning with Hidden Representation Perturbation 17 Dec 2022 · 1 repository · arXiv:2212.08853
-
Self-Attention Message Passing for Contrastive Few-Shot Learning 12 Oct 2022 · 1 repository · arXiv:2210.06339
-
When not to use machine learning: a perspective on potential and limitations 6 Oct 2022 · 0 repositories · arXiv:2210.02666
-
Not Cheating on the Turing Test: Towards Grounded Language Learning in Artificial Intelligence 29 Jun 2022 · 0 repositories · arXiv:2206.14672
-
Landing AI on Networks: An equipment vendor viewpoint on Autonomous Driving Networks 26 Apr 2022 · 0 repositories · arXiv:2205.08347
-
The 6-Ds of Creating AI-Enabled Systems 4 Feb 2022 · 0 repositories · arXiv:2202.03172
-
GRPE: Relative Positional Encoding for Graph Transformer 30 Jan 2022 · 1 repository · arXiv:2201.12787Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified (of 6 harvested samples)
-
Digital Twin: From Concept to Practice 14 Jan 2022 · 0 repositories · arXiv:2201.06912
-
Challenges of Artificial Intelligence -- From Machine Learning and Computer Vision to Emotional Intelligence 5 Jan 2022 · 0 repositories · arXiv:2201.01466
-
Machine learning for Earth System Science (ESS): A survey, status and future directions for South Asia 24 Dec 2021 · 0 repositories · arXiv:2112.12966
-
Machine Learning for Computational Science and Engineering -- a brief introduction and some critical questions 22 Dec 2021 · 0 repositories · arXiv:2112.12054
-
Towards Launching AI Algorithms for Cellular Pathology into Clinical & Pharmaceutical Orbits 17 Dec 2021 · 0 repositories · arXiv:2112.09496
-
Skeletal Graph Self-Attention: Embedding a Skeleton Inductive Bias into Sign Language Production 6 Dec 2021 · 0 repositories · arXiv:2112.05277
-
The Dangers of Underclaiming: Reasons for Caution When Reporting How NLP Systems Fail 15 Oct 2021 · 0 repositories · arXiv:2110.08300
-
Successive POI Recommendation via Brain-inspired Spatiotemporal Aware Representation 29 Sep 2021 · 0 repositories
-
A Techno-Economic Cost Framework for Satellite Networks Applied to Low Earth Orbit Constellations: Assessing Starlink, OneWeb and Kuiper 24 Aug 2021 · 0 repositories · arXiv:2108.10834
-
Should You Take Investment Advice From WallStreetBets? A Data-Driven Approach 6 May 2021 · 0 repositories · arXiv:2105.02728
-
Improving Abstractive Dialogue Summarization with Conversational Structure and Factual Knowledge 1 Jan 2021 · 0 repositories
-
Self-Supervised Hyperboloid Representations from Logical Queries over Knowledge Graphs 23 Dec 2020 · 1 repository · arXiv:2012.13023
-
Improving Abstractive Dialogue Summarization with Graph Structures and Topic Words 1 Dec 2020 · 0 repositories
-
Multivariate Time-series Anomaly Detection via Graph Attention Network 4 Sep 2020 · 2 repositories · arXiv:2009.02040Syntology 8 ran (of which 0 constructed an object rather than computing a result; 7 with no instrument failure: 0 honoured, 2 violated, 5 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 8 harvested samples)
-
Investigating Typed Syntactic Dependencies for Targeted Sentiment Classification Using Graph Attention Neural Network 22 Feb 2020 · 1 repository · arXiv:2002.09685
-
BP-Transformer: Modelling Long-Range Context via Binary Partitioning 11 Nov 2019 · 2 repositories · arXiv:1911.04070Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 5 unverified (of 7 harvested samples)
Tasks archive 2025-07-28
20 shown of 86 tasks the archive attaches to papers tagged with this method, by distinct papers. A task without a page in the catalog is plain text.
Usage over time archive 2025-07-28
Components: the archive holds no method-to-method composition, so PwC's Components table cannot be rebuilt; the Papers list carries no Results column for the same reason (the archive does not join its leaderboard rows to method tags).
Categories archive 2025-07-28
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections