Home › Code › MultiHeadedAttention

MultiHeadedAttention

Syntologyentry name in harvested coderead from the graph 2026-09-24

MultiHeadedAttention appears in the code Syntology harvested for 38 papers, as 49 distinct code bodies found in 49 places (a place is one code body under one paper). At least one of them ran in 34 of the papers; 11 of the code bodies carry a behaviour fingerprint.

What this page is not. Routines are grouped here by the exact string of their function or class name. Nothing asserts that two samples named MultiHeadedAttention do the same thing, share code, or are comparable; the name is a string, not an identity. Behaviour outputs (what a fingerprinted sample returned on the shared battery) are not in this export and are not shown here; the graph at syntology.ai holds them. "Ran" means executed on a synthesized fixture, not that the code is correct or reproduces a paper.

Samples Syntology

Syntology ran 44 of the 49 distinct code bodies named MultiHeadedAttention; 5 are unverified. One tile per status, in the site's fixed vocabulary, each code body counted once:

0ran · honoured contract
0ran · violated contract
0ran · our draft was wrong
0ran · fixture could not drive it
44ran
5unverified
11fingerprinted

Licence is a property of each copy, so it is counted per place: 31 of the 49 places are pointer only (Syntology does not serve that copy's text). This site shows no code text for any sample; every row below links to the file in its repository where the record names one.

“Ran” means the sample executed on a synthesized input; it does not mean the output is correct. “Honoured” and “violated” refer to a contract Syntology drafted from the code itself; “our draft was wrong” and “fixture could not drive it” are failures of Syntology's instrument, not of the code, and those samples did run. The ran count above is every status except unverified, the same rule as each paper page.

Papers

38 papers shown of 38, newest first; 49 places in the table. A paper with no recorded date is placed by the month its arXiv id encodes, shown in the Date column as YYYY-MM (from id). One row per place: a paper whose repository defines the name more than once appears more than once, and the same code body held for several papers appears once under each, with the same status. Titles and dates are the archive's archive 2025-07-28 for papers in the archive, and the graph's for 4 papers added by Syntology. Status and fingerprint are Syntology's record of each code body; licence is recorded for each place. The File cell ends with the code body's code_sha256, Syntology's identity for that exact code: an agent fetches the stored sample with Syntology's MCP tool get_code(code_sha256="…") (how to connect); click an identity to copy that call.

PaperDateFileStatus SyntologyLicence
QuITE: Query-Based Irregular Time Series Embedding added by Syntology 2026-05 (from id) Meaningfull9502/QuITE/models/embeddings/quite.py aad38af511206eb3 ran · metamorphic tier: invariant fingerprinted no licence file found · pointer only
Domain Adaptation Without the Compute Burden for Efficient Whole Slide Image Analysis added by Syntology 2026-03 (from id) umarikkar/eWSI/models/wsi_models.py 7161463aa6072312 ran · metamorphic tier: deterministic no licence file found · pointer only
Attention's Gravitational Field: A Power-Law Interpretation of Positional Correlation added by Syntology 2026-03 (from id) OpenNMT/OpenNMT-py/onmt/modules/multi_headed_attn.py 62f1ce6285ab599b unverified MIT (permissive)
Alignment, Mining and Fusion: Representation Alignment with Hard Negative Mining and Selective Knowledge Fusion for Medical Visual Question Answering added by Syntology 2025-10 (from id) AlexCo1d/AMiF/model/submodule/Gated_Cross_Attention.py af22edada261aa74 ran no licence file found · pointer only
Flow Matching based Sequential Recommender Model 22 May 2025 FengLiu-1/FMRec/src/fmrec.py a0897ec05701d398 ran · metamorphic tier: invariant no licence file found · pointer only
Cross-modal Causal Relation Alignment for Video Question Grounding 5 Mar 2025 WissingChen/CRA-GQA/models/cra.py 379fd9e2ec6e80ff ran · metamorphic tier: deterministic no licence file found · pointer only
Prompt-enhanced Network for Hateful Meme Classification 12 Nov 2024 juszzi/Pen/Pen/rela_encoder.py 295c7cd78c0c5615 ran fingerprinted no licence file found · pointer only
Semi-Supervised Spoken Language Glossification 12 Jun 2024 yaohj11/S3LG/model/seq2seq/encoder.py 4c756637a87da821 ran · metamorphic tier: invariant MIT (permissive)
Robust Singing Voice Transcription Serves Synthesis 16 May 2024 RickyL-2000/ROSVOT/modules/rosvot/rosvot.py c656361e98563c09 ran MIT (permissive)
Predictive Modeling with Temporal Graphical Representation on Electronic Health Records 7 May 2024 The-Real-JerryChen/TRANS/models/Seqmodels.py aec89621438a6ffd ran · metamorphic tier: deterministic no licence file found · pointer only
Deep SE(3)-Equivariant Geometric Reasoning for Precise Placement Tasks 20 Apr 2024 r-pad/taxpose/taxpose/nets/transformer_flow.py 2aaa428ab3d2f019 ran · metamorphic tier: invariant fingerprinted MIT (permissive)
Prompt Switch: Efficient CLIP Adaptation for Text-Video Retrieval 15 Aug 2023 bladewaltz1/promptswitch/model/prompt_clip.py 90011c4f1d727ebe unverified no licence file found · pointer only
Concise Answers to Complex Questions: Summarization of Long-form Answers 30 May 2023 acpotluri/lfqa_summary/model/PreSumm/src/models/encoder.py 943c3bbe63e96f12 unverified no licence file found · pointer only
IMP: Iterative Matching and Pose Estimation with Adaptive Pooling 28 Apr 2023 feixue94/imp-release/nets/adgm.py d174e0da00210ed5 ran licence not identified · pointer only
GlueStick: Robust Image Matching by Sticking Points and Lines Together 4 Apr 2023 Golbstein/GlueStick-tensorflow/gluestick.py 0d5fe463a1a289eb ran fingerprinted no licence file found · pointer only
GlueStick: Robust Image Matching by Sticking Points and Lines Together 4 Apr 2023 cvg/GlueStick/gluestick/models/gluestick.py 35811a32bf5387ee ran MIT (permissive)
Zero-Shot Everything Sketch-Based Image Retrieval, and in Explainable Style 25 Mar 2023 buptLinfy/ZSE-SBIR/model/model.py 8b6a335cd0939a66 ran MIT (permissive)
CVT-SLR: Contrastive Visual-Textual Transformation for Sign Language Recognition with Variational Alignment 10 Mar 2023 binbinjiang/CVT-SLR/cvtslr_model.py 756e910b89bd8197 ran · metamorphic tier: invariant no licence file found · pointer only
SC-wLS: Towards Interpretable Feed-forward Camera Re-localization 23 Oct 2022 xinwu98/sc-wls/models/Dense_networks_e2e_GNN.py 6a1d48100708dee9 ran · metamorphic tier: deterministic MIT (permissive)
Dense Cross-Query-and-Support Attention Weighted Mask Aggregation for Few-Shot Segmentation 18 Jul 2022 pawn-sxy/DCAMA/model/DCAMA.py 5385d0ed2b350edf ran · metamorphic tier: deterministic no licence file found · pointer only
P-STMO: Pre-Trained Spatial Temporal Many-to-One Model for 3D Human Pose Estimation 15 Mar 2022 paTRICK-swk/P-STMO/model/stmo_pretrain.py 9bc6abc38072722f ran · metamorphic tier: deterministic MIT (permissive)
A Novel Perspective to Look At Attention: Bi-level Attention-based Explainable Topic Modeling for News Classification 14 Mar 2022 Ruixinhua/BATM/models/nc_bi_attention.py 587f583c6bb53989 ran · metamorphic tier: deterministic no licence file found · pointer only
StreamHover: Livestream Transcript Summarization and Annotation 11 Sep 2021 ucfnlp/streamhover/src/modeling_bertvqvae.py e38e088b24aef575 ran · metamorphic tier: deterministic no licence file found · pointer only
Low-Resource Dialogue Summarization with Domain-Agnostic Multi-Source Pretraining 9 Sep 2021 RowitZou/DAMS/src/models/dams.py 01f7839e605de391 ran MIT (permissive)
FuseFormer: Fusing Fine-Grained Information in Transformers for Video Inpainting 7 Sep 2021 ruiliu-ai/FuseFormer/model/fuseformer.py 634deecea407ff83 ran · metamorphic tier: deterministic no licence file found · pointer only
Improving 3D Object Detection with Channel-wise Transformer 23 Aug 2021 hlsheng1/ct3d/pcdet/models/roi_heads/ct3d_head.py 671c67f4433ae3c1 ran MIT (permissive)
Cross-Lingual Abstractive Summarization with Limited Parallel Resources 28 May 2021 WoodenWhite/MCLAS/src/models/model_builder.py e5315ec1cdee2571 ran fingerprinted MIT (permissive)
PQA: Perceptual Question Answering 8 Apr 2021 qugank/pqa.github.io/code/model/ContextAttention/attention.py f4c40c862f5893e8 ran fingerprinted no licence file found · pointer only
Robust Point Cloud Registration Framework Based on Deep Graph Matching 7 Mar 2021 fukexue/RGM/models/Net_noais.py 16726110f1aa6e89 ran · metamorphic tier: invariant fingerprinted no licence file found · pointer only
Data Augmentation for Abstractive Query-Focused Multi-Document Summarization 2 Mar 2021 ramakanth-pasunuru/QmdsCnnIr/src/abstractive/transformer_encoder.py ede19314dc86d7ce ran · metamorphic tier: deterministic no licence file found · pointer only
Neural Pharmacodynamic State Space Modeling 22 Feb 2021 zeshanmh/ief/ief_core/models/iefs/att_iefs.py 8af753e7dde0e0dc unverified MIT (permissive)
Is Space-Time Attention All You Need for Video Understanding? 9 Feb 2021 jerrywn121/TianChi_AIEarth/STTransformer/transformer.py bb5aa1cbee56c9d7 ran · metamorphic tier: deterministic no licence file found · pointer only
Generating Radiology Reports via Memory-driven Transformer 30 Oct 2020 cuhksz-nlp/R2Gen/modules/encoder_decoder.py b79314b6538aca28 ran fingerprinted no licence file found · pointer only
An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale 22 Oct 2020 konstantinos-p/image_classification_SOTA/testing/models/ViTransformer.py a166a1e285a378b2 ran · metamorphic tier: deterministic no licence file found · pointer only
Graph-based, Self-Supervised Program Repair from Diagnostic Feedback 20 May 2020 michiyasunaga/DrRepair/model/repairer/model/attention_zoo.py 995919c0e59b6ea0 ran · metamorphic tier: deterministic MIT (permissive)
Dense-Caption Matching and Frame-Selection Gating for Temporal Localization in VideoQA 13 May 2020 hyounghk/VideoQADenseCapFrameGate-ACL2020/qanet/tvqanet.py 27eddc30c65e3b95 ran MIT (permissive)
Transformer-XL: Attentive Language Models Beyond a Fixed-Length Context 9 Jan 2019 okkteam/Transformer-Transducer/tt/transformer/attention.py 5597fd8e1219b866 ran · metamorphic tier: deterministic no licence file found · pointer only
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding 11 Oct 2018 fanchenyou/transformer-study/transformer_bert_from_scratch_5.py 8708bfceac69760b ran · metamorphic tier: deterministic no licence file found · pointer only
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding 11 Oct 2018 linlei1214/SITS-BERT/code/model/bert.py a56b4078536a7e01 unverified MIT (permissive)
Attention Is All You Need 12 Jun 2017 tbmoon/LANL_Earthquake_Prediction/models.py b6f3f12968e48a46 ran · metamorphic tier: deterministic no licence file found · pointer only
Attention Is All You Need 12 Jun 2017 WenYanger/General-Transformer-Pytorch/Transformer.py 2b4f8633485ab704 ran · metamorphic tier: invariant fingerprinted no licence file found · pointer only
Attention Is All You Need 12 Jun 2017 Kirankumaraswamy/Transformers/models/transformer_model.py 9c6f007eae0a1c9c ran · metamorphic tier: deterministic no licence file found · pointer only
Attention Is All You Need 12 Jun 2017 ArdalanM/nlp-benchmarks/src/transformer/net.py 6c5285591a9dbf14 ran · metamorphic tier: invariant fingerprinted no licence file found · pointer only
Attention Is All You Need 12 Jun 2017 guillaume-chevalier/Linear-Attention-Recurrent-Neural-Network/multi_head_attention.py ec31c34cdcc5f31e ran MIT (permissive)
Attention Is All You Need 12 Jun 2017 soumik12345/transformer.pytorch/src/model.py 17b8e62d1c6f4854 ran no licence file found · pointer only
Attention Is All You Need 12 Jun 2017 fanchenyou/transformer-study/utils/attention.py 081d187f6e154043 ran no licence file found · pointer only
Attention Is All You Need 12 Jun 2017 gordicaleksa/pytorch-original-transformer/models/definitions/transformer_model.py 9957e49c08380d07 ran MIT (permissive)
Attention Is All You Need 12 Jun 2017 harvardnlp/annotated-transformer/the_annotated_transformer.py ac57a5d3fea5bd8f ran MIT (permissive)
Attention Is All You Need 12 Jun 2017 redevaaa/Transformer-for-EEG/lib/eeg_transformer.py 42f2dc140fc68040 ran · metamorphic tier: invariant fingerprinted no licence file found · pointer only

This site shows no code text; each File cell links to the file on GitHub at the repository's current default branch, which may have changed since the harvest. "Pointer only" means Syntology does not serve that copy's text, for one of four reasons: no licence file was found; the licence was not identified; the licence is recorded as permissive but that copy's record is not marked cleared; or the licence is outside the permissive list Syntology serves text under (MIT, Apache-2.0, BSD and similar). Some licences outside that list permit redistribution, such as WTFPL, and GPL-3.0 under its conditions; they are simply not on the list. Hover a licence cell for the reason. Per-sample records for a paper are on its paper page under "Code Syntology ran".

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections