Home › Code › MultiHeadSelfAttention

MultiHeadSelfAttention

Syntologyentry name in harvested coderead from the graph 2026-09-24

MultiHeadSelfAttention appears in the code Syntology harvested for 17 papers, as 21 distinct code bodies found in 21 places (a place is one code body under one paper). At least one of them ran in 17 of the papers; 5 of the code bodies carry a behaviour fingerprint.

What this page is not. Routines are grouped here by the exact string of their function or class name. Nothing asserts that two samples named MultiHeadSelfAttention do the same thing, share code, or are comparable; the name is a string, not an identity. Behaviour outputs (what a fingerprinted sample returned on the shared battery) are not in this export and are not shown here; the graph at syntology.ai holds them. "Ran" means executed on a synthesized fixture, not that the code is correct or reproduces a paper.

Samples Syntology

Syntology ran 21 of the 21 distinct code bodies named MultiHeadSelfAttention; 0 are unverified. One tile per status, in the site's fixed vocabulary, each code body counted once:

0ran · honoured contract
0ran · violated contract
0ran · our draft was wrong
0ran · fixture could not drive it
21ran
0unverified
5fingerprinted

Licence is a property of each copy, so it is counted per place: 9 of the 21 places are pointer only (Syntology does not serve that copy's text). This site shows no code text for any sample; every row below links to the file in its repository where the record names one.

“Ran” means the sample executed on a synthesized input; it does not mean the output is correct. “Honoured” and “violated” refer to a contract Syntology drafted from the code itself; “our draft was wrong” and “fixture could not drive it” are failures of Syntology's instrument, not of the code, and those samples did run. The ran count above is every status except unverified, the same rule as each paper page.

Papers

17 papers shown of 17, newest first; 21 places in the table. A paper with no recorded date is placed by the month its arXiv id encodes, shown in the Date column as YYYY-MM (from id). One row per place: a paper whose repository defines the name more than once appears more than once, and the same code body held for several papers appears once under each, with the same status. Titles and dates are the archive's archive 2025-07-28 for papers in the archive, and the graph's for 3 papers added by Syntology; 1 papers have no page here and are shown by arXiv id only. Status and fingerprint are Syntology's record of each code body; licence is recorded for each place. The File cell ends with the code body's code_sha256, Syntology's identity for that exact code: an agent fetches the stored sample with Syntology's MCP tool get_code(code_sha256="…") (how to connect); click an identity to copy that call.

PaperDateFileStatus SyntologyLicence
ScreenShot: A Foundation Model for Few-Shot Combination Drug Screening added by Syntology 2026-08 (from id) tansey-lab/screenshot/screenshot/screenshot.py 5aa389f841c7d630 ran · metamorphic tier: deterministic no licence file found · pointer only
Slot-MPC: Goal-Conditioned Model Predictive Control with Object-Centric Representations added by Syntology 2026-05 (from id) angelvillar96/PlaySlot/src/models/Predictors/DynamicsModels.py 0987ef4fdb7f10f2 ran no licence file found · pointer only
LoopViT: Scaling Visual ARC with Looped Transformers added by Syntology 2026-02 (from id) WenjieShu/LoopViT/src/ARC_LoopViT.py 5e13bc5575eebdc1 ran no licence file found · pointer only
Probabilistic Concept Bottleneck Models 2 Jun 2023 ejkim47/prob-cbm/models/build_model_resnset.py 428e1e15fdf0919e ran MIT (permissive)
MAGVLT: Masked Generative Vision-and-Language Transformer 21 Mar 2023 kakaobrain/magvlt/magvlt/models/stage2/transformers.py 2f73823d89add892 ran · metamorphic tier: deterministic MIT (permissive)
StoryDALL-E: Adapting Pretrained Text-to-Image Transformers for Story Continuation 13 Sep 2022 adymaharana/storydalle/story-dalle/dalle/models/stage2/transformer.py c354cf95a9627777 ran MIT (permissive)
Masked Autoencoders that Listen 13 Jul 2022 facebookresearch/multimodal/torchmultimodal/models/masked_auto_encoder/model.py 354dccecc7d137d8 ran · metamorphic tier: invariant fingerprinted BSD-3-Clause (permissive)
Video Graph Transformer for Video Question Answering 12 Jul 2022 sail-sg/VGT/model/vqa_model.py b091b2a22b3049e3 ran Apache-2.0 (permissive)
End-to-End Transformer Based Model for Image Captioning 29 Mar 2022 232525/PureT/models/pure_transformer.py 1b4e47ec99e1e927 ran fingerprinted no licence file found · pointer only
MobileViT: Light-weight, General-purpose, and Mobile-friendly Vision Transformer 5 Oct 2021 wilile26811249/MobileViT/models/model.py 3b57311302acf06c ran MIT (permissive)
RegionViT: Regional-to-Local Attention for Vision Transformers 4 Jun 2021 dc3ea9f/RegionViT/models/region_vit.py 02fc42edbfdbea41 ran MIT (permissive)
Training data-efficient image transformers & distillation through attention 23 Dec 2020 omihub777/vit-cifar/dw_vit.py 295ab55989f9e8fe ran · metamorphic tier: invariant MIT (permissive)
An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale 22 Oct 2020 Burf/VisionTransformer-Tensorflow2/vit/vit.py 36d6e2f710d562d7 ran MIT (permissive)
An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale 22 Oct 2020 rayanramoul/Visual-Transformer-PyTorch/src/models.py 37fc76128226736c ran · metamorphic tier: deterministic fingerprinted Apache-2.0 (permissive)
An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale 22 Oct 2020 nima1999nikkhah/ViT-Hybrid/ViT-Hybrid.py 15459d47883ae1eb ran no licence file found · pointer only
An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale 22 Oct 2020 04RR/SOTA-Vision/ViT.py d55ce4c4028d4526 ran fingerprinted no licence file found · pointer only
Universal Transformers 10 Jul 2018 sidney1505/arc_maml_transformer/keras_transformer/transformer.py 99fc6b1e929c1a86 ran no licence file found · pointer only
DARTS: Differentiable Architecture Search 24 Jun 2018 anonNo2/MulTeacher-KD/models/search_cnn.py 4902b129ae174440 ran no licence file found · pointer only
Attention Is All You Need 12 Jun 2017 The-AI-Summer/self_attention/self_attention_cv/transformer_vanilla/transformer_block.py cd2e2c9fddfd5422 ran · metamorphic tier: deterministic MIT (permissive)
Attention Is All You Need 12 Jun 2017 HanhaiNotHai/transformer/transformer.py a32c389367f7344c ran WTFPL · pointer only
arXiv:ijcai2025_0648 BW297/FACD/model/FACD.py 7e16aa458840b8a8 ran fingerprinted MIT (permissive)

This site shows no code text; each File cell links to the file on GitHub at the repository's current default branch, which may have changed since the harvest. "Pointer only" means Syntology does not serve that copy's text, for one of four reasons: no licence file was found; the licence was not identified; the licence is recorded as permissive but that copy's record is not marked cleared; or the licence is outside the permissive list Syntology serves text under (MIT, Apache-2.0, BSD and similar). Some licences outside that list permit redistribution, such as WTFPL, and GPL-3.0 under its conditions; they are simply not on the list. Hover a licence cell for the reason. Per-sample records for a paper are on its paper page under "Code Syntology ran".

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections