Home › Code › multi_head_attention_forward

multi_head_attention_forward

Syntologyentry name in harvested coderead from the graph 2026-09-24

multi_head_attention_forward appears in the code Syntology harvested for 73 papers, as 42 distinct code bodies found in 79 places (a place is one code body under one paper). At least one of them ran in 17 of the papers; 0 of the code bodies carry a behaviour fingerprint.

What this page is not. Routines are grouped here by the exact string of their function or class name. Nothing asserts that two samples named multi_head_attention_forward do the same thing, share code, or are comparable; the name is a string, not an identity. Behaviour outputs (what a fingerprinted sample returned on the shared battery) are not in this export and are not shown here; the graph at syntology.ai holds them. "Ran" means executed on a synthesized fixture, not that the code is correct or reproduces a paper.

Samples Syntology

Syntology ran 13 of the 42 distinct code bodies named multi_head_attention_forward; 29 are unverified. One tile per status, in the site's fixed vocabulary, each code body counted once:

0ran · honoured contract
0ran · violated contract
4ran · our draft was wrong
2ran · fixture could not drive it
7ran
29unverified
0fingerprinted

Licence is a property of each copy, so it is counted per place: 31 of the 79 places are pointer only (Syntology does not serve that copy's text). This site shows no code text for any sample; every row below links to the file in its repository where the record names one.

“Ran” means the sample executed on a synthesized input; it does not mean the output is correct. “Honoured” and “violated” refer to a contract Syntology drafted from the code itself; “our draft was wrong” and “fixture could not drive it” are failures of Syntology's instrument, not of the code, and those samples did run. The ran count above is every status except unverified, the same rule as each paper page.

Papers

73 papers shown of 73, newest first; 79 places in the table. A paper with no recorded date is placed by the month its arXiv id encodes, shown in the Date column as YYYY-MM (from id). One row per place: a paper whose repository defines the name more than once appears more than once, and the same code body held for several papers appears once under each, with the same status. Titles and dates are the archive's archive 2025-07-28 for papers in the archive, and the graph's for 4 papers added by Syntology; 8 papers have no page here and are shown by arXiv id only. Status and fingerprint are Syntology's record of each code body; licence is recorded for each place. The File cell ends with the code body's code_sha256, Syntology's identity for that exact code: an agent fetches the stored sample with Syntology's MCP tool get_code(code_sha256="…") (how to connect); click an identity to copy that call.

PaperDateFileStatus SyntologyLicence
TABSWIFT: An Efficient Tabular Foundation Model with Row-Wise Attention added by Syntology 2026-06 (from id) LAMDA-Tabular/TabSwift/TALENT/model/lib/tabswift/model/attention.py a9dd34f2bf5c94fd ran MIT (permissive)
Nodule-DETR: A Novel DETR Architecture with Frequency-Channel Attention for Ultrasound Thyroid Nodule Detection added by Syntology 2026-01 (from id) wjj1wjj/Nodule-DETR/Nodule-DETR/models/attention.py a82091666b9db8cf unverified no licence file found · pointer only
Visual Diversity and Region-aware Prompt Learning for Zero-shot HOI Detection added by Syntology 2025-10 (from id) mlvlab/VDRP/attention.py 7653b4a0a7557b30 unverified MIT (permissive)
When One Moment Isn't Enough: Multi-Moment Retrieval with Cross-Moment Interactions added by Syntology 2025-10 (from id) Zhuo-Cao/QV-M2/FlashMMR/attention.py a82091666b9db8cf unverified no licence file found · pointer only
When One Moment Isn't Enough: Multi-Moment Retrieval with Cross-Moment Interactions added by Syntology 2025-10 (from id) Zhuo-Cao/QV-M2/FlashMMR/crossattention.py 5d7fc668e3b608cf unverified no licence file found · pointer only
arXiv:2506.23502 2025-06 (from id) Mengxiao-Tian/LAMP/clip/attention.py 440f24d0f7a85c28 unverified no licence file found · pointer only
Exploring CLIP's Dense Knowledge for Weakly Supervised Semantic Segmentation 26 Mar 2025 zwyang6/ExCEL/model/model_excel.py a7e566273a4fdcb7 ran · fixture could not drive it no licence file found · pointer only
State Space Model Meets Transformer: A New Paradigm for 3D Object Detection 18 Mar 2025 OpenSpaceAI/DEST3D/models/multi_head_attention.py fd73be3c7c18abff unverified MIT (permissive)
The Devil is in the Spurious Correlation: Boosting Moment Retrieval via Temporal Dynamic Learning 13 Jan 2025 xyangzhou/TD-DETR/td_detr/attention.py a82091666b9db8cf unverified MIT (permissive)
FlashVTG: Feature Layering and Adaptive Score Handling Network for Video Temporal Grounding 18 Dec 2024 zhuo-cao/flashvtg/FlashVTG/attention.py a82091666b9db8cf unverified no licence file found · pointer only
FlashVTG: Feature Layering and Adaptive Score Handling Network for Video Temporal Grounding 18 Dec 2024 zhuo-cao/flashvtg/FlashVTG/crossattention.py 5d7fc668e3b608cf unverified no licence file found · pointer only
RG-SAN: Rule-Guided Spatial Awareness Network for End-to-End 3D Referring Expression Segmentation 3 Dec 2024 sosppxo/RG-SAN/rg_san/model/attention.py a4a324f1b49cd7c6 unverified no licence file found · pointer only
RETR: Multi-View Radar Detection Transformer for Indoor Perception 15 Nov 2024 merlresearch/radar-detection-transformer/src/models/module_retr/attention.py 62e28a74b391b811 unverified AGPL-3.0 (copyleft) · pointer only
Lighthouse: A User-Friendly Library for Reproducible Video Moment Retrieval and Highlight Detection 6 Aug 2024 line/lighthouse/lighthouse/common/attention.py a82091666b9db8cf unverified Apache-2.0 (permissive)
Lighthouse: A User-Friendly Library for Reproducible Video Moment Retrieval and Highlight Detection 6 Aug 2024 line/lighthouse/lighthouse/common/crossattention.py 5d7fc668e3b608cf unverified Apache-2.0 (permissive)
An Efficient and Effective Transformer Decoder-Based Framework for Multi-Task Visual Grounding 2 Aug 2024 chenwei746/eevg/models/decoder_layer/multi_head_attention.py 17bc17d91de1161a unverified no licence file found · pointer only
Prior Knowledge Integration via LLM Encoding and Pseudo Event Regulation for Video Moment Retrieval 21 Jul 2024 fletcherjiang/llmepet/llm_epet/attention.py a82091666b9db8cf unverified BSD-3-Clause (permissive)
Prior Knowledge Integration via LLM Encoding and Pseudo Event Regulation for Video Moment Retrieval 21 Jul 2024 fletcherjiang/llmepet/llm_epet/crossattention.py 52dcd63a2ee1f51a unverified BSD-3-Clause (permissive)
DEAL: Disentangle and Localize Concept-level Explanations for VLMs 19 Jul 2024 tangli-udel/DEAL/CLIP/clip/auxilary.py 33c1a0c844a11c56 ran MIT (permissive)
SHINE: Saliency-aware HIerarchical NEgative Ranking for Compositional Temporal Grounding 6 Jul 2024 zxccade/SHINE/shine/attention.py a82091666b9db8cf unverified no licence file found · pointer only
LW-DETR: A Transformer Replacement to YOLO for Real-Time Detection 5 Jun 2024 atten4vis/lw-detr/models/attention.py 57e6ba78fde593e0 unverified Apache-2.0 (permissive)
Task-Driven Exploration: Decoupling and Inter-Task Feedback for Joint Moment Retrieval and Highlight Detection 14 Apr 2024 EdenGabriel/TaskWeave/taskweave/attention.py a82091666b9db8cf unverified no licence file found · pointer only
Unleash the Potential of CLIP for Video Highlight Detection 2 Apr 2024 dhk1349/HL-CLIP/moment_detr/attention.py a82091666b9db8cf unverified MIT (permissive)
IS-Fusion: Instance-Scene Collaborative Fusion for Multimodal 3D Object Detection 22 Mar 2024 yinjunbo/IS-Fusion/mmdet3d/models/middle_encoders/fusion_encoder.py e8974f996d0fa2ae ran Apache-2.0 (permissive)
TransGOP: Transformer-Based Gaze Object Prediction 21 Feb 2024 chenxi-Guo/TransGOP/models/TransGOP/attention.py a82091666b9db8cf unverified Apache-2.0 (permissive)
3D Diffuser Actor: Policy Diffusion with 3D Scene Representations 16 Feb 2024 nickgkan/3d_diffuser_actor/diffuser_actor/utils/multihead_custom_attention.py 616805ec8f4f95fb unverified MIT (permissive)
Social Physics Informed Diffusion Model for Crowd Simulation 8 Feb 2024 tsinghua-fib-lab/SPDiff/models/multi_attention_forward.py 4a5f247d4b18ad03 ran no licence file found · pointer only
TR-DETR: Task-Reciprocal Transformer for Joint Moment Retrieval and Highlight Detection 4 Jan 2024 mingyao1120/tr-detr/tr_detr/attention.py a82091666b9db8cf unverified no licence file found · pointer only
Towards Balanced Alignment: Modal-Enhanced Semantic Modeling for Video Moment Retrieval 19 Dec 2023 lntzm/mesm/model/attention.py a82091666b9db8cf unverified MIT (permissive)
General Object Foundation Model for Images and Videos at Scale 14 Dec 2023 FoundationVision/GLEE/projects/GLEE/glee/modules/attention.py 22a94fc69aed9aca unverified MIT (permissive)
Learning Hierarchical Prompt with Structured Linguistic Knowledge for Vision-Language Models 11 Dec 2023 vill-lab/2024-aaai-hpt/clip/attention.py 440f24d0f7a85c28 unverified MIT (permissive)
BAM-DETR: Boundary-Aligned Moment Detection Transformer for Temporal Sentence Grounding in Videos 30 Nov 2023 Pilhyeon/BAM-DETR/bam_detr/attention.py a82091666b9db8cf unverified no licence file found · pointer only
Bridging the Gap: A Unified Video Comprehension Framework for Moment Retrieval and Highlight Detection 28 Nov 2023 easonxiao-888/uvcom/uvcom/attention.py a82091666b9db8cf unverified MIT (permissive)
Correlation-Guided Query-Dependency Calibration for Video Temporal Grounding 15 Nov 2023 wjun0830/cgdetr/cg_detr/attention.py a82091666b9db8cf unverified no licence file found · pointer only
Correlation-Guided Query-Dependency Calibration for Video Temporal Grounding 15 Nov 2023 wjun0830/cgdetr/cg_detr/crossattention.py 5d7fc668e3b608cf unverified no licence file found · pointer only
Learning from Rich Semantics and Coarse Locations for Long-tailed Object Detection 18 Oct 2023 MengLcool/RichSem/models/richsem/attention.py a82091666b9db8cf unverified no licence file found · pointer only
X-Pose: Detecting Any Keypoints 12 Oct 2023 IDEA-Research/UniPose/models/UniPose/attention.py a82091666b9db8cf unverified no licence file found · pointer only
Cross-Modal Translation and Alignment for Survival Analysis 22 Sep 2023 ft-zhou-zzz/cmta/models/cmta/network.py ed90a207a3c44285 ran no licence file found · pointer only
Neural Speaker Diarization Using Memory-Aware Multi-Speaker Embedding with Sequence-to-Sequence Architecture 17 Sep 2023 liyunlongaaa/nsd-ms2s/local/model_S2S_weight_input_DIM.py f89d3dff01a8d443 unverified no licence file found · pointer only
Mask-Attention-Free Transformer for 3D Instance Segmentation 4 Sep 2023 dvlab-research/mask-attention-free-transformer/maft/model/attention.py f09175b0f39f0ad0 unverified no licence file found · pointer only
SketchDreamer: Interactive Text-Augmented Creative Sketch Ideation 27 Aug 2023 winkawaks/sketchdreamer/CLIP_/clip/auxilary.py bc3ccaf78ecd6394 ran Apache-2.0 (permissive)
Knowing Where to Focus: Event-aware Transformer for Video Grounding 14 Aug 2023 jinhyunj/eatr/models/attention.py a82091666b9db8cf unverified MIT (permissive)
Exploring Predicate Visual Context in Detecting Human-Object Interactions 11 Aug 2023 fredzzhang/pvic/attention.py 7653b4a0a7557b30 unverified BSD-3-Clause (permissive)
Learning Dynamic Query Combinations for Transformer-based Object Detection and Segmentation 23 Jul 2023 bytedance/DQ-Det/Cond-DETR-DQ/models/attention.py f09175b0f39f0ad0 unverified Apache-2.0 (permissive)
Towards Robust Scene Text Image Super-resolution via Explicit Location Enhancement 19 Jul 2023 csguoh/LEMMA/model/transformer.py 0ca1572c9755ffd9 ran Apache-2.0 (permissive)
MomentDiff: Generative Video Moment Retrieval from Random to Real 6 Jul 2023 imccretrieval/momentdiff/momentdiff/attention.py a82091666b9db8cf unverified no licence file found · pointer only
Segment Any Point Cloud Sequences by Distilling Vision Foundation Models 15 Jun 2023 IDEA-Research/OpenSeeD/openseed/modules/attention.py 22a94fc69aed9aca unverified Apache-2.0 (permissive)
Multimodal Optimal Transport-based Co-Attention Transformer with Global Structure Consistency for Survival Prediction 14 Jun 2023 JJ-ZHOU-Code/RobustMultiModel/models/model_coattn.py 4043b3b3f31ca073 unverified no licence file found · pointer only
Human-Object Interaction Prediction in Videos through Gaze Following 6 Jun 2023 nizhf/hoi-prediction-gaze-transformer/modules/sthoip_transformer/sttran/mha_utils.py c6cbf275e58cc089 unverified MIT (permissive)
Subequivariant Graph Reinforcement Learning in 3D Environments 30 May 2023 alpc91/sgrl/src/subequivariant_attentions.py 389d696e65ff8fb1 unverified MIT (permissive)
Subequivariant Graph Reinforcement Learning in 3D Environments 30 May 2023 alpc91/SGRL/src/attentions.py 11c0ca2379df2020 unverified MIT (permissive)
Linguistic More: Taking a Further Step toward Efficient and Accurate Scene Text Recognition 9 May 2023 CyrilSterling/LPV/modules/transformer.py 0ca1572c9755ffd9 ran MIT (permissive)
Speak Foreign Languages with Your Own Voice: Cross-Lingual Neural Codec Language Modeling 7 Mar 2023 plachtaa/vall-e-x/modules/activation.py 1b616e7eb0f31017 unverified MIT (permissive)
Masked Images Are Counterfactual Samples for Robust Fine-tuning 6 Mar 2023 Coxy7/robust-finetuning/models/clip/multihead_attention.py 10db37a6179c6f22 unverified Apache-2.0 (permissive)
AQuaMaM: An Autoregressive, Quaternion Manifold Model for Rapidly Estimating Complex SO(3) Distributions 21 Jan 2023 airalcorn2/aquamam/aquamam.py 968809b799fc5586 unverified MIT (permissive)
Pointly-Supervised Panoptic Segmentation 25 Oct 2022 BraveGroup/PSPS/models/attention.py de985e115a5e7c9b unverified Apache-2.0 (permissive)
Geodesic-Former: a Geodesic-Guided Few-shot 3D Point Cloud Instance Segmenter 22 Jul 2022 VinAIResearch/GeoFormer/model/attention.py 739083ff32255d01 unverified BSD-3-Clause (permissive)
Mask DINO: Towards A Unified Transformer-based Framework for Object Detection and Segmentation 6 Jun 2022 IDEA-opensource/DN-DETR/models/DN_DAB_DETR/attention.py a82091666b9db8cf unverified Apache-2.0 recorded; this copy not marked cleared · pointer only
TransFusion: Robust LiDAR-Camera Fusion for 3D Object Detection with Transformers 22 Mar 2022 xuyangbai/transfusion/mmdet3d/models/dense_heads/transfusion_head.py e8974f996d0fa2ae ran Apache-2.0 (permissive)
KinyaBERT: a Morphology-aware Kinyarwanda Language Model 16 Mar 2022 anzeyimana/kinyabert-acl2022/code/morpho_model.py 6b3df8438d1f1eb3 ran · our draft was wrong MIT (permissive)
DINO: DETR with Improved DeNoising Anchor Boxes for End-to-End Object Detection 7 Mar 2022 idea-research/dino/models/dino/attention.py a82091666b9db8cf unverified Apache-2.0 recorded; this copy not marked cleared · pointer only
DN-DETR: Accelerate DETR Training by Introducing Query DeNoising 2 Mar 2022 FengLi-ust/DN-DETR/models/DN_DAB_DETR/attention.py a82091666b9db8cf unverified Apache-2.0 recorded; this copy not marked cleared · pointer only
GroupFormer: Group Activity Recognition with Clustered Spatial-Temporal Transformer 28 Aug 2021 xueyee/groupformer/group/models/transformer_cluster.py 8e2156fc442de944 unverified Apache-2.0 (permissive)
Conditional DETR for Fast Training Convergence 13 Aug 2021 atten4vis/conditionaldetr/models/attention.py f09175b0f39f0ad0 unverified Apache-2.0 (permissive)
More Identifiable yet Equally Performant Transformers for Text Classification 2 Jun 2021 declare-lab/identifiable-transformers/model_identifiable.py 650a5edfdd5ec496 ran · our draft was wrong Apache-2.0 (permissive)
Learning Relation Alignment for Calibrated Cross-modal Retrieval 28 May 2021 lancopku/IAIS/model/attention.py fed42c63be2ceb6c ran · our draft was wrong MIT (permissive)
Group-Free 3D Object Detection via Transformers 1 Apr 2021 KookHoiKim/GroupFree3dBaseline/models/detector.py 89a5e4ca75931eac ran · fixture could not drive it MIT (permissive)
Read Like Humans: Autonomous, Bidirectional and Iterative Language Modeling for Scene Text Recognition 11 Mar 2021 FangShancheng/ABINet/modules/model_abinet.py 62abaf6e5036ae75 ran · our draft was wrong licence not identified · pointer only
Fast Convergence of DETR with Spatially Modulated Co-Attention 19 Jan 2021 gaopengcuhk/SMCA-DETR/models/attention_layer.py d72990eaed622d96 unverified no licence file found · pointer only
RelationNet++: Bridging Visual Representations for Object Detection via Transformer Decoder 29 Oct 2020 microsoft/RelationNet2/code/models/utils/bvr_transformer/multihead_attention.py 150c213138c1ac1a unverified MIT (permissive)
Large-Scale Adversarial Training for Vision-and-Language Representation Learning 11 Jun 2020 zhegan27/VILLA/model/attention.py fed42c63be2ceb6c ran · our draft was wrong MIT (permissive)
Spatio-Temporal Graph Transformer Networks for Pedestrian Trajectory Prediction 18 May 2020 Majiker/STAR/src/multi_attention_forward.py 4a5f247d4b18ad03 ran MIT (permissive)
arXiv:aaai_28387 Vill-Lab/2024-AAAI-HPT/clip/attention.py 440f24d0f7a85c28 unverified MIT (permissive)
arXiv:aaai_28177 lntzm/MESM/model/attention.py a82091666b9db8cf unverified MIT (permissive)
arXiv:Xiao_Bridging_the_Gap_A_Unified_Video_Comprehension_Framework_for_Moment_CVPR_2024_paper EasonXiao-888/UVCOM/uvcom/attention.py a82091666b9db8cf unverified MIT (permissive)
arXiv:Wang_Language-Driven_Multi-Label_Zero-Shot_Learning_with_Semantic_Granularity_ICCV_2025_paper wangshouwen/RCNn/clip/multi_head_attn.py 1274bb9f45cad0b2 unverified Apache-2.0 (permissive)
arXiv:Tang_Progressive_Attention_on_Multi-Level_Dense_Difference_Maps_for_Generic_Event_CVPR_2022_paper MCG-NJU/DDM/DDM-Net/modeling/attn.py f09175b0f39f0ad0 unverified MIT (permissive)
arXiv:Liu_SAP-DETR_Bridging_the_Gap_Between_Salient_Points_and_Queries-Based_Transformer_CVPR_2023_paper liuyang-ict/SAP-DETR/models/SAP_DETR/attention.py 8ccb75883fb557ba unverified Apache-2.0 recorded; this copy not marked cleared · pointer only
arXiv:He_Bidirectional_Alignment_for_Domain_Adaptive_Detection_with_Transformers_ICCV_2023_paper helq2612/biADT/models/dn_dab_deformable_detr/attention.py f9f896834ab32dc2 unverified Apache-2.0 recorded; this copy not marked cleared · pointer only

This site shows no code text; each File cell links to the file on GitHub at the repository's current default branch, which may have changed since the harvest. "Pointer only" means Syntology does not serve that copy's text, for one of four reasons: no licence file was found; the licence was not identified; the licence is recorded as permissive but that copy's record is not marked cleared; or the licence is outside the permissive list Syntology serves text under (MIT, Apache-2.0, BSD and similar). Some licences outside that list permit redistribution, such as WTFPL, and GPL-3.0 under its conditions; they are simply not on the list. Hover a licence cell for the reason. Per-sample records for a paper are on its paper page under "Code Syntology ran".

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections