Home › Code › TransformerBlock

TransformerBlock

Syntologyentry name in harvested coderead from the graph 2026-09-24

TransformerBlock appears in the code Syntology harvested for 73 papers, as 89 distinct code bodies found in 89 places (a place is one code body under one paper). At least one of them ran in 35 of the papers; 6 of the code bodies carry a behaviour fingerprint.

What this page is not. Routines are grouped here by the exact string of their function or class name. Nothing asserts that two samples named TransformerBlock do the same thing, share code, or are comparable; the name is a string, not an identity. Behaviour outputs (what a fingerprinted sample returned on the shared battery) are not in this export and are not shown here; the graph at syntology.ai holds them. "Ran" means executed on a synthesized fixture, not that the code is correct or reproduces a paper.

Samples Syntology

Syntology ran 47 of the 89 distinct code bodies named TransformerBlock; 42 are unverified. One tile per status, in the site's fixed vocabulary, each code body counted once:

0ran · honoured contract
0ran · violated contract
0ran · our draft was wrong
0ran · fixture could not drive it
47ran
42unverified
6fingerprinted

Licence is a property of each copy, so it is counted per place: 50 of the 89 places are pointer only (Syntology does not serve that copy's text). This site shows no code text for any sample; every row below links to the file in its repository where the record names one.

“Ran” means the sample executed on a synthesized input; it does not mean the output is correct. “Honoured” and “violated” refer to a contract Syntology drafted from the code itself; “our draft was wrong” and “fixture could not drive it” are failures of Syntology's instrument, not of the code, and those samples did run. The ran count above is every status except unverified, the same rule as each paper page.

Papers

73 papers shown of 73, newest first; 89 places in the table. A paper with no recorded date is placed by the month its arXiv id encodes, shown in the Date column as YYYY-MM (from id). One row per place: a paper whose repository defines the name more than once appears more than once, and the same code body held for several papers appears once under each, with the same status. Titles and dates are the archive's archive 2025-07-28 for papers in the archive, and the graph's for 17 papers added by Syntology; 4 papers have no page here and are shown by arXiv id only. Status and fingerprint are Syntology's record of each code body; licence is recorded for each place. The File cell ends with the code body's code_sha256, Syntology's identity for that exact code: an agent fetches the stored sample with Syntology's MCP tool get_code(code_sha256="…") (how to connect); click an identity to copy that call.

PaperDateFileStatus SyntologyLicence
Amortized Interventional Forecasting for Multivariate CIR Processes added by Syntology 2026-08 (from id) sa-and/cir-activa/models.py 5f42d8d95774866a ran no licence file found · pointer only
tFUSOperator: Operator Learning for Transcranial Focused Ultrasound Digital Twins added by Syntology 2026-08 (from id) CMME-Lab/tFUSOperator/models/model.py fd3ab8b08108ae49 ran · metamorphic tier: deterministic MIT (permissive)
From Interface to Inference: Eliciting Any-Order Inference from Any-Order Models added by Syntology 2026-07 (from id) SeunggeunKimkr/genuine-any-order/LatentMDM/model/latent_mdm.py 92e841bff119fbfb unverified Apache-2.0 (permissive)
Text-Driven Fusion for Infrared and Visible Images: Achieving Image Scene Adaptation on Hyperbolic Space added by Syntology 2026-06 (from id) Shaoyun2023/TEDFusion/model/TEDFusion_model.py 3bec9331e88709b1 ran no licence file found · pointer only
Slot-MPC: Goal-Conditioned Model Predictive Control with Object-Centric Representations added by Syntology 2026-05 (from id) angelvillar96/PlaySlot/src/models/Predictors/DynamicsModels.py 39f80a1d11dadcea unverified no licence file found · pointer only
Shape: A Self-Supervised 3D Geometry Foundation Model for Industrial CAD Analysis added by Syntology 2026-04 (from id) simd-ai/shape/shape_foundation/models/gaot_backbone.py 59d28bdee2ad39aa unverified Apache-2.0 (permissive)
Emergency Preemption Without Online Exploration: A Decision Transformer Approach added by Syntology 2026-03 (from id) AnthonySu/decision-transformer-traffic/src/models/madt.py 5bbbfdbefbaf524d ran · metamorphic tier: deterministic no licence file found · pointer only
TabICLv2: A better, faster, scalable, and open tabular foundation model added by Syntology 11 Feb 2026 soda-inria/nanotabicl/model.py 17ca29b6edfb0303 unverified BSD-3-Clause (permissive)
Accelerating Benchmarking of Functional Connectivity Modeling via Structure-aware Core-set Selection added by Syntology 2026-02 (from id) lzhan94swu/SCLCS/model.py 2cc3cf6df8f2cd0a ran · metamorphic tier: deterministic no licence file found · pointer only
Kernelized Edge Attention: Addressing Semantic Attention Blurring in Temporal Graph Neural Networks added by Syntology 2026-02 (from id) shenyangHuang/TGB/modules/sthn.py c0c8de46adf7473e unverified MIT (permissive)
Semi-Supervised Masked Autoencoders: Unlocking Vision Transformer Potential with Limited Data added by Syntology 2026-01 (from id) atik666/ssmae/ssmae.py 439300399e4bce24 ran no licence file found · pointer only
Breaking Coordinate Overfitting: Geometry-Aware WiFi Sensing for Cross-Layout 3D Pose Estimation added by Syntology 2026-01 (from id) Trymore-lab/PerceptAlign/perceptalign/models/perceptalign.py 6d63f165bbbdc39f ran · metamorphic tier: invariant fingerprinted MIT (permissive)
ResTok: Learning Hierarchical Residuals in 1D Visual Tokenizers for Autoregressive Image Generation added by Syntology 2026-01 (from id) Kwai-Kolors/ResTok/modeling/restok.py 031fee67ad484ab8 unverified Apache-2.0 (permissive)
Enhancing Infrared Vision: Progressive Prompt Fusion Network and Benchmark added by Syntology 2025-10 (from id) Zihang-Chen/HM-TIR/models/restormer_arch.py 543f89fa45313251 ran MIT (permissive)
Language Model Based Text-to-Audio Generation: Anti-Causally Aligned Collaborative Residual Transformers added by Syntology 2025-10 (from id) wjc2830/Siren/src/siren/model.py 569eaf68130b8046 unverified no licence file found · pointer only
Boundary-to-Region Supervision for Offline Safe Reinforcement Learning added by Syntology 2025-09 (from id) HuikangSu/B2R/model/B2R.py 5f51ec4895241525 unverified Apache-2.0 (permissive)
Global Regulation and Excitation via Attention Tuning for Stereo Matching added by Syntology 2025-09 (from id) JarvisLee0423/GREAT-Stereo/models/great_stereo/transformers.py 91825e9c5c198d4d unverified Apache-2.0 (permissive)
HoliTracer: Holistic Vectorization of Geographic Objects from Large-Size Remote Sensing Imagery 22 Jul 2025 vvangfaye/HoliTracer/holitracer/vector/models/base.py 786b3229be60ffc1 ran · metamorphic tier: invariant MIT (permissive)
PhysioWave: A Multi-Scale Wavelet-Transformer for Physiological Signal Representation 12 Jun 2025 ForeverBlue816/PhysioWave/model.py 8560d21a0d260387 ran · metamorphic tier: deterministic MIT (permissive)
From Debate to Equilibrium: Belief-Driven Multi-Agent LLM Reasoning via Bayesian Nash Equilibrium 9 Jun 2025 tmlr-group/econ/src/modules/agents/belief_policy_network.py c9580d1c98d9c426 ran fingerprinted MIT (permissive)
Flow Matching based Sequential Recommender Model 22 May 2025 FengLiu-1/FMRec/src/fmrec.py c2faa101f85c2e6f ran fingerprinted no licence file found · pointer only
Degradation-Aware Feature Perturbation for All-in-One Image Restoration 19 May 2025 TxpHome/DFPIR/net/model.py cde7278418c4fe09 ran no licence file found · pointer only
Voila: Voice-Language Foundation Models for Real-Time Autonomous Interaction and Voice Role-Play 5 May 2025 maitrix-org/Voila/model.py 262a73a1c64553d2 unverified MIT (permissive)
F$^3$Set: Towards Analyzing Fast, Frequent, and Fine-grained Events from Videos 11 Apr 2025 f3set/f3set/model/impl/actionformer.py 881363cfc3127e8f unverified no licence file found · pointer only
PixelFlow: Pixel-Space Generative Models with Flow 10 Apr 2025 shoufachen/pixelflow/pixelflow/model.py 768992dc577749dc unverified MIT (permissive)
Devil is in the Uniformity: Exploring Diverse Learners within Transformer for Image Restoration 26 Mar 2025 joshyZhou/HINT/basicsr/models/archs/HINT_arch.py 888eb051383154ce unverified no licence file found · pointer only
Neighboring Autoregressive Modeling for Efficient Visual Generation 12 Mar 2025 thisisbillhe/nar/NAR-images/autoregressive/models/gpt.py 0421358adba1260b unverified no licence file found · pointer only
One Model for ALL: Low-Level Task Interaction Is a Key to Task-Agnostic Image Fusion 27 Feb 2025 AWCXV/GIFNet/GIFNet_model.py 12e49ea3bbb33533 ran no licence file found · pointer only
Improving Autoregressive Visual Generation with Cluster-Oriented Token Prediction 1 Jan 2025 sjtuplayer/IAR/autoregressive/models/gpt.py f03b5731f02b2a1e unverified no licence file found · pointer only
Meissonic: Revitalizing Masked Generative Transformers for Efficient High-Resolution Text-to-Image Synthesis 10 Oct 2024 viiika/Meissonic/src/transformer.py 8d6351d29b4f55c6 unverified Apache-2.0 (permissive)
Diffusion Auto-regressive Transformer for Effective Self-supervised Time Series Forecasting 8 Oct 2024 mingyue-cheng/timemae/model/TimeMAE.py d60276a4b2f78c8d ran · metamorphic tier: deterministic no licence file found · pointer only
ControlAR: Controllable Image Generation with Autoregressive Models 3 Oct 2024 hustvl/controlar/autoregressive/models/gpt.py 7baa685224160fe5 unverified Apache-2.0 (permissive)
SONICS: Synthetic Or Not -- Identifying Counterfeit Songs 26 Aug 2024 awsaf49/sonics/sonics/models/spectttra.py 1a607e9c32d2884d ran · metamorphic tier: invariant licence not identified · pointer only
RealViformer: Investigating Attention for Real-World Video Super-Resolution 19 Jul 2024 Yuehan717/RealViformer/archs/realviformer_arch.py e91c5e9a654fd7dc unverified MIT (permissive)
Restoring Images in Adverse Weather Conditions via Histogram Transformer 14 Jul 2024 sunshangquan/Histoformer/basicsr/models/archs/histoformer_arch.py b3103e147e16c1a5 unverified no licence file found · pointer only
OneRestore: A Universal Restoration Framework for Composite Degradation 5 Jul 2024 gy65896/onerestore/model/OneRestore.py 392dd9ba5b5f2e7a unverified no licence file found · pointer only
Simplified and Generalized Masked Diffusion for Discrete Data 6 Jun 2024 google-deepmind/md4/md4/models/diffusion/md4.py 7a351fb6b29e26ac unverified Apache-2.0 (permissive)
TOPA: Extending Large Language Models for Video Understanding via Text-Only Pre-Alignment 22 May 2024 dhg-wei/topa/llama/model.py 36f60efcf15f5bc6 unverified MIT (permissive)
Predictive Modeling with Temporal Graphical Representation on Electronic Health Records 7 May 2024 The-Real-JerryChen/TRANS/models/Seqmodels.py 65bdef9d91c144b9 ran · metamorphic tier: deterministic no licence file found · pointer only
Dual-Scale Transformer for Large-Scale Single-Pixel Imaging 7 Apr 2024 Gang-Qu/HATNet-SPI/model/network.py f0be4135088932a4 unverified no licence file found · pointer only
Bidirectional Multi-Scale Implicit Neural Representations for Image Deraining 2 Apr 2024 cschenxiang/NeRD-Rain/model.py e0f3a63ce67469c7 unverified no licence file found · pointer only
arXiv:2404.00288 2024-04 (from id) joshyZhou/FPro/basicsr/models/archs/FPro_arch.py 2e2bd9540b0c5ff0 unverified no licence file found · pointer only
A Semi-supervised Nighttime Dehazing Baseline with Spatial-Frequency Aware and Realistic Brightness Constraint 27 Mar 2024 Xiaofeng-life/SFSNiD/methods/MyNightDehazing/SFSNiD.py 5a7a00261e5bfad2 ran no licence file found · pointer only
Text-Guided Molecule Generation with Diffusion Language Model 20 Feb 2024 Deno-V/tgm-dlm/improved-diffusion/improved_diffusion/transformer_model.py 85f117cd2c476a03 unverified no licence file found · pointer only
Guiding Masked Representation Learning to Capture Spatio-Temporal Relationship of Electrocardiogram 2 Feb 2024 bakqui/st-mem/models/st_mem.py 8bb3bf9e7e9a8e01 ran · metamorphic tier: deterministic licence not identified · pointer only
Emergence of In-Context Reinforcement Learning from Noise Distillation 19 Dec 2023 corl-team/ad-eps/dark_room/ad_darkroom.py 0797809d36877895 ran · metamorphic tier: deterministic no licence file found · pointer only
arXiv:2311.04434 2023-11 (from id) spatialdatasciencegroup/HST/utils/bandLayers.py 1886bc45e56b3f1a unverified no licence file found · pointer only
Large Language Models are Temporal and Causal Reasoners for Video Question Answering 24 Oct 2023 mlvlab/Flipped-VQA/llama/model.py ed5543f646686967 unverified MIT (permissive)
Self-Supervised Neuron Segmentation with Multi-Agent Reinforcement Learning 6 Oct 2023 ydchen0806/dbMiM/dbmim/models.py a8c788e1c3eb20c1 ran no licence file found · pointer only
MB-TaylorFormer: Multi-branch Efficient Transformer Expanded by Taylor Formula for Image Dehazing 27 Aug 2023 FVL2020/ICCV-2023-MB-TaylorFormer/basicsr/models/archs/MB_TaylorFormer.py 60ff91d683606241 unverified no licence file found · pointer only
Llama 2: Open Foundation and Fine-Tuned Chat Models 18 Jul 2023 glb400/Toy-RecLM/model.py 61aae005c3076a9b unverified MIT (permissive)
Learning A Sparse Transformer Network for Effective Image Deraining 21 Mar 2023 cschenxiang/drsformer/basicsr/models/archs/DRSformer_arch.py 724b7c5be1319bc9 unverified no licence file found · pointer only
DDFM: Denoising Diffusion Model for Multi-Modality Image Fusion 13 Mar 2023 zhaozixiang1228/mmif-cddfuse/net.py 7fbefc76d724c861 ran · metamorphic tier: deterministic no licence file found · pointer only
Im2Hands: Learning Attentive Implicit Representation of Interacting Two-Hand Shapes 28 Feb 2023 jyunlee/im2hands/artihand/nasa/models/core_ref_occ.py e8908a6667142a43 ran no licence file found · pointer only
Constrained Decision Transformer for Offline Safe Reinforcement Learning 14 Feb 2023 liuzuxin/osrl/osrl/algorithms/cdt.py c0e123b568ecbec0 ran fingerprinted Apache-2.0 (permissive)
E-NeRV: Expedite Neural Video Representation with Disentangled Spatial-Temporal Context 17 Jul 2022 kyleleey/E-NeRV/model/E_NeRV.py 718295a430fc6897 ran no licence file found · pointer only
Video Graph Transformer for Video Question Answering 12 Jul 2022 sail-sg/VGT/model/vqa_model.py b294b4902336fb78 ran fingerprinted Apache-2.0 (permissive)
StarGraph: Knowledge Representation Learning based on Incomplete Two-hop Subgraph 27 May 2022 hzli-ucas/stargraph/model.py 479ae90c7dfc70a7 ran no licence file found · pointer only
Training Compute-Optimal Large Language Models 29 Mar 2022 karpathy/llama2.c/model.py 46b07f9445b01dce unverified MIT (permissive)
Auto-scaling Vision Transformers without Training 24 Feb 2022 vita-group/asvit/lib/models/cell_infers/transformer.py 96404f2862cd1474 unverified MIT (permissive)
FuseFormer: Fusing Fine-Grained Information in Transformers for Video Inpainting 7 Sep 2021 ruiliu-ai/FuseFormer/model/fuseformer.py afa615aa2f60ae16 ran · metamorphic tier: deterministic no licence file found · pointer only
Self-Attentive Ensemble Transformer: Representing Ensemble Interactions in Neural Networks for Earth System Models 21 Jun 2021 uantwerpm4s/pp_eupp/Transformer.py b8f30b82390a6db8 ran · metamorphic tier: deterministic MIT (permissive)
Decision Transformer: Reinforcement Learning via Sequence Modeling 2 Jun 2021 corl-team/CORL/algorithms/offline/dt.py d879368facd3289e ran Apache-2.0 (permissive)
Decision Transformer: Reinforcement Learning via Sequence Modeling 2 Jun 2021 zzmtsvv/rl_task/decision_transformer/model.py 12cc4b7038955563 ran no licence file found · pointer only
Decision Transformer: Reinforcement Learning via Sequence Modeling 2 Jun 2021 yun-kwak/decision-transformer-jax/dt_jax/gpt.py 9b48d1222dabdd2c unverified MIT (permissive)
SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformers 31 May 2021 macdonaldezra/minesegsat/mine_seg_sat/models/segformer.py 89979e961601b054 ran MIT (permissive)
Read Like Humans: Autonomous, Bidirectional and Iterative Language Modeling for Scene Text Recognition 11 Mar 2021 topdu/openocr/openrec/modeling/decoders/abinet_decoder.py 27366919489ba9ab ran · metamorphic tier: deterministic Apache-2.0 (permissive)
Multi-Stage Progressive Image Restoration 4 Feb 2021 taowangzj/llformer/model/LLFormer.py 2d417e1b35e33481 unverified licence not identified · pointer only
An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale 22 Oct 2020 Burf/VisionTransformer-Tensorflow2/vit/vit.py 608cb341e62af9a7 ran MIT (permissive)
An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale 22 Oct 2020 mdmhriday/vision-transformers/models/vit.py 136aaa7dc1143322 ran · metamorphic tier: deterministic MIT (permissive)
An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale 22 Oct 2020 nima1999nikkhah/ViT-Hybrid/ViT-Hybrid.py 472347df45454b8a ran no licence file found · pointer only
An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale 22 Oct 2020 04RR/SOTA-Vision/ViT.py 625ba3d0632ccbe7 ran no licence file found · pointer only
An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale 22 Oct 2020 uzi0espil/research-papers-implementation/Vision Transformer/models.py 621c33d160c8772b ran no licence file found · pointer only
An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale 22 Oct 2020 Ugenteraan/Masked-AutoEncoder-PyTorch/models/mae.py ca9596fc7f3f63a7 ran · metamorphic tier: invariant licence not identified · pointer only
ALBERT: A Lite BERT for Self-supervised Learning of Language Representations 26 Sep 2019 kamalkraj/ALBERT-TF2.0/albert.py 64da3191abb9f8c9 unverified Apache-2.0 (permissive)
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding 11 Oct 2018 fanchenyou/transformer-study/transformer_bert_from_scratch_5.py 7e19140b483ea0b1 ran · metamorphic tier: deterministic no licence file found · pointer only
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding 11 Oct 2018 codertimo/BERT-pytorch/bert_pytorch/model/bert.py 81af9c02ca090c06 unverified Apache-2.0 (permissive)
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding 11 Oct 2018 eagle705/bert/model/bert.py daa550ff0552c158 unverified no licence file found · pointer only
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding 11 Oct 2018 linlei1214/SITS-BERT/code/model/bert.py 9b28507fe7a827ac unverified MIT (permissive)
Universal Transformers 10 Jul 2018 sidney1505/arc_maml_transformer/keras_transformer/transformer.py bfa58c8b92ee3953 unverified no licence file found · pointer only
Attention Is All You Need 12 Jun 2017 WenYanger/General-Transformer-Pytorch/Transformer.py 1a2fa936d6b70229 ran · metamorphic tier: deterministic no licence file found · pointer only
Attention Is All You Need 12 Jun 2017 Wolfie8935/Implementation-of-Attention-is-all-you-need/transformer_from_scratch.py eb24958475ff8e8a ran · metamorphic tier: deterministic no licence file found · pointer only
Attention Is All You Need 12 Jun 2017 jelifysh/Transformers/transformers.py a41be559b566c0ca ran · metamorphic tier: deterministic no licence file found · pointer only
Attention Is All You Need 12 Jun 2017 The-AI-Summer/self_attention/self_attention_cv/transformer_vanilla/transformer_block.py 82fc4978c3cb86ab ran · metamorphic tier: deterministic MIT (permissive)
Attention Is All You Need 12 Jun 2017 Rami97rgb/French-to-English-Translator/model.py 9ea0e0ad81a3931c ran no licence file found · pointer only
Attention Is All You Need 12 Jun 2017 nlinc1905/dsilt-tsa/time_series_classification/models.py 4f1eaa4055e49eac ran MIT (permissive)
Attention Is All You Need 12 Jun 2017 ShivamRajSharma/Transformer-Architectures-From-Scratch/TRANSFORMERS.py 97b94fa2b1b16f5b ran · metamorphic tier: invariant fingerprinted MIT (permissive)
arXiv:ijcai2024_0231 2837790380/SD-CEM/model/SDCEM.py a7a7203de53c6f2b unverified no licence file found · pointer only
arXiv:Zhou_PanoLlama_Generating_Endless_and_Coherent_Panoramas_with_Next-Token-Prediction_LLMs_ICCV_2025_paper 0606zt/PanoLlama/token_generator/gpt.py b99cafb688aeae10 unverified no licence file found · pointer only

This site shows no code text; each File cell links to the file on GitHub at the repository's current default branch, which may have changed since the harvest. "Pointer only" means Syntology does not serve that copy's text, for one of four reasons: no licence file was found; the licence was not identified; the licence is recorded as permissive but that copy's record is not marked cleared; or the licence is outside the permissive list Syntology serves text under (MIT, Apache-2.0, BSD and similar). Some licences outside that list permit redistribution, such as WTFPL, and GPL-3.0 under its conditions; they are simply not on the list. Hover a licence cell for the reason. Per-sample records for a paper are on its paper page under "Code Syntology ran".

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections