{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/transformer-in-transformer","title":"Transformer in Transformer","arxiv_id":"2103.00112","date":"2021-02-27","proceeding":"NeurIPS 2021 12","authors":["Kai Han","An Xiao","Enhua Wu","Jianyuan Guo","Chunjing Xu","Yunhe Wang"],"abstract":"Transformer is a new kind of neural architecture which encodes the input data as powerful features via the attention mechanism. Basically, the visual transformers first divide the input images into several local patches and then calculate both representations and their relationship. Since natural images are of high complexity with abundant detail and color information, the granularity of the patch dividing is not fine enough for excavating features of objects in different scales and locations. In this paper, we point out that the attention inside these local patches are also essential for building visual transformers with high performance and we explore a new architecture, namely, Transformer iN Transformer (TNT). Specifically, we regard the local patches (e.g., 16$\\times$16) as \"visual sentences\" and present to further divide them into smaller patches (e.g., 4$\\times$4) as \"visual words\". The attention of each word will be calculated with other words in the given visual sentence with negligible computational costs. Features of both words and sentences will be aggregated to enhance the representation ability. Experiments on several benchmarks demonstrate the effectiveness of the proposed TNT architecture, e.g., we achieve an 81.5% top-1 accuracy on the ImageNet, which is about 1.7% higher than that of the state-of-the-art visual transformer with similar computational cost. The PyTorch code is available at https://github.com/huawei-noah/CV-Backbones, and the MindSpore code is available at https://gitee.com/mindspore/models/tree/master/research/cv/TNT.","url_abs":"https://arxiv.org/abs/2103.00112v3","url_pdf":"https://arxiv.org/pdf/2103.00112v3.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"transformer-in-transformer","repo_url":"https://github.com/huawei-noah/CV-backbones","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"tf","reach":{"status":"ok"}},{"paper_slug":"transformer-in-transformer","repo_url":"https://github.com/huawei-noah/CV-Backbones/tree/master/tnt_pytorch","is_official":1,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"pytorch","reach":null},{"paper_slug":"transformer-in-transformer","repo_url":"https://github.com/NZ99/transformer_in_transformer_flax","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"jax","reach":null},{"paper_slug":"transformer-in-transformer","repo_url":"https://github.com/Rishit-dagli/Transformer-in-Transformer","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"tf","reach":null},{"paper_slug":"transformer-in-transformer","repo_url":"https://github.com/lucidrains/transformer-in-transformer","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":null},{"paper_slug":"transformer-in-transformer","repo_url":"https://github.com/2023-MindSpore-1/ms-code-7/tree/main/TNT","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"mindspore","reach":null},{"paper_slug":"transformer-in-transformer","repo_url":"https://github.com/PaddlePaddle/PaddleClas","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"paddle","reach":{"status":"ok","spdx":"Apache-2.0"}},{"paper_slug":"transformer-in-transformer","repo_url":"https://github.com/mindspore-ai/models/tree/master/research/cv/TNT","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"mindspore","reach":null},{"paper_slug":"transformer-in-transformer","repo_url":"https://github.com/mindspore-courses/External-Attention-MindSpore/blob/main/model/backbone/TnT.py","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"mindspore","reach":null},{"paper_slug":"transformer-in-transformer","repo_url":"https://github.com/open-mmlab/mmclassification","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"pytorch","reach":{"status":"ok","spdx":"Apache-2.0"}},{"paper_slug":"transformer-in-transformer","repo_url":"https://github.com/rwightman/pytorch-image-models/blob/master/timm/models/tnt.py","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"pytorch","reach":null},{"paper_slug":"transformer-in-transformer","repo_url":"https://www.kaggle.com/rishitdagli/training-transformer-in-transformer","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"none","reach":null}],"tasks":[{"task_slug":"fine-grained-image-classification","task_name":"Fine-Grained Image Classification"},{"task_slug":"image-classification","task_name":"Image Classification"},{"task_slug":"sentence","task_name":"Sentence"}],"methods":[{"method_slug":"absolute-position-encodings","method_name":"Absolute Position Encodings"},{"method_slug":"adam","method_name":"Adam"},{"method_slug":"attention","method_name":"Attention"},{"method_slug":"attention-dropout","method_name":"Attention Dropout"},{"method_slug":"bpe","method_name":"BPE"},{"method_slug":"deit","method_name":"DeiT"},{"method_slug":"dense-connections","method_name":"Dense Connections"},{"method_slug":"dropout","method_name":"Dropout"},{"method_slug":"feedforward-network","method_name":"Feedforward Network"},{"method_slug":"label-smoothing","method_name":"Label Smoothing"},{"method_slug":"layer-normalization","method_name":"Layer Normalization"},{"method_slug":"linear-layer","method_name":"Linear Layer"},{"method_slug":"multi-head-attention","method_name":"Multi-Head Attention"},{"method_slug":"position-wise-feed-forward-layer","method_name":"Position-Wise Feed-Forward Layer"},{"method_slug":"residual-connection","method_name":"Residual Connection"},{"method_slug":"softmax","method_name":"Softmax"},{"method_slug":"tnt","method_name":"TNT"},{"method_slug":"transformer","method_name":"Transformer"}],"datasets_introduced":[],"methods_introduced":[{"slug":"tnt","name":"TNT","full_name":"Transformer in Transformer"}],"results":[{"leaderboard":"/sota/fine-grained-image-classification-on-oxford","task":"Fine-Grained Image Classification","dataset":"Oxford 102 Flowers","model":"TNT-B","rank_in_archive_order":8,"of":25,"metrics":{"Accuracy":"99.0%","PARAMS":"65.6M"},"uses_additional_data":false},{"leaderboard":"/sota/fine-grained-image-classification-on-oxford-1","task":"Fine-Grained Image Classification","dataset":"Oxford-IIIT Pet Dataset","model":"TNT-B","rank_in_archive_order":9,"of":15,"metrics":{"Accuracy":"95.0%","PARAMS":"65.6M"},"uses_additional_data":false},{"leaderboard":"/sota/image-classification-on-cifar-10","task":"Image Classification","dataset":"CIFAR-10","model":"TNT-B","rank_in_archive_order":15,"of":265,"metrics":{"Percentage correct":"99.1"},"uses_additional_data":true},{"leaderboard":"/sota/image-classification-on-cifar-100","task":"Image Classification","dataset":"CIFAR-100","model":"TNT-B","rank_in_archive_order":21,"of":211,"metrics":{"PARAMS":"65.6M","Percentage correct":"91.1"},"uses_additional_data":true},{"leaderboard":"/sota/image-classification-on-imagenet","task":"Image Classification","dataset":"ImageNet","model":"TNT-B","rank_in_archive_order":380,"of":1060,"metrics":{"Number of params":"65.6M","Top 1 Accuracy":"83.9%"},"uses_additional_data":false}],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2103.00112","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2103.00112"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/2023-MindSpore-1/ms-code-7/tree/main/TNT","reach":null},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/rwightman/pytorch-image-models/blob/master/timm/models/tnt.py","reach":null},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/PaddlePaddle/PaddleClas","reach":{"status":"ok","spdx":"Apache-2.0"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/mindspore-ai/models/tree/master/research/cv/TNT","reach":null},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/huawei-noah/CV-backbones","reach":{"status":"ok"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/lucidrains/transformer-in-transformer","reach":null},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/open-mmlab/mmclassification","reach":{"status":"ok","spdx":"Apache-2.0"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/Rishit-dagli/Transformer-in-Transformer","reach":null},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/huawei-noah/CV-Backbones/tree/master/tnt_pytorch","reach":null},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/mindspore-courses/External-Attention-MindSpore/blob/main/model/backbone/TnT.py","reach":null},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://www.kaggle.com/rishitdagli/training-transformer-in-transformer","reach":null},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/NZ99/transformer_in_transformer_flax","reach":null}],"summary":{"ran":14,"ran_draft_wrong":1,"ran_honours":1,"unverified":8},"by_repo_kind":{"official":{"samples":5,"ran":4,"repositories":1},"listed":{"samples":19,"ran":12,"repositories":3}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":5,"samples":[{"code_sha256_prefix":"e7fd0617316574c2","entry":"AddPositionEmbs","repo":"NZ99/transformer_in_transformer_flax","repo_kind":"listed","path":"transformer_in_transformer_flax/tnt.py","file_url":"https://github.com/NZ99/transformer_in_transformer_flax/blob/HEAD/transformer_in_transformer_flax/tnt.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"e7fd0617316574c2"}},{"code_sha256_prefix":"aa47e20b1de49f21","entry":"Attention","repo":"huawei-noah/CV-Backbones","repo_kind":"official","path":"tnt_pytorch/tnt.py","file_url":"https://github.com/huawei-noah/CV-Backbones/blob/HEAD/tnt_pytorch/tnt.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"aa47e20b1de49f21"}},{"code_sha256_prefix":"ae43efde4f9bdb00","entry":"Attention","repo":"Rishit-dagli/Transformer-in-Transformer","repo_kind":"listed","path":"tnt/tnt.py","file_url":"https://github.com/Rishit-dagli/Transformer-in-Transformer/blob/HEAD/tnt/tnt.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"ae43efde4f9bdb00"}},{"code_sha256_prefix":"81188c67ea536d0b","entry":"Attention","repo":"lucidrains/transformer-in-transformer","repo_kind":"listed","path":"transformer_in_transformer/tnt.py","file_url":"https://github.com/lucidrains/transformer-in-transformer/blob/HEAD/transformer_in_transformer/tnt.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"invariant","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"81188c67ea536d0b"}},{"code_sha256_prefix":"0adf903cee3f68c1","entry":"Block","repo":"huawei-noah/CV-Backbones","repo_kind":"official","path":"tnt_pytorch/tnt.py","file_url":"https://github.com/huawei-noah/CV-Backbones/blob/HEAD/tnt_pytorch/tnt.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"0adf903cee3f68c1"}},{"code_sha256_prefix":"fa83b1a389d93eb9","entry":"FeedForward","repo":"Rishit-dagli/Transformer-in-Transformer","repo_kind":"listed","path":"tnt/tnt.py","file_url":"https://github.com/Rishit-dagli/Transformer-in-Transformer/blob/HEAD/tnt/tnt.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"fa83b1a389d93eb9"}},{"code_sha256_prefix":"0f86fae86e577e92","entry":"MlpBlock","repo":"NZ99/transformer_in_transformer_flax","repo_kind":"listed","path":"transformer_in_transformer_flax/tnt.py","file_url":"https://github.com/NZ99/transformer_in_transformer_flax/blob/HEAD/transformer_in_transformer_flax/tnt.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"0f86fae86e577e92"}},{"code_sha256_prefix":"3ab31df137c0d6a7","entry":"PatchEmbed","repo":"huawei-noah/CV-Backbones","repo_kind":"official","path":"tnt_pytorch/tnt.py","file_url":"https://github.com/huawei-noah/CV-Backbones/blob/HEAD/tnt_pytorch/tnt.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"3ab31df137c0d6a7"}},{"code_sha256_prefix":"bc8ebba1f2a3f25c","entry":"PreNorm","repo":"Rishit-dagli/Transformer-in-Transformer","repo_kind":"listed","path":"tnt/tnt.py","file_url":"https://github.com/Rishit-dagli/Transformer-in-Transformer/blob/HEAD/tnt/tnt.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"bc8ebba1f2a3f25c"}},{"code_sha256_prefix":"3b5e96f71824e712","entry":"SE","repo":"huawei-noah/CV-Backbones","repo_kind":"official","path":"tnt_pytorch/tnt.py","file_url":"https://github.com/huawei-noah/CV-Backbones/blob/HEAD/tnt_pytorch/tnt.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"3b5e96f71824e712"}},{"code_sha256_prefix":"3c37926a5a94b20c","entry":"TNT","repo":"Rishit-dagli/Transformer-in-Transformer","repo_kind":"listed","path":"tnt/tnt.py","file_url":"https://github.com/Rishit-dagli/Transformer-in-Transformer/blob/HEAD/tnt/tnt.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"3c37926a5a94b20c"}},{"code_sha256_prefix":"f10d48901b98d6a7","entry":"TNTConfig","repo":"NZ99/transformer_in_transformer_flax","repo_kind":"listed","path":"transformer_in_transformer_flax/tnt.py","file_url":"https://github.com/NZ99/transformer_in_transformer_flax/blob/HEAD/transformer_in_transformer_flax/tnt.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"f10d48901b98d6a7"}},{"code_sha256_prefix":"4cb16ca8e61d759a","entry":"TransformPatches","repo":"NZ99/transformer_in_transformer_flax","repo_kind":"listed","path":"transformer_in_transformer_flax/tnt.py","file_url":"https://github.com/NZ99/transformer_in_transformer_flax/blob/HEAD/transformer_in_transformer_flax/tnt.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"4cb16ca8e61d759a"}},{"code_sha256_prefix":"f61d6e6e8177147a","entry":"divisible_by","repo":"lucidrains/transformer-in-transformer","repo_kind":"listed","path":"transformer_in_transformer/tnt.py","file_url":"https://github.com/lucidrains/transformer-in-transformer/blob/HEAD/transformer_in_transformer/tnt.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"f61d6e6e8177147a"}},{"code_sha256_prefix":"9a4efbdf001d9928","entry":"get_elements_from_nested_list","repo":"Rishit-dagli/Transformer-in-Transformer","repo_kind":"listed","path":"tnt/tnt.py","file_url":"https://github.com/Rishit-dagli/Transformer-in-Transformer/blob/HEAD/tnt/tnt.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"9a4efbdf001d9928"}},{"code_sha256_prefix":"cf4db82cbfb5407c","entry":"unfold_output_size","repo":"lucidrains/transformer-in-transformer","repo_kind":"listed","path":"transformer_in_transformer/tnt.py","file_url":"https://github.com/lucidrains/transformer-in-transformer/blob/HEAD/transformer_in_transformer/tnt.py","link_basis":"first_harvest_node","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"cf4db82cbfb5407c"}},{"code_sha256_prefix":"6a49d8dc0841e17c","entry":"Encoder","repo":"NZ99/transformer_in_transformer_flax","repo_kind":"listed","path":"transformer_in_transformer_flax/tnt.py","file_url":"https://github.com/NZ99/transformer_in_transformer_flax/blob/HEAD/transformer_in_transformer_flax/tnt.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"6a49d8dc0841e17c"}},{"code_sha256_prefix":"5fc54ab39842a479","entry":"TNT","repo":"huawei-noah/CV-Backbones","repo_kind":"official","path":"tnt_pytorch/tnt.py","file_url":"https://github.com/huawei-noah/CV-Backbones/blob/HEAD/tnt_pytorch/tnt.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"5fc54ab39842a479"}},{"code_sha256_prefix":"19242d4759c5ee91","entry":"TNT","repo":"lucidrains/transformer-in-transformer","repo_kind":"listed","path":"transformer_in_transformer/tnt.py","file_url":"https://github.com/lucidrains/transformer-in-transformer/blob/HEAD/transformer_in_transformer/tnt.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"19242d4759c5ee91"}},{"code_sha256_prefix":"950a07c48a64e5ab","entry":"TNTBlock","repo":"NZ99/transformer_in_transformer_flax","repo_kind":"listed","path":"transformer_in_transformer_flax/tnt.py","file_url":"https://github.com/NZ99/transformer_in_transformer_flax/blob/HEAD/transformer_in_transformer_flax/tnt.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"950a07c48a64e5ab"}},{"code_sha256_prefix":"4b8fa19df5d3871a","entry":"TransformerInTransformer","repo":"NZ99/transformer_in_transformer_flax","repo_kind":"listed","path":"transformer_in_transformer_flax/tnt.py","file_url":"https://github.com/NZ99/transformer_in_transformer_flax/blob/HEAD/transformer_in_transformer_flax/tnt.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"4b8fa19df5d3871a"}},{"code_sha256_prefix":"b506fc7ff0a3b8a4","entry":"default","repo":"lucidrains/transformer-in-transformer","repo_kind":"listed","path":"transformer_in_transformer/tnt.py","file_url":"https://github.com/lucidrains/transformer-in-transformer/blob/HEAD/transformer_in_transformer/tnt.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":"HONOURS","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"b506fc7ff0a3b8a4"}},{"code_sha256_prefix":"65876fc080ac5567","entry":"divisible_by","repo":"lucidrains/transformer-in-transformer","repo_kind":"listed","path":"transformer_in_transformer/tnt.py","file_url":"https://github.com/lucidrains/transformer-in-transformer/blob/HEAD/transformer_in_transformer/tnt.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":"VIOLATES","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"65876fc080ac5567"}},{"code_sha256_prefix":"1e954f6d1f5902c2","entry":"exists","repo":"lucidrains/transformer-in-transformer","repo_kind":"listed","path":"transformer_in_transformer/tnt.py","file_url":"https://github.com/lucidrains/transformer-in-transformer/blob/HEAD/transformer_in_transformer/tnt.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":"VIOLATES","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"1e954f6d1f5902c2"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}