{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/tokens-to-token-vit-training-vision","title":"Tokens-to-Token ViT: Training Vision Transformers from Scratch on ImageNet","arxiv_id":"2101.11986","date":"2021-01-28","proceeding":"ICCV 2021 10","authors":["Li Yuan","Yunpeng Chen","Tao Wang","Weihao Yu","Yujun Shi","Zihang Jiang","Francis EH Tay","Jiashi Feng","Shuicheng Yan"],"abstract":"Transformers, which are popular for language modeling, have been explored for solving vision tasks recently, e.g., the Vision Transformer (ViT) for image classification. The ViT model splits each image into a sequence of tokens with fixed length and then applies multiple Transformer layers to model their global relation for classification. However, ViT achieves inferior performance to CNNs when trained from scratch on a midsize dataset like ImageNet. We find it is because: 1) the simple tokenization of input images fails to model the important local structure such as edges and lines among neighboring pixels, leading to low training sample efficiency; 2) the redundant attention backbone design of ViT leads to limited feature richness for fixed computation budgets and limited training samples. To overcome such limitations, we propose a new Tokens-To-Token Vision Transformer (T2T-ViT), which incorporates 1) a layer-wise Tokens-to-Token (T2T) transformation to progressively structurize the image to tokens by recursively aggregating neighboring Tokens into one Token (Tokens-to-Token), such that local structure represented by surrounding tokens can be modeled and tokens length can be reduced; 2) an efficient backbone with a deep-narrow structure for vision transformer motivated by CNN architecture design after empirical study. Notably, T2T-ViT reduces the parameter count and MACs of vanilla ViT by half, while achieving more than 3.0\\% improvement when trained from scratch on ImageNet. It also outperforms ResNets and achieves comparable performance with MobileNets by directly training on ImageNet. For example, T2T-ViT with comparable size to ResNet50 (21.5M parameters) can achieve 83.3\\% top1 accuracy in image resolution 384$\\times$384 on ImageNet. (Code: https://github.com/yitu-opensource/T2T-ViT)","url_abs":"https://arxiv.org/abs/2101.11986v3","url_pdf":"https://arxiv.org/pdf/2101.11986v3.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"tokens-to-token-vit-training-vision","repo_url":"https://github.com/yitu-opensource/T2T-ViT","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":null},{"paper_slug":"tokens-to-token-vit-training-vision","repo_url":"https://github.com/KaenChan/ProbFace","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"tf","reach":{"status":"unanswered"}},{"paper_slug":"tokens-to-token-vit-training-vision","repo_url":"https://github.com/Shaunlipy/T2T_VIT","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":null},{"paper_slug":"tokens-to-token-vit-training-vision","repo_url":"https://github.com/ahmedelmahy/myownvit","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":null},{"paper_slug":"tokens-to-token-vit-training-vision","repo_url":"https://github.com/conceptofmind/Token-to-Token-ViT-flax","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"jax","reach":null},{"paper_slug":"tokens-to-token-vit-training-vision","repo_url":"https://github.com/mvenouziou/Project-Attention-Is-What-You-Get","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"tf","reach":null},{"paper_slug":"tokens-to-token-vit-training-vision","repo_url":"https://github.com/tianhai123/vit-pytorch","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":null},{"paper_slug":"tokens-to-token-vit-training-vision","repo_url":"https://github.com/ttt496/vit-pytorch","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":null},{"paper_slug":"tokens-to-token-vit-training-vision","repo_url":"https://github.com/zhl98/T2T_paddle","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"paddle","reach":{"status":"unanswered"}},{"paper_slug":"tokens-to-token-vit-training-vision","repo_url":"https://github.com/BR-IDL/PaddleViT/blob/main/image_classification/T2T_ViT","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"paddle","reach":null},{"paper_slug":"tokens-to-token-vit-training-vision","repo_url":"https://github.com/MindSpore-paper-code-2/code3/tree/main/t2t-vit","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"mindspore","reach":null},{"paper_slug":"tokens-to-token-vit-training-vision","repo_url":"https://github.com/PaddlePaddle/PASSL","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"paddle","reach":{"status":"ok","spdx":"Apache-2.0"}},{"paper_slug":"tokens-to-token-vit-training-vision","repo_url":"https://github.com/open-mmlab/mmclassification","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"pytorch","reach":{"status":"ok","spdx":"Apache-2.0"}}],"tasks":[{"task_slug":"image-classification","task_name":"Image Classification"},{"task_slug":"language-modeling","task_name":"Language Modeling"},{"task_slug":"language-modelling","task_name":"Language Modelling"},{"task_slug":"image-classification","task_name":"image-classification"}],"methods":[{"method_slug":"1x1-convolution","method_name":"1x1 Convolution"},{"method_slug":"absolute-position-encodings","method_name":"Absolute Position Encodings"},{"method_slug":"adam","method_name":"Adam"},{"method_slug":"attention","method_name":"Attention"},{"method_slug":"average-pooling","method_name":"Average Pooling"},{"method_slug":"bpe","method_name":"BPE"},{"method_slug":"batch-normalization","method_name":"Batch Normalization"},{"method_slug":"convolution","method_name":"Convolution"},{"method_slug":"dense-connections","method_name":"Dense Connections"},{"method_slug":"depthwise-convolution","method_name":"Depthwise Convolution"},{"method_slug":"depthwise-separable-convolution","method_name":"Depthwise Separable Convolution"},{"method_slug":"dropout","method_name":"Dropout"},{"method_slug":"ghost-bottleneck","method_name":"Ghost Bottleneck"},{"method_slug":"ghost-module","method_name":"Ghost Module"},{"method_slug":"ghostnet","method_name":"GhostNet"},{"method_slug":"global-average-pooling","method_name":"Global Average Pooling"},{"method_slug":"label-smoothing","method_name":"Label Smoothing"},{"method_slug":"layer-normalization","method_name":"Layer Normalization"},{"method_slug":"linear-layer","method_name":"Linear Layer"},{"method_slug":"multi-head-attention","method_name":"Multi-Head Attention"},{"method_slug":"pointwise-convolution","method_name":"Pointwise Convolution"},{"method_slug":"position-wise-feed-forward-layer","method_name":"Position-Wise Feed-Forward Layer"},{"method_slug":"relu","method_name":"ReLU"},{"method_slug":"residual-connection","method_name":"Residual Connection"},{"method_slug":"sigmoid-activation","method_name":"Sigmoid Activation"},{"method_slug":"softmax","method_name":"Softmax"},{"method_slug":"squeeze-and-excitation-block","method_name":"Squeeze-and-Excitation Block"},{"method_slug":"t2t-vit","method_name":"T2T-ViT"},{"method_slug":"transformer","method_name":"Transformer"},{"method_slug":"vision-transformer","method_name":"Vision Transformer"}],"datasets_introduced":[],"methods_introduced":[],"results":[{"leaderboard":"/sota/image-classification-on-imagenet","task":"Image Classification","dataset":"ImageNet","model":"T2T-ViT-14|384","rank_in_archive_order":436,"of":1060,"metrics":{"GFLOPs":"34.2","Top 1 Accuracy":"83.3%"},"uses_additional_data":false},{"leaderboard":"/sota/image-classification-on-imagenet","task":"Image Classification","dataset":"ImageNet","model":"T2T-ViTt-24","rank_in_archive_order":525,"of":1060,"metrics":{"GFLOPs":"30","Number of params":"64.4M","Top 1 Accuracy":"82.6%"},"uses_additional_data":false},{"leaderboard":"/sota/image-classification-on-imagenet","task":"Image Classification","dataset":"ImageNet","model":"T2T-ViT-24","rank_in_archive_order":548,"of":1060,"metrics":{"GFLOPs":"27.6","Top 1 Accuracy":"82.3%"},"uses_additional_data":false},{"leaderboard":"/sota/image-classification-on-imagenet","task":"Image Classification","dataset":"ImageNet","model":"T2T-ViTt-19","rank_in_archive_order":562,"of":1060,"metrics":{"GFLOPs":"19.6","Number of params":"39.2M","Top 1 Accuracy":"82.2%"},"uses_additional_data":false},{"leaderboard":"/sota/image-classification-on-imagenet","task":"Image Classification","dataset":"ImageNet","model":"T2T-ViT-19","rank_in_archive_order":593,"of":1060,"metrics":{"GFLOPs":"17.0","Top 1 Accuracy":"81.9%"},"uses_additional_data":false},{"leaderboard":"/sota/image-classification-on-imagenet","task":"Image Classification","dataset":"ImageNet","model":"T2T-ViT-14","rank_in_archive_order":636,"of":1060,"metrics":{"GFLOPs":"9.6","Number of params":"21.5M","Top 1 Accuracy":"81.5%"},"uses_additional_data":false}],"syntology":{"syntology_url":"https://syntology.ai/paper/2101.11986","atlas_url":"https://app.syntology.ai/?focus=2101.11986","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2101.11986"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-25T09:33:49+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/MindSpore-paper-code-2/code3/tree/main/t2t-vit","reach":null},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/zhl98/T2T_paddle","reach":{"status":"unanswered"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/PaddlePaddle/PASSL","reach":{"status":"ok","spdx":"Apache-2.0"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/KaenChan/ProbFace","reach":{"status":"unanswered"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/BR-IDL/PaddleViT/blob/main/image_classification/T2T_ViT","reach":null},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/ttt496/vit-pytorch","reach":null},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/open-mmlab/mmclassification","reach":{"status":"ok","spdx":"Apache-2.0"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/mvenouziou/Project-Attention-Is-What-You-Get","reach":null},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/yitu-opensource/T2T-ViT","reach":null},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/conceptofmind/Token-to-Token-ViT-flax","reach":null},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/Shaunlipy/T2T_VIT","reach":null},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/ahmedelmahy/myownvit","reach":null},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/tianhai123/vit-pytorch","reach":null}],"summary":{"ran":20,"ran_honours":1,"unverified":5},"by_repo_kind":{"official":{"samples":6,"ran":4,"repositories":1},"listed":{"samples":20,"ran":17,"repositories":5}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":8,"samples":[{"code_sha256_prefix":"26b673d7f271bb3d","entry":"Attention","repo":"ttt496/vit-pytorch","repo_kind":"listed","path":"vit_pytorch/t2t.py","file_url":"https://github.com/ttt496/vit-pytorch/blob/HEAD/vit_pytorch/t2t.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"26b673d7f271bb3d"}},{"code_sha256_prefix":"c5be8ba345dd9a2b","entry":"Attention","repo":"conceptofmind/Token-to-Token-ViT-flax","repo_kind":"listed","path":"t2t.py","file_url":"https://github.com/conceptofmind/Token-to-Token-ViT-flax/blob/HEAD/t2t.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"c5be8ba345dd9a2b"}},{"code_sha256_prefix":"bb63e3aa0e13762e","entry":"Attention","repo":"yitu-opensource/T2T-ViT","repo_kind":"official","path":"models/t2t_vit.py","file_url":"https://github.com/yitu-opensource/T2T-ViT/blob/HEAD/models/t2t_vit.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"bb63e3aa0e13762e"}},{"code_sha256_prefix":"6f1ffa7354716396","entry":"Attention","repo":"tianhai123/vit-pytorch","repo_kind":"listed","path":"vit_pytorch/t2t.py","file_url":"https://github.com/tianhai123/vit-pytorch/blob/HEAD/vit_pytorch/t2t.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"6f1ffa7354716396"}},{"code_sha256_prefix":"c17d96c99b861de1","entry":"FeedForward","repo":"ttt496/vit-pytorch","repo_kind":"listed","path":"vit_pytorch/t2t.py","file_url":"https://github.com/ttt496/vit-pytorch/blob/HEAD/vit_pytorch/t2t.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"c17d96c99b861de1"}},{"code_sha256_prefix":"b261477eb5f9d3a4","entry":"FeedForward","repo":"conceptofmind/Token-to-Token-ViT-flax","repo_kind":"listed","path":"t2t.py","file_url":"https://github.com/conceptofmind/Token-to-Token-ViT-flax/blob/HEAD/t2t.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"b261477eb5f9d3a4"}},{"code_sha256_prefix":"005532cda6b215dd","entry":"PreNorm","repo":"ttt496/vit-pytorch","repo_kind":"listed","path":"vit_pytorch/t2t.py","file_url":"https://github.com/ttt496/vit-pytorch/blob/HEAD/vit_pytorch/t2t.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"005532cda6b215dd"}},{"code_sha256_prefix":"da6e96393b45305a","entry":"PreNorm","repo":"conceptofmind/Token-to-Token-ViT-flax","repo_kind":"listed","path":"t2t.py","file_url":"https://github.com/conceptofmind/Token-to-Token-ViT-flax/blob/HEAD/t2t.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"da6e96393b45305a"}},{"code_sha256_prefix":"c0c9235b40027a60","entry":"RearrangeImage","repo":"ttt496/vit-pytorch","repo_kind":"listed","path":"vit_pytorch/t2t.py","file_url":"https://github.com/ttt496/vit-pytorch/blob/HEAD/vit_pytorch/t2t.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"c0c9235b40027a60"}},{"code_sha256_prefix":"e21b062fec33b4d7","entry":"RearrangeUnfoldTransformer","repo":"conceptofmind/Token-to-Token-ViT-flax","repo_kind":"listed","path":"t2t.py","file_url":"https://github.com/conceptofmind/Token-to-Token-ViT-flax/blob/HEAD/t2t.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"e21b062fec33b4d7"}},{"code_sha256_prefix":"f8c201eeb0cfec0a","entry":"T2TViT","repo":"ttt496/vit-pytorch","repo_kind":"listed","path":"vit_pytorch/t2t.py","file_url":"https://github.com/ttt496/vit-pytorch/blob/HEAD/vit_pytorch/t2t.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"f8c201eeb0cfec0a"}},{"code_sha256_prefix":"55d063282d6be0d2","entry":"T2TViT","repo":"conceptofmind/Token-to-Token-ViT-flax","repo_kind":"listed","path":"t2t.py","file_url":"https://github.com/conceptofmind/Token-to-Token-ViT-flax/blob/HEAD/t2t.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"55d063282d6be0d2"}},{"code_sha256_prefix":"7e22b681466bb3b8","entry":"T2TViT","repo":"ahmedelmahy/myownvit","repo_kind":"listed","path":"vit_pytorch/t2t.py","file_url":"https://github.com/ahmedelmahy/myownvit/blob/HEAD/vit_pytorch/t2t.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"7e22b681466bb3b8"}},{"code_sha256_prefix":"5284a1760a5fa238","entry":"T2T_module","repo":"yitu-opensource/T2T-ViT","repo_kind":"official","path":"models/t2t_vit.py","file_url":"https://github.com/yitu-opensource/T2T-ViT/blob/HEAD/models/t2t_vit.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"5284a1760a5fa238"}},{"code_sha256_prefix":"ee29036e4296eef5","entry":"T2T_module","repo":"Shaunlipy/T2T_VIT","repo_kind":"listed","path":"models/t2t_vit.py","file_url":"https://github.com/Shaunlipy/T2T_VIT/blob/HEAD/models/t2t_vit.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"ee29036e4296eef5"}},{"code_sha256_prefix":"755008532b287d3b","entry":"Token_performer","repo":"yitu-opensource/T2T-ViT","repo_kind":"official","path":"models/t2t_vit.py","file_url":"https://github.com/yitu-opensource/T2T-ViT/blob/HEAD/models/t2t_vit.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"755008532b287d3b"}},{"code_sha256_prefix":"2ec03ab6d47405ef","entry":"Token_transformer","repo":"yitu-opensource/T2T-ViT","repo_kind":"official","path":"models/t2t_vit.py","file_url":"https://github.com/yitu-opensource/T2T-ViT/blob/HEAD/models/t2t_vit.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"2ec03ab6d47405ef"}},{"code_sha256_prefix":"517882a6d04b7940","entry":"Transformer","repo":"ttt496/vit-pytorch","repo_kind":"listed","path":"vit_pytorch/t2t.py","file_url":"https://github.com/ttt496/vit-pytorch/blob/HEAD/vit_pytorch/t2t.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"517882a6d04b7940"}},{"code_sha256_prefix":"3b4d51835157c831","entry":"Transformer","repo":"conceptofmind/Token-to-Token-ViT-flax","repo_kind":"listed","path":"t2t.py","file_url":"https://github.com/conceptofmind/Token-to-Token-ViT-flax/blob/HEAD/t2t.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"3b4d51835157c831"}},{"code_sha256_prefix":"6f5a43d0a77a9794","entry":"Transformer","repo":"tianhai123/vit-pytorch","repo_kind":"listed","path":"vit_pytorch/t2t.py","file_url":"https://github.com/tianhai123/vit-pytorch/blob/HEAD/vit_pytorch/t2t.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"6f5a43d0a77a9794"}},{"code_sha256_prefix":"2160b3abdb219b68","entry":"conv_output_size","repo":"ttt496/vit-pytorch","repo_kind":"listed","path":"vit_pytorch/t2t.py","file_url":"https://github.com/ttt496/vit-pytorch/blob/HEAD/vit_pytorch/t2t.py","link_basis":"first_harvest_node","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":"well_formed","behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"2160b3abdb219b68"}},{"code_sha256_prefix":"4e7b29e9c82cf102","entry":"Block","repo":"yitu-opensource/T2T-ViT","repo_kind":"official","path":"models/t2t_vit.py","file_url":"https://github.com/yitu-opensource/T2T-ViT/blob/HEAD/models/t2t_vit.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"4e7b29e9c82cf102"}},{"code_sha256_prefix":"e38ae21b52d727dd","entry":"IdentityLayer","repo":"conceptofmind/Token-to-Token-ViT-flax","repo_kind":"listed","path":"t2t.py","file_url":"https://github.com/conceptofmind/Token-to-Token-ViT-flax/blob/HEAD/t2t.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"e38ae21b52d727dd"}},{"code_sha256_prefix":"2ecf8983d7a2547b","entry":"T2TViT","repo":"tianhai123/vit-pytorch","repo_kind":"listed","path":"vit_pytorch/t2t.py","file_url":"https://github.com/tianhai123/vit-pytorch/blob/HEAD/vit_pytorch/t2t.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"2ecf8983d7a2547b"}},{"code_sha256_prefix":"cd6a8b763f979637","entry":"T2T_ViT","repo":"yitu-opensource/T2T-ViT","repo_kind":"official","path":"models/t2t_vit.py","file_url":"https://github.com/yitu-opensource/T2T-ViT/blob/HEAD/models/t2t_vit.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"cd6a8b763f979637"}},{"code_sha256_prefix":"7e2445af0025404a","entry":"T2T_ViT","repo":"Shaunlipy/T2T_VIT","repo_kind":"listed","path":"models/t2t_vit.py","file_url":"https://github.com/Shaunlipy/T2T_VIT/blob/HEAD/models/t2t_vit.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"7e2445af0025404a"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}