{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/is-space-time-attention-all-you-need-for","title":"Is Space-Time Attention All You Need for Video Understanding?","arxiv_id":"2102.05095","date":"2021-02-09","proceeding":null,"authors":["Gedas Bertasius","Heng Wang","Lorenzo Torresani"],"abstract":"We present a convolution-free approach to video classification built exclusively on self-attention over space and time. Our method, named \"TimeSformer,\" adapts the standard Transformer architecture to video by enabling spatiotemporal feature learning directly from a sequence of frame-level patches. Our experimental study compares different self-attention schemes and suggests that \"divided attention,\" where temporal attention and spatial attention are separately applied within each block, leads to the best video classification accuracy among the design choices considered. Despite the radically new design, TimeSformer achieves state-of-the-art results on several action recognition benchmarks, including the best reported accuracy on Kinetics-400 and Kinetics-600. Finally, compared to 3D convolutional networks, our model is faster to train, it can achieve dramatically higher test efficiency (at a small drop in accuracy), and it can also be applied to much longer video clips (over one minute long). Code and models are available at: https://github.com/facebookresearch/TimeSformer.","url_abs":"https://arxiv.org/abs/2102.05095v4","url_pdf":"https://arxiv.org/pdf/2102.05095v4.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"is-space-time-attention-all-you-need-for","repo_url":"https://github.com/facebookresearch/TimeSformer","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"unanswered"}},{"paper_slug":"is-space-time-attention-all-you-need-for","repo_url":"https://github.com/davide-coccomini/TimeSformer-Video-Classification","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"unanswered"}},{"paper_slug":"is-space-time-attention-all-you-need-for","repo_url":"https://github.com/halixness/generative_timesformer_pytorch","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":null},{"paper_slug":"is-space-time-attention-all-you-need-for","repo_url":"https://github.com/jerrywn121/TianChi_AIEarth","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":null},{"paper_slug":"is-space-time-attention-all-you-need-for","repo_url":"https://github.com/lucidrains/TimeSformer-pytorch","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":null},{"paper_slug":"is-space-time-attention-all-you-need-for","repo_url":"https://github.com/m-bain/video-transformers","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":null},{"paper_slug":"is-space-time-attention-all-you-need-for","repo_url":"https://github.com/md-mohaiminul/objectstatechange","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"NOASSERTION"}},{"paper_slug":"is-space-time-attention-all-you-need-for","repo_url":"https://github.com/mx-mark/videotransformer-pytorch","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":null},{"paper_slug":"is-space-time-attention-all-you-need-for","repo_url":"https://github.com/yiyixuxu/TimeSformer-rolled-attention","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":null},{"paper_slug":"is-space-time-attention-all-you-need-for","repo_url":"https://github.com/MindCode-4/code-5/tree/main/timesformer","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"mindspore","reach":null},{"paper_slug":"is-space-time-attention-all-you-need-for","repo_url":"https://github.com/PaddlePaddle/PaddleVideo/blob/develop/docs/zh-CN/model_zoo/recognition/timesformer.md","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"paddle","reach":null},{"paper_slug":"is-space-time-attention-all-you-need-for","repo_url":"https://github.com/The-AI-Summer/self-attention-cv","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"pytorch","reach":null},{"paper_slug":"is-space-time-attention-all-you-need-for","repo_url":"https://github.com/open-mmlab/mmaction2","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"pytorch","reach":null},{"paper_slug":"is-space-time-attention-all-you-need-for","repo_url":"https://github.com/pwc-1/Paper-10/tree/main/timesformer","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"mindspore","reach":null},{"paper_slug":"is-space-time-attention-all-you-need-for","repo_url":"https://github.com/pwc-1/Paper-9/tree/main/1/timesformer","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"mindspore","reach":null},{"paper_slug":"is-space-time-attention-all-you-need-for","repo_url":"https://github.com/towhee-io/towhee","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"pytorch","reach":null}],"tasks":[{"task_slug":"action-classification","task_name":"Action Classification"},{"task_slug":"action-recognition-in-videos","task_name":"Action Recognition"},{"task_slug":"all","task_name":"All"},{"task_slug":"anomaly-detection","task_name":"Anomaly Detection"},{"task_slug":"classification","task_name":"General Classification"},{"task_slug":"video-classification","task_name":"Video Classification"},{"task_slug":"video-question-answering","task_name":"Video Question Answering"},{"task_slug":"video-understanding","task_name":"Video Understanding"}],"methods":[{"method_slug":"timesformer","method_name":"TimeSformer"}],"datasets_introduced":[],"methods_introduced":[{"slug":"timesformer","name":"TimeSformer","full_name":"TimeSformer"}],"results":[{"leaderboard":"/sota/action-classification-on-kinetics-400","task":"Action Classification","dataset":"Kinetics-400","model":"TimeSformer-L","rank_in_archive_order":93,"of":207,"metrics":{"Acc@1":"80.7","Acc@5":"94.7","FLOPs (G) x views":"7140x3","Parameters (M)":"121.4"},"uses_additional_data":false},{"leaderboard":"/sota/action-classification-on-kinetics-400","task":"Action Classification","dataset":"Kinetics-400","model":"TimeSformer-HR","rank_in_archive_order":108,"of":207,"metrics":{"Acc@1":"79.7","Acc@5":"94.4"},"uses_additional_data":false},{"leaderboard":"/sota/action-classification-on-kinetics-400","task":"Action Classification","dataset":"Kinetics-400","model":"TimeSformer","rank_in_archive_order":130,"of":207,"metrics":{"Acc@1":"78","Acc@5":"93.7"},"uses_additional_data":false},{"leaderboard":"/sota/action-recognition-on-diving-48","task":"Action Recognition","dataset":"Diving-48","model":"TimeSformer-L","rank_in_archive_order":15,"of":18,"metrics":{"Accuracy":"81"},"uses_additional_data":false},{"leaderboard":"/sota/action-recognition-on-diving-48","task":"Action Recognition","dataset":"Diving-48","model":"TimeSformer-HR","rank_in_archive_order":16,"of":18,"metrics":{"Accuracy":"78"},"uses_additional_data":false},{"leaderboard":"/sota/action-recognition-on-diving-48","task":"Action Recognition","dataset":"Diving-48","model":"TimeSformer","rank_in_archive_order":18,"of":18,"metrics":{"Accuracy":"75"},"uses_additional_data":false},{"leaderboard":"/sota/action-recognition-in-videos-on-something","task":"Action Recognition","dataset":"Something-Something V2","model":"TimeSformer-HR","rank_in_archive_order":103,"of":123,"metrics":{"Top-1 Accuracy":"62.5"},"uses_additional_data":true},{"leaderboard":"/sota/action-recognition-in-videos-on-something","task":"Action Recognition","dataset":"Something-Something V2","model":"TimeSformer-L","rank_in_archive_order":104,"of":123,"metrics":{"Top-1 Accuracy":"62.3"},"uses_additional_data":true},{"leaderboard":"/sota/action-recognition-in-videos-on-something","task":"Action Recognition","dataset":"Something-Something V2","model":"TimeSformer","rank_in_archive_order":113,"of":123,"metrics":{"Top-1 Accuracy":"59.5"},"uses_additional_data":true},{"leaderboard":"/sota/anomaly-detection-on-ubnormal","task":"Anomaly Detection","dataset":"UBnormal","model":"TimeSformer","rank_in_archive_order":5,"of":14,"metrics":{"AUC":"68.5%","RBDC":"0.04","TBDC":"0.05"},"uses_additional_data":true},{"leaderboard":"/sota/video-question-answering-on-howto100m-qa","task":"Video Question Answering","dataset":"Howto100M-QA","model":"TimeSformer","rank_in_archive_order":1,"of":1,"metrics":{"Accuracy":"62.1"},"uses_additional_data":false}],"syntology":{"syntology_url":"https://syntology.ai/paper/2102.05095","atlas_url":"https://app.syntology.ai/?focus=2102.05095","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2102.05095"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-25T09:33:49+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/pwc-1/Paper-9/tree/main/1/timesformer","reach":null},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/yiyixuxu/TimeSformer-rolled-attention","reach":null},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/facebookresearch/TimeSformer","reach":{"status":"unanswered"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/MindCode-4/code-5/tree/main/timesformer","reach":null},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/PaddlePaddle/PaddleVideo/blob/develop/docs/zh-CN/model_zoo/recognition/timesformer.md","reach":null},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/m-bain/video-transformers","reach":null},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/The-AI-Summer/self-attention-cv","reach":null},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/md-mohaiminul/objectstatechange","reach":{"status":"ok","spdx":"NOASSERTION"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/lucidrains/TimeSformer-pytorch","reach":null},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/jerrywn121/TianChi_AIEarth","reach":null},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/pwc-1/Paper-10/tree/main/timesformer","reach":null},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/davide-coccomini/TimeSformer-Video-Classification","reach":{"status":"unanswered"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/mx-mark/videotransformer-pytorch","reach":null},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/open-mmlab/mmaction2","reach":null},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/towhee-io/towhee","reach":null},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/halixness/generative_timesformer_pytorch","reach":null}],"summary":{"ran":20,"ran_fixture":9,"ran_draft_wrong":5,"ran_violates":1,"unverified":8},"by_repo_kind":{"listed":{"samples":42,"ran":34,"repositories":6}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":14,"samples":[{"code_sha256_prefix":"9e6eb12055d4b5db","entry":"Attention","repo":"halixness/generative_timesformer_pytorch","repo_kind":"listed","path":"timesformer_pytorch/timesformer_pytorch.py","file_url":"https://github.com/halixness/generative_timesformer_pytorch/blob/HEAD/timesformer_pytorch/timesformer_pytorch.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"9e6eb12055d4b5db"}},{"code_sha256_prefix":"2125f85e76f4efc7","entry":"AxialRotaryEmbedding","repo":"lucidrains/TimeSformer-pytorch","repo_kind":"listed","path":"timesformer_pytorch/timesformer_pytorch.py","file_url":"https://github.com/lucidrains/TimeSformer-pytorch/blob/HEAD/timesformer_pytorch/timesformer_pytorch.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"2125f85e76f4efc7"}},{"code_sha256_prefix":"3c436600aed6654a","entry":"Decoder","repo":"jerrywn121/TianChi_AIEarth","repo_kind":"listed","path":"STTransformer/transformer.py","file_url":"https://github.com/jerrywn121/TianChi_AIEarth/blob/HEAD/STTransformer/transformer.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"3c436600aed6654a"}},{"code_sha256_prefix":"1879ef86738392c0","entry":"DecoderLayer","repo":"jerrywn121/TianChi_AIEarth","repo_kind":"listed","path":"STTransformer/transformer.py","file_url":"https://github.com/jerrywn121/TianChi_AIEarth/blob/HEAD/STTransformer/transformer.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"1879ef86738392c0"}},{"code_sha256_prefix":"070741108b175c8f","entry":"Encoder","repo":"jerrywn121/TianChi_AIEarth","repo_kind":"listed","path":"STTransformer/transformer.py","file_url":"https://github.com/jerrywn121/TianChi_AIEarth/blob/HEAD/STTransformer/transformer.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"070741108b175c8f"}},{"code_sha256_prefix":"38ab040cbcf984b8","entry":"EncoderLayer","repo":"jerrywn121/TianChi_AIEarth","repo_kind":"listed","path":"STTransformer/transformer.py","file_url":"https://github.com/jerrywn121/TianChi_AIEarth/blob/HEAD/STTransformer/transformer.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"38ab040cbcf984b8"}},{"code_sha256_prefix":"0183b5f0d306482f","entry":"FeedForward","repo":"lucidrains/TimeSformer-pytorch","repo_kind":"listed","path":"timesformer_pytorch/timesformer_pytorch.py","file_url":"https://github.com/lucidrains/TimeSformer-pytorch/blob/HEAD/timesformer_pytorch/timesformer_pytorch.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"0183b5f0d306482f"}},{"code_sha256_prefix":"384419959d31762c","entry":"GEGLU","repo":"lucidrains/TimeSformer-pytorch","repo_kind":"listed","path":"timesformer_pytorch/timesformer_pytorch.py","file_url":"https://github.com/lucidrains/TimeSformer-pytorch/blob/HEAD/timesformer_pytorch/timesformer_pytorch.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"384419959d31762c"}},{"code_sha256_prefix":"409ab4896697a02f","entry":"Mlp","repo":"m-bain/video-transformers","repo_kind":"listed","path":"video-transformers/timesformer.py","file_url":"https://github.com/m-bain/video-transformers/blob/HEAD/video-transformers/timesformer.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"409ab4896697a02f"}},{"code_sha256_prefix":"bb5aa1cbee56c9d7","entry":"MultiHeadedAttention","repo":"jerrywn121/TianChi_AIEarth","repo_kind":"listed","path":"STTransformer/transformer.py","file_url":"https://github.com/jerrywn121/TianChi_AIEarth/blob/HEAD/STTransformer/transformer.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"bb5aa1cbee56c9d7"}},{"code_sha256_prefix":"8bb9d8688ba435cf","entry":"PreNorm","repo":"lucidrains/TimeSformer-pytorch","repo_kind":"listed","path":"timesformer_pytorch/timesformer_pytorch.py","file_url":"https://github.com/lucidrains/TimeSformer-pytorch/blob/HEAD/timesformer_pytorch/timesformer_pytorch.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"8bb9d8688ba435cf"}},{"code_sha256_prefix":"42b61b5b4f622a76","entry":"PreTokenShift","repo":"lucidrains/TimeSformer-pytorch","repo_kind":"listed","path":"timesformer_pytorch/timesformer_pytorch.py","file_url":"https://github.com/lucidrains/TimeSformer-pytorch/blob/HEAD/timesformer_pytorch/timesformer_pytorch.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"42b61b5b4f622a76"}},{"code_sha256_prefix":"4e0216fcf6abef9d","entry":"RotaryEmbedding","repo":"lucidrains/TimeSformer-pytorch","repo_kind":"listed","path":"timesformer_pytorch/timesformer_pytorch.py","file_url":"https://github.com/lucidrains/TimeSformer-pytorch/blob/HEAD/timesformer_pytorch/timesformer_pytorch.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"well_formed","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"4e0216fcf6abef9d"}},{"code_sha256_prefix":"cf33bd73aa85bae0","entry":"SpaceAttention","repo":"jerrywn121/TianChi_AIEarth","repo_kind":"listed","path":"STTransformer/transformer.py","file_url":"https://github.com/jerrywn121/TianChi_AIEarth/blob/HEAD/STTransformer/transformer.py","link_basis":"first_harvest_node","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"cf33bd73aa85bae0"}},{"code_sha256_prefix":"6ed6a97e76e9e405","entry":"SpacetimeMHSA","repo":"The-AI-Summer/self-attention-cv","repo_kind":"listed","path":"self_attention_cv/timesformer/timesformer.py","file_url":"https://github.com/The-AI-Summer/self-attention-cv/blob/HEAD/self_attention_cv/timesformer/timesformer.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"6ed6a97e76e9e405"}},{"code_sha256_prefix":"2c2573860f1078bc","entry":"SublayerConnection","repo":"jerrywn121/TianChi_AIEarth","repo_kind":"listed","path":"STTransformer/transformer.py","file_url":"https://github.com/jerrywn121/TianChi_AIEarth/blob/HEAD/STTransformer/transformer.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"2c2573860f1078bc"}},{"code_sha256_prefix":"0f190b82b567601a","entry":"TimeAttention","repo":"jerrywn121/TianChi_AIEarth","repo_kind":"listed","path":"STTransformer/transformer.py","file_url":"https://github.com/jerrywn121/TianChi_AIEarth/blob/HEAD/STTransformer/transformer.py","link_basis":"first_harvest_node","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"0f190b82b567601a"}},{"code_sha256_prefix":"1e12db9a2b6a6d61","entry":"TimeSformer","repo":"halixness/generative_timesformer_pytorch","repo_kind":"listed","path":"timesformer_pytorch/timesformer_pytorch.py","file_url":"https://github.com/halixness/generative_timesformer_pytorch/blob/HEAD/timesformer_pytorch/timesformer_pytorch.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"1e12db9a2b6a6d61"}},{"code_sha256_prefix":"b5fc28091e91cbe9","entry":"TimeSformerBlock","repo":"The-AI-Summer/self-attention-cv","repo_kind":"listed","path":"self_attention_cv/timesformer/timesformer.py","file_url":"https://github.com/The-AI-Summer/self-attention-cv/blob/HEAD/self_attention_cv/timesformer/timesformer.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"b5fc28091e91cbe9"}},{"code_sha256_prefix":"90617d5175fc43de","entry":"VarAttention","repo":"m-bain/video-transformers","repo_kind":"listed","path":"video-transformers/timesformer.py","file_url":"https://github.com/m-bain/video-transformers/blob/HEAD/video-transformers/timesformer.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"90617d5175fc43de"}},{"code_sha256_prefix":"02e3cffeb7724448","entry":"VideoPatchEmbed","repo":"m-bain/video-transformers","repo_kind":"listed","path":"video-transformers/timesformer.py","file_url":"https://github.com/m-bain/video-transformers/blob/HEAD/video-transformers/timesformer.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"02e3cffeb7724448"}},{"code_sha256_prefix":"b47a2562da71bf81","entry":"apply_rot_emb","repo":"lucidrains/TimeSformer-pytorch","repo_kind":"listed","path":"timesformer_pytorch/timesformer_pytorch.py","file_url":"https://github.com/lucidrains/TimeSformer-pytorch/blob/HEAD/timesformer_pytorch/timesformer_pytorch.py","link_basis":"first_harvest_node","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":"invariant","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"b47a2562da71bf81"}},{"code_sha256_prefix":"5d2b139fbe3e2fe5","entry":"attn","repo":"lucidrains/TimeSformer-pytorch","repo_kind":"listed","path":"timesformer_pytorch/timesformer_pytorch.py","file_url":"https://github.com/lucidrains/TimeSformer-pytorch/blob/HEAD/timesformer_pytorch/timesformer_pytorch.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":"invariant","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"5d2b139fbe3e2fe5"}},{"code_sha256_prefix":"c9b2023a8e7f543b","entry":"attn","repo":"halixness/generative_timesformer_pytorch","repo_kind":"listed","path":"timesformer_pytorch/timesformer_pytorch.py","file_url":"https://github.com/halixness/generative_timesformer_pytorch/blob/HEAD/timesformer_pytorch/timesformer_pytorch.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"c9b2023a8e7f543b"}},{"code_sha256_prefix":"aa5486a3650902d8","entry":"exists","repo":null,"repo_kind":null,"path":null,"file_url":null,"link_basis":"identical_code_first_harvested_elsewhere","language":"python","status":"ran_violates","verification_level":1,"contract_check":"VIOLATES","metamorphic_tier":"deterministic","behaviour_fingerprint":true,"licence":null,"inline_ok":false,"mcp_get_code":{"code_sha256":"aa5486a3650902d8"}},{"code_sha256_prefix":"382b7426a720dd16","entry":"fold_tensor","repo":"jerrywn121/TianChi_AIEarth","repo_kind":"listed","path":"STTransformer/transformer.py","file_url":"https://github.com/jerrywn121/TianChi_AIEarth/blob/HEAD/STTransformer/transformer.py","link_basis":"first_harvest_node","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"382b7426a720dd16"}},{"code_sha256_prefix":"d1d6c81b2e101027","entry":"input_embedding","repo":"jerrywn121/TianChi_AIEarth","repo_kind":"listed","path":"STTransformer/transformer.py","file_url":"https://github.com/jerrywn121/TianChi_AIEarth/blob/HEAD/STTransformer/transformer.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"d1d6c81b2e101027"}},{"code_sha256_prefix":"d153fd18d2c78fd5","entry":"merge_timespace","repo":"The-AI-Summer/self-attention-cv","repo_kind":"listed","path":"self_attention_cv/timesformer/timesformer.py","file_url":"https://github.com/The-AI-Summer/self-attention-cv/blob/HEAD/self_attention_cv/timesformer/timesformer.py","link_basis":"first_harvest_node","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"d153fd18d2c78fd5"}},{"code_sha256_prefix":"3b4883ee8560ec7c","entry":"project_vk_linformer","repo":"The-AI-Summer/self-attention-cv","repo_kind":"listed","path":"self_attention_cv/timesformer/timesformer.py","file_url":"https://github.com/The-AI-Summer/self-attention-cv/blob/HEAD/self_attention_cv/timesformer/timesformer.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"3b4883ee8560ec7c"}},{"code_sha256_prefix":"07e3c5417d5f77fc","entry":"rotate_every_two","repo":"lucidrains/TimeSformer-pytorch","repo_kind":"listed","path":"timesformer_pytorch/timesformer_pytorch.py","file_url":"https://github.com/lucidrains/TimeSformer-pytorch/blob/HEAD/timesformer_pytorch/timesformer_pytorch.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"07e3c5417d5f77fc"}},{"code_sha256_prefix":"f6e07e75149898e3","entry":"shift","repo":"lucidrains/TimeSformer-pytorch","repo_kind":"listed","path":"timesformer_pytorch/timesformer_pytorch.py","file_url":"https://github.com/lucidrains/TimeSformer-pytorch/blob/HEAD/timesformer_pytorch/timesformer_pytorch.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"f6e07e75149898e3"}},{"code_sha256_prefix":"214635d3580c503e","entry":"space_att_rearrange","repo":"The-AI-Summer/self-attention-cv","repo_kind":"listed","path":"self_attention_cv/timesformer/timesformer.py","file_url":"https://github.com/The-AI-Summer/self-attention-cv/blob/HEAD/self_attention_cv/timesformer/timesformer.py","link_basis":"first_harvest_node","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"214635d3580c503e"}},{"code_sha256_prefix":"43ee896c0cb92a0e","entry":"split_cls","repo":"The-AI-Summer/self-attention-cv","repo_kind":"listed","path":"self_attention_cv/timesformer/timesformer.py","file_url":"https://github.com/The-AI-Summer/self-attention-cv/blob/HEAD/self_attention_cv/timesformer/timesformer.py","link_basis":"first_harvest_node","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":"deterministic","behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"43ee896c0cb92a0e"}},{"code_sha256_prefix":"2349364a5be28b97","entry":"time_att_rearrange","repo":"The-AI-Summer/self-attention-cv","repo_kind":"listed","path":"self_attention_cv/timesformer/timesformer.py","file_url":"https://github.com/The-AI-Summer/self-attention-cv/blob/HEAD/self_attention_cv/timesformer/timesformer.py","link_basis":"first_harvest_node","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"2349364a5be28b97"}},{"code_sha256_prefix":"5eee191e9a7fe18e","entry":"unfold_StackOverChannel","repo":"jerrywn121/TianChi_AIEarth","repo_kind":"listed","path":"STTransformer/transformer.py","file_url":"https://github.com/jerrywn121/TianChi_AIEarth/blob/HEAD/STTransformer/transformer.py","link_basis":"first_harvest_node","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"5eee191e9a7fe18e"}},{"code_sha256_prefix":"f7e0694aefe90304","entry":"Attention","repo":"lucidrains/TimeSformer-pytorch","repo_kind":"listed","path":"timesformer_pytorch/timesformer_pytorch.py","file_url":"https://github.com/lucidrains/TimeSformer-pytorch/blob/HEAD/timesformer_pytorch/timesformer_pytorch.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"f7e0694aefe90304"}},{"code_sha256_prefix":"2af0e5fbba35a2f7","entry":"SpaceTimeBlock","repo":"m-bain/video-transformers","repo_kind":"listed","path":"video-transformers/timesformer.py","file_url":"https://github.com/m-bain/video-transformers/blob/HEAD/video-transformers/timesformer.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"2af0e5fbba35a2f7"}},{"code_sha256_prefix":"9323660c90d8a3a4","entry":"SpaceTimeTransformer","repo":"jerrywn121/TianChi_AIEarth","repo_kind":"listed","path":"STTransformer/transformer.py","file_url":"https://github.com/jerrywn121/TianChi_AIEarth/blob/HEAD/STTransformer/transformer.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"9323660c90d8a3a4"}},{"code_sha256_prefix":"1c93e555127bcf25","entry":"TimeSformer","repo":"lucidrains/TimeSformer-pytorch","repo_kind":"listed","path":"timesformer_pytorch/timesformer_pytorch.py","file_url":"https://github.com/lucidrains/TimeSformer-pytorch/blob/HEAD/timesformer_pytorch/timesformer_pytorch.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"1c93e555127bcf25"}},{"code_sha256_prefix":"cc63279ce5b42414","entry":"Timesformer","repo":"The-AI-Summer/self-attention-cv","repo_kind":"listed","path":"self_attention_cv/timesformer/timesformer.py","file_url":"https://github.com/The-AI-Summer/self-attention-cv/blob/HEAD/self_attention_cv/timesformer/timesformer.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"cc63279ce5b42414"}},{"code_sha256_prefix":"9ad394810b771a6b","entry":"Timesformer","repo":"m-bain/video-transformers","repo_kind":"listed","path":"video-transformers/timesformer.py","file_url":"https://github.com/m-bain/video-transformers/blob/HEAD/video-transformers/timesformer.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"9ad394810b771a6b"}},{"code_sha256_prefix":"e29cd379b8279b38","entry":"compute_mhsa","repo":"The-AI-Summer/self-attention-cv","repo_kind":"listed","path":"self_attention_cv/timesformer/timesformer.py","file_url":"https://github.com/The-AI-Summer/self-attention-cv/blob/HEAD/self_attention_cv/timesformer/timesformer.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"e29cd379b8279b38"}},{"code_sha256_prefix":"7c6f43d2449917c6","entry":"get_frames","repo":"yiyixuxu/TimeSformer-rolled-attention","repo_kind":"listed","path":"visualize_attn_util.py","file_url":"https://github.com/yiyixuxu/TimeSformer-rolled-attention/blob/HEAD/visualize_attn_util.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"7c6f43d2449917c6"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}