{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/pyramid-vision-transformer-a-versatile","title":"Pyramid Vision Transformer: A Versatile Backbone for Dense Prediction without Convolutions","arxiv_id":"2102.12122","date":"2021-02-24","proceeding":"ICCV 2021 10","authors":["Wenhai Wang","Enze Xie","Xiang Li","Deng-Ping Fan","Kaitao Song","Ding Liang","Tong Lu","Ping Luo","Ling Shao"],"abstract":"Although using convolutional neural networks (CNNs) as backbones achieves great successes in computer vision, this work investigates a simple backbone network useful for many dense prediction tasks without convolutions. Unlike the recently-proposed Transformer model (e.g., ViT) that is specially designed for image classification, we propose Pyramid Vision Transformer~(PVT), which overcomes the difficulties of porting Transformer to various dense prediction tasks. PVT has several merits compared to prior arts. (1) Different from ViT that typically has low-resolution outputs and high computational and memory cost, PVT can be not only trained on dense partitions of the image to achieve high output resolution, which is important for dense predictions but also using a progressive shrinking pyramid to reduce computations of large feature maps. (2) PVT inherits the advantages from both CNN and Transformer, making it a unified backbone in various vision tasks without convolutions by simply replacing CNN backbones. (3) We validate PVT by conducting extensive experiments, showing that it boosts the performance of many downstream tasks, e.g., object detection, semantic, and instance segmentation. For example, with a comparable number of parameters, RetinaNet+PVT achieves 40.4 AP on the COCO dataset, surpassing RetinNet+ResNet50 (36.3 AP) by 4.1 absolute AP. We hope PVT could serve as an alternative and useful backbone for pixel-level predictions and facilitate future researches. Code is available at https://github.com/whai362/PVT.","url_abs":"https://arxiv.org/abs/2102.12122v2","url_pdf":"https://arxiv.org/pdf/2102.12122v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"pyramid-vision-transformer-a-versatile","repo_url":"https://github.com/whai362/PVT","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":null},{"paper_slug":"pyramid-vision-transformer-a-versatile","repo_url":"https://github.com/DarshanDeshpande/jax-models","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"jax","reach":null},{"paper_slug":"pyramid-vision-transformer-a-versatile","repo_url":"https://github.com/SforAiDl/vformer","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":null},{"paper_slug":"pyramid-vision-transformer-a-versatile","repo_url":"https://github.com/hustvl/sparseinst","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}},{"paper_slug":"pyramid-vision-transformer-a-versatile","repo_url":"https://github.com/martinsbruveris/tensorflow-image-models","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"tf","reach":null},{"paper_slug":"pyramid-vision-transformer-a-versatile","repo_url":"https://github.com/microsoft/vision-longformer","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":null},{"paper_slug":"pyramid-vision-transformer-a-versatile","repo_url":"https://github.com/open-mmlab/mmpose","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"Apache-2.0"}},{"paper_slug":"pyramid-vision-transformer-a-versatile","repo_url":"https://github.com/wangermeng2021/PVT-tensorflow2","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"tf","reach":{"status":"unanswered"}},{"paper_slug":"pyramid-vision-transformer-a-versatile","repo_url":"https://github.com/xiaohu2015/pvt_detectron2","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}},{"paper_slug":"pyramid-vision-transformer-a-versatile","repo_url":"https://github.com/open-mmlab/mmdetection","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"pytorch","reach":{"status":"ok","spdx":"Apache-2.0"}},{"paper_slug":"pyramid-vision-transformer-a-versatile","repo_url":"https://gitlab.com/birder/birder","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"pytorch","reach":null}],"tasks":[{"task_slug":"image-classification","task_name":"Image Classification"},{"task_slug":"instance-segmentation","task_name":"Instance Segmentation"},{"task_slug":"object-detection","task_name":"Object Detection"},{"task_slug":"semantic-segmentation","task_name":"Semantic Segmentation"},{"task_slug":"image-classification","task_name":"image-classification"},{"task_slug":"object-detection-1","task_name":"object-detection"}],"methods":[{"method_slug":"absolute-position-encodings","method_name":"Absolute Position Encodings"},{"method_slug":"adam","method_name":"Adam"},{"method_slug":"attention","method_name":"Attention"},{"method_slug":"bpe","method_name":"BPE"},{"method_slug":"dense-connections","method_name":"Dense Connections"},{"method_slug":"dropout","method_name":"Dropout"},{"method_slug":"label-smoothing","method_name":"Label Smoothing"},{"method_slug":"layer-normalization","method_name":"Layer Normalization"},{"method_slug":"linear-layer","method_name":"Linear Layer"},{"method_slug":"multi-head-attention","method_name":"Multi-Head Attention"},{"method_slug":"pvt","method_name":"PVT"},{"method_slug":"position-wise-feed-forward-layer","method_name":"Position-Wise Feed-Forward Layer"},{"method_slug":"residual-connection","method_name":"Residual Connection"},{"method_slug":"softmax","method_name":"Softmax"},{"method_slug":"spatial-reduction-attention","method_name":"Spatial-Reduction Attention"},{"method_slug":"transformer","method_name":"Transformer"}],"datasets_introduced":[],"methods_introduced":[{"slug":"spatial-reduction-attention","name":"Spatial-Reduction Attention","full_name":"Spatial-Reduction Attention"}],"results":[{"leaderboard":"/sota/object-detection-on-coco-minival","task":"Object Detection","dataset":"COCO minival","model":"PVT-Large (RetinaNet 3x,MS)","rank_in_archive_order":140,"of":220,"metrics":{"AP50":"63.6","AP75":"46.1","APL":"59.5","APM":"46.0","APS":"26.1","box AP":"43.4"},"uses_additional_data":false},{"leaderboard":"/sota/object-detection-on-coco-minival","task":"Object Detection","dataset":"COCO minival","model":"PVT-Large (RetinaNet 1x)","rank_in_archive_order":151,"of":220,"metrics":{"AP50":"63.7","AP75":"45.4","APL":"58.4","APM":"46.0","APS":"25.8","box AP":"42.6"},"uses_additional_data":false},{"leaderboard":"/sota/semantic-segmentation-on-densepass","task":"Semantic Segmentation","dataset":"DensePASS","model":"PVT (Tiny, FPN)","rank_in_archive_order":26,"of":36,"metrics":{"mIoU":"31.20%"},"uses_additional_data":false},{"leaderboard":"/sota/semantic-segmentation-on-synpass","task":"Semantic Segmentation","dataset":"SynPASS","model":"PVT","rank_in_archive_order":4,"of":6,"metrics":{"mIoU":"32.68%"},"uses_additional_data":false}],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2102.12122","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2102.12122"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/xiaohu2015/pvt_detectron2","reach":{"status":"ok","spdx":"MIT"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/open-mmlab/mmpose","reach":{"status":"ok","spdx":"Apache-2.0"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/open-mmlab/mmdetection","reach":{"status":"ok","spdx":"Apache-2.0"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/martinsbruveris/tensorflow-image-models","reach":null},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://gitlab.com/birder/birder","reach":null},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/microsoft/vision-longformer","reach":null},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/DarshanDeshpande/jax-models","reach":null},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/hustvl/sparseinst","reach":{"status":"ok","spdx":"MIT"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/whai362/PVT","reach":null},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/wangermeng2021/PVT-tensorflow2","reach":{"status":"unanswered"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/SforAiDl/vformer","reach":null}],"summary":{"ran":16,"ran_draft_wrong":4,"ran_honours":2,"unverified":8},"by_repo_kind":{"official":{"samples":4,"ran":4,"repositories":1},"listed":{"samples":25,"ran":17,"repositories":2}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":1,"samples":[{"code_sha256_prefix":"4e79665da13fed0d","entry":"AdaptiveAveragePool2D","repo":"DarshanDeshpande/jax-models","repo_kind":"listed","path":"jax_models/models/pvit.py","file_url":"https://github.com/DarshanDeshpande/jax-models/blob/HEAD/jax_models/models/pvit.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"4e79665da13fed0d"}},{"code_sha256_prefix":"07fdb7e2bfa01afa","entry":"Attention","repo":"DarshanDeshpande/jax-models","repo_kind":"listed","path":"jax_models/models/pvit.py","file_url":"https://github.com/DarshanDeshpande/jax-models/blob/HEAD/jax_models/models/pvit.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"07fdb7e2bfa01afa"}},{"code_sha256_prefix":"5dada1aeda7932eb","entry":"Attention","repo":"whai362/PVT","repo_kind":"official","path":"classification/pvt.py","file_url":"https://github.com/whai362/PVT/blob/HEAD/classification/pvt.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"5dada1aeda7932eb"}},{"code_sha256_prefix":"592e8438de425b53","entry":"Attention","repo":"microsoft/vision-longformer","repo_kind":"listed","path":"src/models/msvit.py","file_url":"https://github.com/microsoft/vision-longformer/blob/HEAD/src/models/msvit.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"592e8438de425b53"}},{"code_sha256_prefix":"583eadd9a5e6a087","entry":"Block","repo":"whai362/PVT","repo_kind":"official","path":"classification/pvt.py","file_url":"https://github.com/whai362/PVT/blob/HEAD/classification/pvt.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"583eadd9a5e6a087"}},{"code_sha256_prefix":"f523e66d872044ea","entry":"DepthwiseConv2D","repo":"DarshanDeshpande/jax-models","repo_kind":"listed","path":"jax_models/models/pvit.py","file_url":"https://github.com/DarshanDeshpande/jax-models/blob/HEAD/jax_models/models/pvit.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"f523e66d872044ea"}},{"code_sha256_prefix":"da55353e88022d26","entry":"FastAttention","repo":"microsoft/vision-longformer","repo_kind":"listed","path":"src/models/msvit.py","file_url":"https://github.com/microsoft/vision-longformer/blob/HEAD/src/models/msvit.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"da55353e88022d26"}},{"code_sha256_prefix":"6ba11adb4f98f7ff","entry":"LinformerSelfAttention","repo":"microsoft/vision-longformer","repo_kind":"listed","path":"src/models/msvit.py","file_url":"https://github.com/microsoft/vision-longformer/blob/HEAD/src/models/msvit.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"6ba11adb4f98f7ff"}},{"code_sha256_prefix":"0440cd3acf07c3c4","entry":"MlpBlock","repo":"microsoft/vision-longformer","repo_kind":"listed","path":"src/models/msvit.py","file_url":"https://github.com/microsoft/vision-longformer/blob/HEAD/src/models/msvit.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"0440cd3acf07c3c4"}},{"code_sha256_prefix":"df41558bed765430","entry":"OverlapPatchEmbed","repo":"DarshanDeshpande/jax-models","repo_kind":"listed","path":"jax_models/models/pvit.py","file_url":"https://github.com/DarshanDeshpande/jax-models/blob/HEAD/jax_models/models/pvit.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"df41558bed765430"}},{"code_sha256_prefix":"916b4f73572180ec","entry":"PatchEmbed","repo":"whai362/PVT","repo_kind":"official","path":"classification/pvt.py","file_url":"https://github.com/whai362/PVT/blob/HEAD/classification/pvt.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"916b4f73572180ec"}},{"code_sha256_prefix":"b8071a3c02db7b92","entry":"PatchEmbed","repo":"microsoft/vision-longformer","repo_kind":"listed","path":"src/models/msvit.py","file_url":"https://github.com/microsoft/vision-longformer/blob/HEAD/src/models/msvit.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"b8071a3c02db7b92"}},{"code_sha256_prefix":"c69b1b1a3052ca98","entry":"PyramidVisionTransformer","repo":"whai362/PVT","repo_kind":"official","path":"classification/pvt.py","file_url":"https://github.com/whai362/PVT/blob/HEAD/classification/pvt.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"c69b1b1a3052ca98"}},{"code_sha256_prefix":"e41b50defb828842","entry":"SRSelfAttention","repo":"microsoft/vision-longformer","repo_kind":"listed","path":"src/models/msvit.py","file_url":"https://github.com/microsoft/vision-longformer/blob/HEAD/src/models/msvit.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"e41b50defb828842"}},{"code_sha256_prefix":"46bc17ff8a5ba939","entry":"SlidingChunk2D","repo":"microsoft/vision-longformer","repo_kind":"listed","path":"src/models/msvit.py","file_url":"https://github.com/microsoft/vision-longformer/blob/HEAD/src/models/msvit.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"46bc17ff8a5ba939"}},{"code_sha256_prefix":"374179113e51b201","entry":"TransformerMLP","repo":"DarshanDeshpande/jax-models","repo_kind":"listed","path":"jax_models/models/pvit.py","file_url":"https://github.com/DarshanDeshpande/jax-models/blob/HEAD/jax_models/models/pvit.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"374179113e51b201"}},{"code_sha256_prefix":"9e88f2b66f738494","entry":"_get_invalid_locations_mask_cyclic","repo":"microsoft/vision-longformer","repo_kind":"listed","path":"src/models/msvit.py","file_url":"https://github.com/microsoft/vision-longformer/blob/HEAD/src/models/msvit.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"9e88f2b66f738494"}},{"code_sha256_prefix":"813948d3f352d1c6","entry":"_get_invalid_locations_mask_exact","repo":"microsoft/vision-longformer","repo_kind":"listed","path":"src/models/msvit.py","file_url":"https://github.com/microsoft/vision-longformer/blob/HEAD/src/models/msvit.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"813948d3f352d1c6"}},{"code_sha256_prefix":"f48afe5b9c50d66c","entry":"_get_invalid_locations_mask_zero","repo":"microsoft/vision-longformer","repo_kind":"listed","path":"src/models/msvit.py","file_url":"https://github.com/microsoft/vision-longformer/blob/HEAD/src/models/msvit.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"f48afe5b9c50d66c"}},{"code_sha256_prefix":"1652fbb1719cc1b4","entry":"gaussian_orthogonal_random_matrix","repo":"microsoft/vision-longformer","repo_kind":"listed","path":"src/models/msvit.py","file_url":"https://github.com/microsoft/vision-longformer/blob/HEAD/src/models/msvit.py","link_basis":"first_harvest_node","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"1652fbb1719cc1b4"}},{"code_sha256_prefix":"3444251df88e6169","entry":"init_","repo":null,"repo_kind":null,"path":null,"file_url":null,"link_basis":"identical_code_first_harvested_elsewhere","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":null,"inline_ok":false,"mcp_get_code":{"code_sha256":"3444251df88e6169"}},{"code_sha256_prefix":"757aee54843af070","entry":"softmax_kernel","repo":"microsoft/vision-longformer","repo_kind":"listed","path":"src/models/msvit.py","file_url":"https://github.com/microsoft/vision-longformer/blob/HEAD/src/models/msvit.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"757aee54843af070"}},{"code_sha256_prefix":"2de4320db751601f","entry":"AttnBlock","repo":"microsoft/vision-longformer","repo_kind":"listed","path":"src/models/msvit.py","file_url":"https://github.com/microsoft/vision-longformer/blob/HEAD/src/models/msvit.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"2de4320db751601f"}},{"code_sha256_prefix":"3ec0d795856d98f3","entry":"Block","repo":"DarshanDeshpande/jax-models","repo_kind":"listed","path":"jax_models/models/pvit.py","file_url":"https://github.com/DarshanDeshpande/jax-models/blob/HEAD/jax_models/models/pvit.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"3ec0d795856d98f3"}},{"code_sha256_prefix":"c7c2414a1044ea7d","entry":"Long2DSCSelfAttention","repo":"microsoft/vision-longformer","repo_kind":"listed","path":"src/models/msvit.py","file_url":"https://github.com/microsoft/vision-longformer/blob/HEAD/src/models/msvit.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"c7c2414a1044ea7d"}},{"code_sha256_prefix":"380e07f5bfb682af","entry":"MsViT","repo":"microsoft/vision-longformer","repo_kind":"listed","path":"src/models/msvit.py","file_url":"https://github.com/microsoft/vision-longformer/blob/HEAD/src/models/msvit.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"380e07f5bfb682af"}},{"code_sha256_prefix":"53e595a68e74e8a6","entry":"PerformerSelfAttention","repo":"microsoft/vision-longformer","repo_kind":"listed","path":"src/models/msvit.py","file_url":"https://github.com/microsoft/vision-longformer/blob/HEAD/src/models/msvit.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"53e595a68e74e8a6"}},{"code_sha256_prefix":"5fad6fb95a0d420f","entry":"PyramidViT","repo":"DarshanDeshpande/jax-models","repo_kind":"listed","path":"jax_models/models/pvit.py","file_url":"https://github.com/DarshanDeshpande/jax-models/blob/HEAD/jax_models/models/pvit.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"5fad6fb95a0d420f"}},{"code_sha256_prefix":"b7a2d11b74ff36f6","entry":"mask_invalid_locations","repo":"microsoft/vision-longformer","repo_kind":"listed","path":"src/models/msvit.py","file_url":"https://github.com/microsoft/vision-longformer/blob/HEAD/src/models/msvit.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"b7a2d11b74ff36f6"}},{"code_sha256_prefix":"56b6ba9dcdd328f4","entry":"slidingchunk_2dautograd","repo":"microsoft/vision-longformer","repo_kind":"listed","path":"src/models/msvit.py","file_url":"https://github.com/microsoft/vision-longformer/blob/HEAD/src/models/msvit.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"56b6ba9dcdd328f4"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}