{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/gpipe-efficient-training-of-giant-neural","title":"GPipe: Efficient Training of Giant Neural Networks using Pipeline Parallelism","arxiv_id":"1811.06965","date":"2018-11-16","proceeding":"NeurIPS 2019 12","authors":["Yanping Huang","Youlong Cheng","Ankur Bapna","Orhan Firat","Mia Xu Chen","Dehao Chen","HyoukJoong Lee","Jiquan Ngiam","Quoc V. Le","Yonghui Wu","Zhifeng Chen"],"abstract":"Scaling up deep neural network capacity has been known as an effective approach to improving model quality for several different machine learning tasks. In many cases, increasing model capacity beyond the memory limit of a single accelerator has required developing special algorithms or infrastructure. These solutions are often architecture-specific and do not transfer to other tasks. To address the need for efficient and task-independent model parallelism, we introduce GPipe, a pipeline parallelism library that allows scaling any network that can be expressed as a sequence of layers. By pipelining different sub-sequences of layers on separate accelerators, GPipe provides the flexibility of scaling a variety of different networks to gigantic sizes efficiently. Moreover, GPipe utilizes a novel batch-splitting pipelining algorithm, resulting in almost linear speedup when a model is partitioned across multiple accelerators. We demonstrate the advantages of GPipe by training large-scale neural networks on two different tasks with distinct network architectures: (i) Image Classification: We train a 557-million-parameter AmoebaNet model and attain a top-1 accuracy of 84.4% on ImageNet-2012, (ii) Multilingual Neural Machine Translation: We train a single 6-billion-parameter, 128-layer Transformer model on a corpus spanning over 100 languages and achieve better quality than all bilingual models.","url_abs":"https://arxiv.org/abs/1811.06965v5","url_pdf":"https://arxiv.org/pdf/1811.06965v5.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"gpipe-efficient-training-of-giant-neural","repo_url":"https://github.com/KakaoBrain/torchgpipe","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"BSD-3-Clause"}},{"paper_slug":"gpipe-efficient-training-of-giant-neural","repo_url":"https://github.com/ViswanathaReddyGajjala/EfficientNet-RetinaNet","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok"}},{"paper_slug":"gpipe-efficient-training-of-giant-neural","repo_url":"https://github.com/alondj/Pytorch-Gpipe","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":null},{"paper_slug":"gpipe-efficient-training-of-giant-neural","repo_url":"https://github.com/northeastsquare/effficientnet","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"tf","reach":{"status":"ok"}},{"paper_slug":"gpipe-efficient-training-of-giant-neural","repo_url":"https://github.com/pikkaay/efficientnet_gpu","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"tf","reach":{"status":"ok"}},{"paper_slug":"gpipe-efficient-training-of-giant-neural","repo_url":"https://github.com/pytorch/pippy","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"BSD-3-Clause"}},{"paper_slug":"gpipe-efficient-training-of-giant-neural","repo_url":"https://github.com/pytorch/tau","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"BSD-3-Clause"}},{"paper_slug":"gpipe-efficient-training-of-giant-neural","repo_url":"https://github.com/qubvel/efficientnet","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"tf","reach":{"status":"ok","spdx":"Apache-2.0"}},{"paper_slug":"gpipe-efficient-training-of-giant-neural","repo_url":"https://github.com/shijianjian/efficientnet-pytorch-3d","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":null},{"paper_slug":"gpipe-efficient-training-of-giant-neural","repo_url":"https://github.com/xslidi/EfficientNets_ddl_apex","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":null},{"paper_slug":"gpipe-efficient-training-of-giant-neural","repo_url":"https://github.com/yakhyo/EfficientNet-PyTorch","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok"}},{"paper_slug":"gpipe-efficient-training-of-giant-neural","repo_url":"https://github.com/PaddlePaddle/FleetX/tree/develop/examples/pipeline","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"paddle","reach":null},{"paper_slug":"gpipe-efficient-training-of-giant-neural","repo_url":"https://github.com/tensorflow/lingvo","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"tf","reach":{"status":"ok","spdx":"Apache-2.0"}}],"tasks":[{"task_slug":"fine-grained-image-classification","task_name":"Fine-Grained Image Classification"},{"task_slug":"image-classification","task_name":"Image Classification"},{"task_slug":"machine-translation","task_name":"Machine Translation"},{"task_slug":"translation","task_name":"Translation"},{"task_slug":"image-classification","task_name":"image-classification"}],"methods":[{"method_slug":"absolute-position-encodings","method_name":"Absolute Position Encodings"},{"method_slug":"adam","method_name":"Adam"},{"method_slug":"amoebanet","method_name":"AmoebaNet"},{"method_slug":"attention","method_name":"Attention"},{"method_slug":"average-pooling","method_name":"Average Pooling"},{"method_slug":"bpe","method_name":"BPE"},{"method_slug":"convolution","method_name":"Convolution"},{"method_slug":"dense-connections","method_name":"Dense Connections"},{"method_slug":"dropout","method_name":"Dropout"},{"method_slug":"gpipe","method_name":"GPipe"},{"method_slug":"label-smoothing","method_name":"Label Smoothing"},{"method_slug":"layer-normalization","method_name":"Layer Normalization"},{"method_slug":"linear-layer","method_name":"Linear Layer"},{"method_slug":"max-pooling","method_name":"Max Pooling"},{"method_slug":"multi-head-attention","method_name":"Multi-Head Attention"},{"method_slug":"position-wise-feed-forward-layer","method_name":"Position-Wise Feed-Forward Layer"},{"method_slug":"relu","method_name":"ReLU"},{"method_slug":"residual-connection","method_name":"Residual Connection"},{"method_slug":"softmax","method_name":"Softmax"},{"method_slug":"spatially-separable-convolution","method_name":"Spatially Separable Convolution"},{"method_slug":"transformer","method_name":"Transformer"}],"datasets_introduced":[],"methods_introduced":[{"slug":"gpipe","name":"GPipe","full_name":"GPipe"}],"results":[{"leaderboard":"/sota/fine-grained-image-classification-on-birdsnap","task":"Fine-Grained Image Classification","dataset":"Birdsnap","model":"GPIPE","rank_in_archive_order":4,"of":5,"metrics":{"Accuracy":"83.6%"},"uses_additional_data":true},{"leaderboard":"/sota/fine-grained-image-classification-on-stanford","task":"Fine-Grained Image Classification","dataset":"Stanford Cars","model":"GPipe","rank_in_archive_order":37,"of":83,"metrics":{"Accuracy":"94.6%"},"uses_additional_data":false},{"leaderboard":"/sota/image-classification-on-cifar-10","task":"Image Classification","dataset":"CIFAR-10","model":"GPIPE + transfer learning","rank_in_archive_order":21,"of":265,"metrics":{"Percentage correct":"99"},"uses_additional_data":true},{"leaderboard":"/sota/image-classification-on-cifar-100","task":"Image Classification","dataset":"CIFAR-100","model":"GPIPE","rank_in_archive_order":20,"of":211,"metrics":{"Percentage correct":"91.3"},"uses_additional_data":true},{"leaderboard":"/sota/image-classification-on-imagenet","task":"Image Classification","dataset":"ImageNet","model":"GPIPE","rank_in_archive_order":316,"of":1060,"metrics":{"Top 1 Accuracy":"84.4%"},"uses_additional_data":false}],"syntology":{"syntology_url":"https://syntology.ai/paper/1811.06965","atlas_url":"https://app.syntology.ai/?focus=1811.06965","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1811.06965"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-25T09:33:49+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/alondj/Pytorch-Gpipe","reach":null},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/pikkaay/efficientnet_gpu","reach":{"status":"ok"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/qubvel/efficientnet","reach":{"status":"ok","spdx":"Apache-2.0"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/xslidi/EfficientNets_ddl_apex","reach":null},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/KakaoBrain/torchgpipe","reach":{"status":"ok","spdx":"BSD-3-Clause"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/ViswanathaReddyGajjala/EfficientNet-RetinaNet","reach":{"status":"ok"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/northeastsquare/effficientnet","reach":{"status":"ok"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/tensorflow/lingvo","reach":{"status":"ok","spdx":"Apache-2.0"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/PaddlePaddle/FleetX/tree/develop/examples/pipeline","reach":null},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/pytorch/pippy","reach":{"status":"ok","spdx":"BSD-3-Clause"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/shijianjian/efficientnet-pytorch-3d","reach":null},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/yakhyo/EfficientNet-PyTorch","reach":{"status":"ok"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/pytorch/tau","reach":{"status":"ok","spdx":"BSD-3-Clause"}}],"summary":{"ran_draft_wrong":1,"unverified":24},"by_repo_kind":{"listed":{"samples":25,"ran":1,"repositories":3}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":16,"samples":[{"code_sha256_prefix":"effafd8df78cdde1","entry":"alexnet","repo":"alondj/Pytorch-Gpipe","repo_kind":"listed","path":"sample_models/AlexNet.py","file_url":"https://github.com/alondj/Pytorch-Gpipe/blob/HEAD/sample_models/AlexNet.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"effafd8df78cdde1"}},{"code_sha256_prefix":"d621b81113bea659","entry":"create_empty_tensors","repo":"pytorch/pippy","repo_kind":"listed","path":"pippy/ManualPipelineStage.py","file_url":"https://github.com/pytorch/pippy/blob/HEAD/pippy/ManualPipelineStage.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"BSD-3-Clause","inline_ok":false,"mcp_get_code":{"code_sha256":"d621b81113bea659"}},{"code_sha256_prefix":"e442618c006c37cc","entry":"create_metadata_tensor","repo":"pytorch/pippy","repo_kind":"listed","path":"pippy/ManualPipelineStage.py","file_url":"https://github.com/pytorch/pippy/blob/HEAD/pippy/ManualPipelineStage.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"BSD-3-Clause","inline_ok":false,"mcp_get_code":{"code_sha256":"e442618c006c37cc"}},{"code_sha256_prefix":"fb9bebfe8fecba77","entry":"current_stream","repo":"KakaoBrain/torchgpipe","repo_kind":"listed","path":"torchgpipe/stream.py","file_url":"https://github.com/KakaoBrain/torchgpipe/blob/HEAD/torchgpipe/stream.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"BSD-3-Clause","inline_ok":true,"mcp_get_code":{"code_sha256":"fb9bebfe8fecba77"}},{"code_sha256_prefix":"3fb6eb077f80eb2a","entry":"default_stream","repo":"KakaoBrain/torchgpipe","repo_kind":"listed","path":"torchgpipe/stream.py","file_url":"https://github.com/KakaoBrain/torchgpipe/blob/HEAD/torchgpipe/stream.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"BSD-3-Clause","inline_ok":true,"mcp_get_code":{"code_sha256":"3fb6eb077f80eb2a"}},{"code_sha256_prefix":"b7a600ae5e37c3a3","entry":"extract_metadata_from_tensor","repo":"pytorch/pippy","repo_kind":"listed","path":"pippy/ManualPipelineStage.py","file_url":"https://github.com/pytorch/pippy/blob/HEAD/pippy/ManualPipelineStage.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"BSD-3-Clause","inline_ok":false,"mcp_get_code":{"code_sha256":"b7a600ae5e37c3a3"}},{"code_sha256_prefix":"3c8d01128ba249ca","entry":"flatten_args","repo":"pytorch/pippy","repo_kind":"listed","path":"pippy/_utils.py","file_url":"https://github.com/pytorch/pippy/blob/HEAD/pippy/_utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"BSD-3-Clause","inline_ok":false,"mcp_get_code":{"code_sha256":"3c8d01128ba249ca"}},{"code_sha256_prefix":"1a1924af4440b5fa","entry":"flatten_args_detach","repo":"pytorch/pippy","repo_kind":"listed","path":"pippy/_utils.py","file_url":"https://github.com/pytorch/pippy/blob/HEAD/pippy/_utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"BSD-3-Clause","inline_ok":false,"mcp_get_code":{"code_sha256":"1a1924af4440b5fa"}},{"code_sha256_prefix":"b6bb1b97b00ed3b6","entry":"friendly_debug_info","repo":"pytorch/pippy","repo_kind":"listed","path":"pippy/_debug.py","file_url":"https://github.com/pytorch/pippy/blob/HEAD/pippy/_debug.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"BSD-3-Clause","inline_ok":false,"mcp_get_code":{"code_sha256":"b6bb1b97b00ed3b6"}},{"code_sha256_prefix":"9463c0f5ec4c4938","entry":"gather","repo":"KakaoBrain/torchgpipe","repo_kind":"listed","path":"torchgpipe/microbatch.py","file_url":"https://github.com/KakaoBrain/torchgpipe/blob/HEAD/torchgpipe/microbatch.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"BSD-3-Clause","inline_ok":true,"mcp_get_code":{"code_sha256":"9463c0f5ec4c4938"}},{"code_sha256_prefix":"2b584480479935de","entry":"join","repo":"KakaoBrain/torchgpipe","repo_kind":"listed","path":"torchgpipe/dependency.py","file_url":"https://github.com/KakaoBrain/torchgpipe/blob/HEAD/torchgpipe/dependency.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"BSD-3-Clause","inline_ok":true,"mcp_get_code":{"code_sha256":"2b584480479935de"}},{"code_sha256_prefix":"39f707712b771120","entry":"load_checkpoint","repo":"pytorch/pippy","repo_kind":"listed","path":"pippy/utilities/hf_checkpoint.py","file_url":"https://github.com/pytorch/pippy/blob/HEAD/pippy/utilities/hf_checkpoint.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"BSD-3-Clause","inline_ok":false,"mcp_get_code":{"code_sha256":"39f707712b771120"}},{"code_sha256_prefix":"48f84aab14bf05d7","entry":"map_debug_info","repo":"pytorch/pippy","repo_kind":"listed","path":"pippy/_debug.py","file_url":"https://github.com/pytorch/pippy/blob/HEAD/pippy/_debug.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"BSD-3-Clause","inline_ok":false,"mcp_get_code":{"code_sha256":"48f84aab14bf05d7"}},{"code_sha256_prefix":"6208a5903d876734","entry":"merge_chunks","repo":"pytorch/pippy","repo_kind":"listed","path":"pippy/microbatch.py","file_url":"https://github.com/pytorch/pippy/blob/HEAD/pippy/microbatch.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"BSD-3-Clause","inline_ok":false,"mcp_get_code":{"code_sha256":"6208a5903d876734"}},{"code_sha256_prefix":"17512f8707f8aff6","entry":"new_stream","repo":"KakaoBrain/torchgpipe","repo_kind":"listed","path":"torchgpipe/stream.py","file_url":"https://github.com/KakaoBrain/torchgpipe/blob/HEAD/torchgpipe/stream.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"BSD-3-Clause","inline_ok":true,"mcp_get_code":{"code_sha256":"17512f8707f8aff6"}},{"code_sha256_prefix":"2b37d8e52033937a","entry":"recommend_auto_balance","repo":"KakaoBrain/torchgpipe","repo_kind":"listed","path":"torchgpipe/gpipe.py","file_url":"https://github.com/KakaoBrain/torchgpipe/blob/HEAD/torchgpipe/gpipe.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"BSD-3-Clause","inline_ok":true,"mcp_get_code":{"code_sha256":"2b37d8e52033937a"}},{"code_sha256_prefix":"e6e8680c8e3f7cca","entry":"scatter","repo":"KakaoBrain/torchgpipe","repo_kind":"listed","path":"torchgpipe/microbatch.py","file_url":"https://github.com/KakaoBrain/torchgpipe/blob/HEAD/torchgpipe/microbatch.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"BSD-3-Clause","inline_ok":true,"mcp_get_code":{"code_sha256":"e6e8680c8e3f7cca"}},{"code_sha256_prefix":"d97c0eee80161ec7","entry":"solve","repo":"KakaoBrain/torchgpipe","repo_kind":"listed","path":"torchgpipe/balance/blockpartition.py","file_url":"https://github.com/KakaoBrain/torchgpipe/blob/HEAD/torchgpipe/balance/blockpartition.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"BSD-3-Clause","inline_ok":true,"mcp_get_code":{"code_sha256":"d97c0eee80161ec7"}},{"code_sha256_prefix":"0c9bc9a454f61b83","entry":"sorted_batch_isend_irecv","repo":"pytorch/pippy","repo_kind":"listed","path":"pippy/PipelineSchedule.py","file_url":"https://github.com/pytorch/pippy/blob/HEAD/pippy/PipelineSchedule.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"BSD-3-Clause","inline_ok":false,"mcp_get_code":{"code_sha256":"0c9bc9a454f61b83"}},{"code_sha256_prefix":"a73bf81e7ff6e480","entry":"split_args_kwargs_into_chunks","repo":"pytorch/pippy","repo_kind":"listed","path":"pippy/microbatch.py","file_url":"https://github.com/pytorch/pippy/blob/HEAD/pippy/microbatch.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"BSD-3-Clause","inline_ok":false,"mcp_get_code":{"code_sha256":"a73bf81e7ff6e480"}},{"code_sha256_prefix":"72a75759840f524d","entry":"split_by_graph_with_num_stages","repo":"pytorch/pippy","repo_kind":"listed","path":"pippy/graphsplit.py","file_url":"https://github.com/pytorch/pippy/blob/HEAD/pippy/graphsplit.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"BSD-3-Clause","inline_ok":false,"mcp_get_code":{"code_sha256":"72a75759840f524d"}},{"code_sha256_prefix":"a98a94de4f9b99a5","entry":"split_into_equal_size","repo":"pytorch/pippy","repo_kind":"listed","path":"pippy/ModelSplit.py","file_url":"https://github.com/pytorch/pippy/blob/HEAD/pippy/ModelSplit.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"BSD-3-Clause","inline_ok":false,"mcp_get_code":{"code_sha256":"a98a94de4f9b99a5"}},{"code_sha256_prefix":"c04cd81ea49efab8","entry":"split_module","repo":"KakaoBrain/torchgpipe","repo_kind":"listed","path":"torchgpipe/gpipe.py","file_url":"https://github.com/KakaoBrain/torchgpipe/blob/HEAD/torchgpipe/gpipe.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"BSD-3-Clause","inline_ok":true,"mcp_get_code":{"code_sha256":"c04cd81ea49efab8"}},{"code_sha256_prefix":"d7cd2aa574b58d09","entry":"split_on_size_threshold","repo":"pytorch/pippy","repo_kind":"listed","path":"pippy/ModelSplit.py","file_url":"https://github.com/pytorch/pippy/blob/HEAD/pippy/ModelSplit.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"BSD-3-Clause","inline_ok":false,"mcp_get_code":{"code_sha256":"d7cd2aa574b58d09"}},{"code_sha256_prefix":"ff4ccc02c28908ec","entry":"stage_backward","repo":"pytorch/pippy","repo_kind":"listed","path":"pippy/_backward.py","file_url":"https://github.com/pytorch/pippy/blob/HEAD/pippy/_backward.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"BSD-3-Clause","inline_ok":false,"mcp_get_code":{"code_sha256":"ff4ccc02c28908ec"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}