{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/from-pixel-to-cancer-cellular-automata-in","title":"From Pixel to Cancer: Cellular Automata in Computed Tomography","arxiv_id":"2403.06459","date":"2024-03-11","proceeding":null,"authors":["Yuxiang Lai","Xiaoxi Chen","Angtian Wang","Alan Yuille","Zongwei Zhou"],"abstract":"AI for cancer detection encounters the bottleneck of data scarcity, annotation difficulty, and low prevalence of early tumors. Tumor synthesis seeks to create artificial tumors in medical images, which can greatly diversify the data and annotations for AI training. However, current tumor synthesis approaches are not applicable across different organs due to their need for specific expertise and design. This paper establishes a set of generic rules to simulate tumor development. Each cell (pixel) is initially assigned a state between zero and ten to represent the tumor population, and a tumor can be developed based on three rules to describe the process of growth, invasion, and death. We apply these three generic rules to simulate tumor development--from pixel to cancer--using cellular automata. We then integrate the tumor state into the original computed tomography (CT) images to generate synthetic tumors across different organs. This tumor synthesis approach allows for sampling tumors at multiple stages and analyzing tumor-organ interaction. Clinically, a reader study involving three expert radiologists reveals that the synthetic tumors and their developing trajectories are convincingly realistic. Technically, we analyze and simulate tumor development at various stages using 9,262 raw, unlabeled CT images sourced from 68 hospitals worldwide. The performance in segmenting tumors in the liver, pancreas, and kidneys exceeds prevailing literature benchmarks, underlining the immense potential of tumor synthesis, especially for earlier cancer detection. The code and models are available at https://github.com/MrGiovanni/Pixel2Cancer","url_abs":"https://arxiv.org/abs/2403.06459v2","url_pdf":"https://arxiv.org/pdf/2403.06459v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"from-pixel-to-cancer-cellular-automata-in","repo_url":"https://github.com/mrgiovanni/pixel2cancer","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"Apache-2.0"}}],"tasks":[{"task_slug":"computed-tomography-ct","task_name":"Computed Tomography (CT)"}],"methods":[{"method_slug":"set","method_name":"SET"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2403.06459","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2403.06459"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/mrgiovanni/pixel2cancer","reach":{"status":"ok","spdx":"Apache-2.0"}}],"summary":{"ran":2,"ran_fixture":2,"ran_draft_wrong":1,"unverified":1},"by_repo_kind":{"official":{"samples":6,"ran":5,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"fcfa9e2be1bb189d","entry":"distributed_all_gather","repo":"mrgiovanni/pixel2cancer","repo_kind":"official","path":"monai_trainer.py","file_url":"https://github.com/mrgiovanni/pixel2cancer/blob/HEAD/monai_trainer.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"fcfa9e2be1bb189d"}},{"code_sha256_prefix":"aad0ea11cb13d353","entry":"get_window_size","repo":"mrgiovanni/pixel2cancer","repo_kind":"official","path":"networks/swin_transformer_3d.py","file_url":"https://github.com/mrgiovanni/pixel2cancer/blob/HEAD/networks/swin_transformer_3d.py","link_basis":"harvester_set","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":"well_formed","behaviour_fingerprint":true,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"aad0ea11cb13d353"}},{"code_sha256_prefix":"49f38716cc6d9f10","entry":"json_get_fold","repo":"mrgiovanni/pixel2cancer","repo_kind":"official","path":"monai_trainer.py","file_url":"https://github.com/mrgiovanni/pixel2cancer/blob/HEAD/monai_trainer.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"49f38716cc6d9f10"}},{"code_sha256_prefix":"4876d8faacbd6927","entry":"window_partition","repo":"mrgiovanni/pixel2cancer","repo_kind":"official","path":"networks/swin_transformer_3d.py","file_url":"https://github.com/mrgiovanni/pixel2cancer/blob/HEAD/networks/swin_transformer_3d.py","link_basis":"harvester_set","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"4876d8faacbd6927"}},{"code_sha256_prefix":"75fd6fbfca7a246c","entry":"window_reverse","repo":"mrgiovanni/pixel2cancer","repo_kind":"official","path":"networks/swin_transformer_3d.py","file_url":"https://github.com/mrgiovanni/pixel2cancer/blob/HEAD/networks/swin_transformer_3d.py","link_basis":"harvester_set","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":"invariant","behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"75fd6fbfca7a246c"}},{"code_sha256_prefix":"0c7f56ecce26a975","entry":"train_epoch","repo":"mrgiovanni/pixel2cancer","repo_kind":"official","path":"monai_trainer.py","file_url":"https://github.com/mrgiovanni/pixel2cancer/blob/HEAD/monai_trainer.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"0c7f56ecce26a975"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}