{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/from-cnns-to-vision-transformers-a","title":"From Modern CNNs to Vision Transformers: Assessing the Performance, Robustness, and Classification Strategies of Deep Learning Models in Histopathology","arxiv_id":"2204.05044","date":"2022-04-11","proceeding":null,"authors":["Maximilian Springenberg","Annika Frommholz","Markus Wenzel","Eva Weicken","Jackie Ma","Nils Strodthoff"],"abstract":"While machine learning is currently transforming the field of histopathology, the domain lacks a comprehensive evaluation of state-of-the-art models based on essential but complementary quality requirements beyond a mere classification accuracy. In order to fill this gap, we developed a new methodology to extensively evaluate a wide range of classification models, including recent vision transformers, and convolutional neural networks such as: ConvNeXt, ResNet (BiT), Inception, ViT and Swin transformer, with and without supervised or self-supervised pretraining. We thoroughly tested the models on five widely used histopathology datasets containing whole slide images of breast, gastric, and colorectal cancer and developed a novel approach using an image-to-image translation model to assess the robustness of a cancer classification model against stain variations. Further, we extended existing interpretability methods to previously unstudied models and systematically reveal insights of the models' classifications strategies that can be transferred to future model architectures.","url_abs":"https://arxiv.org/abs/2204.05044v2","url_pdf":"https://arxiv.org/pdf/2204.05044v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"from-cnns-to-vision-transformers-a","repo_url":"https://github.com/hhi-aml/histobenchmark","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":null}],"tasks":[{"task_slug":"benchmarking","task_name":"Benchmarking"},{"task_slug":"cancer-classification","task_name":"Cancer Classification"},{"task_slug":"classification-1","task_name":"Classification"},{"task_slug":"image-to-image-translation","task_name":"Image-to-Image Translation"},{"task_slug":"whole-slide-images","task_name":"whole slide images"}],"methods":[{"method_slug":"convnext","method_name":"ConvNeXt"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2204.05044","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2204.05044"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/hhi-aml/histobenchmark","reach":null}],"summary":{"ran_draft_wrong":3,"ran_fixture":1,"unverified":1},"by_repo_kind":{"official":{"samples":5,"ran":4,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":5,"samples":[{"code_sha256_prefix":"0d4eb2eb9e32af69","entry":"collect_scores","repo":"hhi-aml/histobenchmark","repo_kind":"official","path":"code/main_cls_scores.py","file_url":"https://github.com/hhi-aml/histobenchmark/blob/HEAD/code/main_cls_scores.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"0d4eb2eb9e32af69"}},{"code_sha256_prefix":"e8f19915080b148b","entry":"get_paramgroups","repo":"hhi-aml/histobenchmark","repo_kind":"official","path":"code/main_patho_lightning.py","file_url":"https://github.com/hhi-aml/histobenchmark/blob/HEAD/code/main_patho_lightning.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"e8f19915080b148b"}},{"code_sha256_prefix":"97f484048ac03556","entry":"mixup_criterion","repo":"hhi-aml/histobenchmark","repo_kind":"official","path":"code/main_patho_lightning.py","file_url":"https://github.com/hhi-aml/histobenchmark/blob/HEAD/code/main_patho_lightning.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":"invariant","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"97f484048ac03556"}},{"code_sha256_prefix":"c0a4cf940a467481","entry":"mixup_data","repo":"hhi-aml/histobenchmark","repo_kind":"official","path":"code/main_patho_lightning.py","file_url":"https://github.com/hhi-aml/histobenchmark/blob/HEAD/code/main_patho_lightning.py","link_basis":"first_harvest_node","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":"deterministic","behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"c0a4cf940a467481"}},{"code_sha256_prefix":"5e4c10ee1d00a8c3","entry":"integrated_top_K","repo":"hhi-aml/histobenchmark","repo_kind":"official","path":"code/main_heatmaps.py","file_url":"https://github.com/hhi-aml/histobenchmark/blob/HEAD/code/main_heatmaps.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"5e4c10ee1d00a8c3"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}