{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/radiotransformer-a-cascaded-global-focal","title":"RadioTransformer: A Cascaded Global-Focal Transformer for Visual Attention-guided Disease Classification","arxiv_id":"2202.11781","date":"2022-02-23","proceeding":null,"authors":["Moinak Bhattacharya","Shubham Jain","Prateek Prasanna"],"abstract":"In this work, we present RadioTransformer, a novel visual attention-driven transformer framework, that leverages radiologists' gaze patterns and models their visuo-cognitive behavior for disease diagnosis on chest radiographs. Domain experts, such as radiologists, rely on visual information for medical image interpretation. On the other hand, deep neural networks have demonstrated significant promise in similar tasks even where visual interpretation is challenging. Eye-gaze tracking has been used to capture the viewing behavior of domain experts, lending insights into the complexity of visual search. However, deep learning frameworks, even those that rely on attention mechanisms, do not leverage this rich domain information. RadioTransformer fills this critical gap by learning from radiologists' visual search patterns, encoded as 'human visual attention regions' in a cascaded global-focal transformer framework. The overall 'global' image characteristics and the more detailed 'local' features are captured by the proposed global and focal modules, respectively. We experimentally validate the efficacy of our student-teacher approach for 8 datasets involving different disease classification tasks where eye-gaze data is not available during the inference phase. Code: https://github.com/bmi-imaginelab/radiotransformer.","url_abs":"https://arxiv.org/abs/2202.11781v2","url_pdf":"https://arxiv.org/pdf/2202.11781v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"radiotransformer-a-cascaded-global-focal","repo_url":"https://github.com/bmi-imaginelab/radiotransformer","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"tf","reach":null}],"tasks":[],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/2202.11781","atlas_url":"https://app.syntology.ai/?focus=2202.11781","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2202.11781"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-25T09:33:49+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"deterministic:regex_extraction","url":"https://github.com/bmi-imaginelab/radiotransformer","reach":null}],"summary":{"unverified":4},"by_repo_kind":{"official":{"samples":4,"ran":0,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":4,"samples":[{"code_sha256_prefix":"05255f735db9e6d1","entry":"loaded_teacher_model","repo":"bmi-imaginelab/radiotransformer","repo_kind":"official","path":"radiotransformer.py","file_url":"https://github.com/bmi-imaginelab/radiotransformer/blob/HEAD/radiotransformer.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"05255f735db9e6d1"}},{"code_sha256_prefix":"c0641c8b7f421de8","entry":"student_model","repo":"bmi-imaginelab/radiotransformer","repo_kind":"official","path":"radiotransformer.py","file_url":"https://github.com/bmi-imaginelab/radiotransformer/blob/HEAD/radiotransformer.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"c0641c8b7f421de8"}},{"code_sha256_prefix":"097b3e664ef09e3b","entry":"student_teacher_model","repo":"bmi-imaginelab/radiotransformer","repo_kind":"official","path":"radiotransformer.py","file_url":"https://github.com/bmi-imaginelab/radiotransformer/blob/HEAD/radiotransformer.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"097b3e664ef09e3b"}},{"code_sha256_prefix":"13a83afc9fe1d947","entry":"teacher_model","repo":"bmi-imaginelab/radiotransformer","repo_kind":"official","path":"radiotransformer.py","file_url":"https://github.com/bmi-imaginelab/radiotransformer/blob/HEAD/radiotransformer.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"13a83afc9fe1d947"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}