Papers › An Attention Based Pipeline for Identifying Pre-Cancer Lesions in Head and Neck Clinical Images

An Attention Based Pipeline for Identifying Pre-Cancer Lesions in Head and Neck Clinical Images

3 May 2024arXiv:2405.01937archive 2025-07-28

Abdullah Alsalemi, Anza Shakeel, Mollie Clark, Syed Ali Khurram, Shan E Ahmed Raza

Early detection of cancer can help improve patient prognosis by early intervention. Head and neck cancer is diagnosed in specialist centres after a surgical biopsy, however, there is a potential for these to be missed leading to delayed diagnosis. To overcome these challenges, we present an attention based pipeline that identifies suspected lesions, segments, and classifies them as non-dysplastic, dysplastic and cancerous lesions. We propose (a) a vision transformer based Mask R-CNN network for lesion detection and segmentation of clinical images, and (b) Multiple Instance Learning (MIL) based scheme for classification. Current results show that the segmentation model produces segmentation masks and bounding boxes with up to 82% overlap accuracy score on unseen external test data and surpassing reviewed segmentation benchmarks. Next, a classification F1-score of 85% on the internal cohort test set. An app has been developed to perform lesion segmentation taken via a smart device. Future work involves employing endoscopic video data for precise early detection and prognosis.

PaperPDFCode

Code

precision-vision/oed-classification-segmentation officialmentioned in paperpytorch report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Lesion DetectionLesion SegmentationMultiple Instance LearningPrognosisSegmentation

Results from the paper archive 2025-07-28

No leaderboard rows for this paper in the archive.

Methods

AttentionConvolutionDense ConnectionsLayer NormalizationLinear LayerMask R-CNNMulti-Head AttentionRPNResidual ConnectionRoIAlignSoftmaxVision Transformer

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections