Papers › LiwTERM: A Lightweight Transformer-Based Model for Dermatological Multimodal Lesion Detection

LiwTERM: A Lightweight Transformer-Based Model for Dermatological Multimodal Lesion Detection

18 Oct 2024SIBGRAPI Conference on Graphics, Patterns and Images (SIBGRAPI) 2024 10archive 2025-07-28

Luis A. Souza; André G. C. Pacheco; Gabriel G. de Angelo; Thiago Oliveira-Santos; Christoph Palm; João P. Papa

Skin cancer is the most common type of cancer in the world, accounting for approximately 30% of all diagnosed tumors. Early diagnosis reduces mortality rates and prevents disfiguring effects in different body regions. In recent years, machine learning techniques, particularly deep learning, have shown promising results in this task, presenting studies that have demonstrated that combining a patient's clinical information with images of the lesion is crucial for improving the classification of skin lesions. Despite that, meaningful use of clinical information with multiple images is mandatory, requiring further investigation. Thus, this project aims to contribute to developing multimodal machine learning-based models to cope with the skin lesion classification task employing a lightweight transformer model. As a main hypothesis, models can take multiple images from different sources as input, along with clinical information from the patient's history, leading to a more reliable diagnosis. Our model deals with the not-trivial task of combining images and clinical information (from anamneses) concerning the skin lesions in a lightweight transformer architecture that does not demand high computation resources but still presents competitive classification results.

PaperPDFCode

Code

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Lesion ClassificationLesion DetectionSkin Lesion Classificationimbalanced classification

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Skin Lesion Classification ISIC 2019 LiwTERM model Balanced Accuracy 0.73 #2 of 2 Archive leaderboard report
Skin Lesion Classification PAD-UFES-20 LiwTERM model Balanced Accuracy 0.74 #1 of 3 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections