{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/liwterm-a-lightweight-transformer-based-model","title":"LiwTERM: A Lightweight Transformer-Based Model for Dermatological Multimodal Lesion Detection","arxiv_id":null,"date":"2024-10-18","proceeding":"SIBGRAPI Conference on Graphics, Patterns and Images (SIBGRAPI) 2024 10","authors":["Luis A. Souza; André G. C. Pacheco; Gabriel G. de Angelo; Thiago Oliveira-Santos; Christoph Palm; João P. Papa"],"abstract":"Skin cancer is the most common type of cancer in the world, accounting for approximately 30% of all diagnosed tumors. Early diagnosis reduces mortality rates and prevents disfiguring effects in different body regions. In recent years, machine learning techniques, particularly deep learning, have shown promising results in this task, presenting studies that have demonstrated that combining a patient's clinical information with images of the lesion is crucial for improving the classification of skin lesions. Despite that, meaningful use of clinical information with multiple images is mandatory, requiring further investigation. Thus, this project aims to contribute to developing multimodal machine learning-based models to cope with the skin lesion classification task employing a lightweight transformer model. As a main hypothesis, models can take multiple images from different sources as input, along with clinical information from the patient's history, leading to a more reliable diagnosis. Our model deals with the not-trivial task of combining images and clinical information (from anamneses) concerning the skin lesions in a lightweight transformer architecture that does not demand high computation resources but still presents competitive classification results.","url_abs":"https://ieeexplore.ieee.org/document/10716324/authors#authors","url_pdf":"https://ieeexplore.ieee.org/document/10716324/authors#authors","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"liwterm-a-lightweight-transformer-based-model","repo_url":"https://github.com/luisouza/liwterm","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"pytorch","reach":null}],"tasks":[{"task_slug":"lesion-classification","task_name":"Lesion Classification"},{"task_slug":"lesion-detection","task_name":"Lesion Detection"},{"task_slug":"skin-lesion-classification","task_name":"Skin Lesion Classification"},{"task_slug":"imbalanced-classification","task_name":"imbalanced classification"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[{"leaderboard":"/sota/skin-lesion-classification-on-isic-2019","task":"Skin Lesion Classification","dataset":"ISIC 2019","model":"LiwTERM model","rank_in_archive_order":2,"of":2,"metrics":{"Balanced Accuracy":"0.73"},"uses_additional_data":false},{"leaderboard":"/sota/skin-lesion-classification-on-pad-ufes-20","task":"Skin Lesion Classification","dataset":"PAD-UFES-20","model":"LiwTERM model","rank_in_archive_order":1,"of":3,"metrics":{"Balanced Accuracy":"0.74"},"uses_additional_data":false}],"syntology":{"syntology_url":null,"atlas_url":null,"mcp":null,"developers":"https://syntology.ai/developers"},"arxiv_metadata":null,"syntology_extracted_results":null}