{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/an-attention-based-mechanism-to-combine","title":"An Attention-Based Mechanism to Combine Images and Metadata in Deep Learning Models Applied to Skin Cancer Classification","arxiv_id":null,"date":"2021-02-26","proceeding":"IEEE Journal of Biomedical and Health Informatics 2021 2","authors":["Andre G. C. Pacheco","Renato A. Krohling"],"abstract":"Computer-aided skin cancer classification systems built with deep neural networks usually yield predictions based only on images of skin lesions. Despite presenting promising results, it is possible to achieve higher performance by taking into account patient demographics, which are important clues that human experts consider during skin lesion screening. In this article, we deal with the problem of combining images and metadata features using deep learning models applied to skin cancer classification. We propose the Metadata Processing Block (MetaBlock), a novel algorithm that uses metadata to support data classification by enhancing the most relevant features extracted from the images throughout the classification pipeline. We compared the proposed method with two other combination approaches: the MetaNet and one based on features concatenation. Results obtained for two different skin lesion datasets show that our method improves classification for all tested models and performs better than the other combination approaches in 6 out of 10 scenarios.","url_abs":"https://ieeexplore.ieee.org/document/9364366","url_pdf":"https://ieeexplore.ieee.org/document/9364366","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[],"tasks":[{"task_slug":"cancer-classification","task_name":"Cancer Classification"},{"task_slug":"classification-1","task_name":"Classification"},{"task_slug":"skin-cancer-classification","task_name":"Skin Cancer Classification"},{"task_slug":"skin-lesion-classification","task_name":"Skin Lesion Classification"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[{"leaderboard":"/sota/skin-lesion-classification-on-pad-ufes-20","task":"Skin Lesion Classification","dataset":"PAD-UFES-20","model":"CNN + Metablock","rank_in_archive_order":2,"of":3,"metrics":{"Balanced Accuracy":"0.77"},"uses_additional_data":false}],"syntology":{"syntology_url":null,"atlas_url":null,"mcp":null,"developers":"https://syntology.ai/developers"},"arxiv_metadata":null,"syntology_extracted_results":null}