Papers › Variational Autoencoders for Feature Exploration and Malignancy Prediction of Lung Lesions

Variational Autoencoders for Feature Exploration and Malignancy Prediction of Lung Lesions

27 Nov 2023arXiv:2311.15719archive 2025-07-28

Benjamin Keel, Aaron Quyn, David Jayne, Samuel D. Relton

Lung cancer is responsible for 21% of cancer deaths in the UK and five-year survival rates are heavily influenced by the stage the cancer was identified at. Recent studies have demonstrated the capability of AI methods for accurate and early diagnosis of lung cancer from routine scans. However, this evidence has not translated into clinical practice with one barrier being a lack of interpretable models. This study investigates the application Variational Autoencoders (VAEs), a type of generative AI model, to lung cancer lesions. Proposed models were trained on lesions extracted from 3D CT scans in the LIDC-IDRI public dataset. Latent vector representations of 2D slices produced by the VAEs were explored through clustering to justify their quality and used in an MLP classifier model for lung cancer diagnosis, the best model achieved state-of-the-art metrics of AUC 0.98 and 93.1% accuracy. Cluster analysis shows the VAE latent space separates the dataset of malignant and benign lesions based on meaningful feature components including tumour size, shape, patient and malignancy class. We also include a comparative analysis of the standard Gaussian VAE (GVAE) and the more recent Dirichlet VAE (DirVAE), which replaces the prior with a Dirichlet distribution to encourage a more explainable latent space with disentangled feature representation. Finally, we demonstrate the potential for latent space traversals corresponding to clinically meaningful feature changes.

PaperPDFCode

Code

benkeel/vae_lung_lesion_bmvc officialmentioned in papermentioned on GitHubpytorch report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Lung Cancer DiagnosisLung Nodule Classification

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Lung Nodule Classification LIDC-IDRI GVAE AUC 98 #2 of 8 Archive leaderboard report
Lung Nodule Classification LIDC-IDRI GVAE Accuracy 93.1 #2 of 8 Archive leaderboard report
Lung Nodule Classification LIDC-IDRI GVAE F1 Score 94 #2 of 8 Archive leaderboard report
Lung Nodule Classification LIDC-IDRI GVAE Precision 93 #2 of 8 Archive leaderboard report
Lung Nodule Classification LIDC-IDRI GVAE Recall/ Sensitivity 96 #2 of 8 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections