Papers › Structural Entities Extraction and Patient Indications Incorporation for Chest X-ray...

Structural Entities Extraction and Patient Indications Incorporation for Chest X-ray Report Generation

23 May 2024arXiv:2405.14905archive 2025-07-28

Kang Liu, Zhuoqi Ma, Xiaolu Kang, Zhusi Zhong, Zhicheng Jiao, Grayson Baird, Harrison Bai, Qiguang Miao

The automated generation of imaging reports proves invaluable in alleviating the workload of radiologists. A clinically applicable reports generation algorithm should demonstrate its effectiveness in producing reports that accurately describe radiology findings and attend to patient-specific indications. In this paper, we introduce a novel method, \textbf{S}tructural \textbf{E}ntities extraction and patient indications \textbf{I}ncorporation (SEI) for chest X-ray report generation. Specifically, we employ a structural entities extraction (SEE) approach to eliminate presentation-style vocabulary in reports and improve the quality of factual entity sequences. This reduces the noise in the following cross-modal alignment module by aligning X-ray images with factual entity sequences in reports, thereby enhancing the precision of cross-modal alignment and further aiding the model in gradient-free retrieval of similar historical cases. Subsequently, we propose a cross-modal fusion network to integrate information from X-ray images, similar historical cases, and patient-specific indications. This process allows the text decoder to attend to discriminative features of X-ray images, assimilate historical diagnostic information from similar cases, and understand the examination intention of patients. This, in turn, assists in triggering the text decoder to produce high-quality reports. Experiments conducted on MIMIC-CXR validate the superiority of SEI over state-of-the-art approaches on both natural language generation and clinical efficacy metrics.

PaperPDFCode

In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

Code

mk-runner/sei officialmentioned in paperpytorch report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

DecoderDiagnosticMedical Report GenerationText Generationcross-modal alignment

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Medical Report Generation MIMIC-CXR SEI-1 BLEU-2 0.247 #2 of 2 Archive leaderboard report
Medical Report Generation MIMIC-CXR SEI-1 BLEU-4 0.135 #2 of 2 Archive leaderboard report
Medical Report Generation MIMIC-CXR SEI-1 Example-F1-14 0.460 #2 of 2 Archive leaderboard report
Medical Report Generation MIMIC-CXR SEI-1 F1 RadGraph 0.249 #2 of 2 Archive leaderboard report
Medical Report Generation MIMIC-CXR SEI-1 METEOR 0.158 #2 of 2 Archive leaderboard report
Medical Report Generation MIMIC-CXR SEI-1 Micro-F1-5 0.542 #2 of 2 Archive leaderboard report
Medical Report Generation MIMIC-CXR SEI-1 ROUGE-L 0.299 #2 of 2 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections