Papers › Act Like a Radiologist: Radiology Report Generation across Anatomical Regions

Act Like a Radiologist: Radiology Report Generation across Anatomical Regions

26 May 2023arXiv:2305.16685archive 2025-07-28

Qi Chen, Yutong Xie, Biao Wu, Xiaomin Chen, James Ang, Minh-Son To, Xiaojun Chang, Qi Wu

Automating radiology report generation can ease the reporting workload for radiologists. However, existing works focus mainly on the chest area due to the limited availability of public datasets for other regions. Besides, they often rely on naive data-driven approaches, e.g., a basic encoder-decoder framework with captioning loss, which limits their ability to recognise complex patterns across diverse anatomical regions. To address these issues, we propose X-RGen, a radiologist-minded report generation framework across six anatomical regions. In X-RGen, we seek to mimic the behaviour of human radiologists, breaking them down into four principal phases: 1) initial observation, 2) cross-region analysis, 3) medical interpretation, and 4) report formation. Firstly, we adopt an image encoder for feature extraction, akin to a radiologist's preliminary review. Secondly, we enhance the recognition capacity of the image encoder by analysing images and reports across various regions, mimicking how radiologists gain their experience and improve their professional ability from past cases. Thirdly, just as radiologists apply their expertise to interpret radiology images, we introduce radiological knowledge of multiple anatomical regions to further analyse the features from a clinical perspective. Lastly, we generate reports based on the medical-aware features using a typical auto-regressive text decoder. Both natural language generation (NLG) and clinical efficacy metrics show the effectiveness of X-RGen on six X-ray datasets. Our code and checkpoints are available at: https://github.com/YtongXie/X-RGen.

PaperPDFCode

In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

Code

ytongxie/s4m officialmentioned in paperpytorch report
ytongxie/x-rgen officialmentioned in paperpytorch report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

DecoderMedical Report GenerationText Generation

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Medical Report Generation IU X-Ray X-RGen BLEU-1 0.466 #1 of 1 Archive leaderboard report
Medical Report Generation IU X-Ray X-RGen BLEU-2 0.306 #1 of 1 Archive leaderboard report
Medical Report Generation IU X-Ray X-RGen BLEU-3 0.225 #1 of 1 Archive leaderboard report
Medical Report Generation IU X-Ray X-RGen BLEU-4 0.177 #1 of 1 Archive leaderboard report
Medical Report Generation IU X-Ray X-RGen CIDEr 0.602 #1 of 1 Archive leaderboard report
Medical Report Generation IU X-Ray X-RGen METEOR 0.199 #1 of 1 Archive leaderboard report
Medical Report Generation IU X-Ray X-RGen ROUGE 0.367 #1 of 1 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections