Papers › TransFuse: Fusing Transformers and CNNs for Medical Image Segmentation

TransFuse: Fusing Transformers and CNNs for Medical Image Segmentation

16 Feb 2021arXiv:2102.08005archive 2025-07-28

Yundong Zhang, Huiye Liu, Qiang Hu

Medical image segmentation - the prerequisite of numerous clinical needs - has been significantly prospered by recent advances in convolutional neural networks (CNNs). However, it exhibits general limitations on modeling explicit long-range relation, and existing cures, resorting to building deep encoders along with aggressive downsampling operations, leads to redundant deepened networks and loss of localized details. Hence, the segmentation task awaits a better solution to improve the efficiency of modeling global contexts while maintaining a strong grasp of low-level details. In this paper, we propose a novel parallel-in-branch architecture, TransFuse, to address this challenge. TransFuse combines Transformers and CNNs in a parallel style, where both global dependency and low-level spatial details can be efficiently captured in a much shallower manner. Besides, a novel fusion technique - BiFusion module is created to efficiently fuse the multi-level features from both branches. Extensive experiments demonstrate that TransFuse achieves the newest state-of-the-art results on both 2D and 3D medical image sets including polyp, skin lesion, hip, and prostate segmentation, with significant parameter decrease and inference speed improvement.

PaperPDFCode

In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

Code

Rayicer/TransFuse officialpytorch report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Image SegmentationMedical Image SegmentationSegmentationSemantic Segmentation

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Medical Image Segmentation CVC-ClinicDB TransFuse-L mean Dice 0.934 #27 of 48 Archive leaderboard report
Medical Image Segmentation CVC-ClinicDB TransFuse-S mean Dice 0.918 #36 of 48 Archive leaderboard report
Medical Image Segmentation CVC-ColonDB TransFuse-S mIoU 0.696 #19 of 25 Archive leaderboard report
Medical Image Segmentation CVC-ColonDB TransFuse-S mean Dice 0.773 #19 of 25 Archive leaderboard report
Medical Image Segmentation CVC-ColonDB TransFuse-L mIoU 0.676 #23 of 25 Archive leaderboard report
Medical Image Segmentation CVC-ColonDB TransFuse-L mean Dice 0.744 #23 of 25 Archive leaderboard report
Medical Image Segmentation ETIS-LARIBPOLYPDB TransFuse-L mIoU 0.661 #17 of 25 Archive leaderboard report
Medical Image Segmentation ETIS-LARIBPOLYPDB TransFuse-L mean Dice 0.737 #17 of 25 Archive leaderboard report
Medical Image Segmentation ETIS-LARIBPOLYPDB TransFuse-S mIoU 0.659 #18 of 25 Archive leaderboard report
Medical Image Segmentation ETIS-LARIBPOLYPDB TransFuse-S mean Dice 0.733 #18 of 25 Archive leaderboard report
Medical Image Segmentation Kvasir-SEG TransFuse-L mIoU 0.868 #26 of 58 Archive leaderboard report
Medical Image Segmentation Kvasir-SEG TransFuse-L mean Dice 0.918 #26 of 58 Archive leaderboard report
Medical Image Segmentation Kvasir-SEG TransFuse-S mIoU 0.868 #27 of 58 Archive leaderboard report
Medical Image Segmentation Kvasir-SEG TransFuse-S mean Dice 0.918 #27 of 58 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections