Papers › Real-time Automatic M-mode Echocardiography Measurement with Panel Attention from...

Real-time Automatic M-mode Echocardiography Measurement with Panel Attention from Local-to-Global Pixels

15 Aug 2023arXiv:2308.07717archive 2025-07-28

Ching-Hsun Tseng, Shao-Ju Chien, Po-Shen Wang, Shin-Jye Lee, Wei-Huan Hu, Bin Pu, Xiao-jun Zeng

Motion mode (M-mode) recording is an essential part of echocardiography to measure cardiac dimension and function. However, the current diagnosis cannot build an automatic scheme, as there are three fundamental obstructs: Firstly, there is no open dataset available to build the automation for ensuring constant results and bridging M-mode echocardiography with real-time instance segmentation (RIS); Secondly, the examination is involving the time-consuming manual labelling upon M-mode echocardiograms; Thirdly, as objects in echocardiograms occupy a significant portion of pixels, the limited receptive field in existing backbones (e.g., ResNet) composed from multiple convolution layers are inefficient to cover the period of a valve movement. Existing non-local attentions (NL) compromise being unable real-time with a high computation overhead or losing information from a simplified version of the non-local block. Therefore, we proposed RAMEM, a real-time automatic M-mode echocardiography measurement scheme, contributes three aspects to answer the problems: 1) provide MEIS, a dataset of M-mode echocardiograms for instance segmentation, to enable consistent results and support the development of an automatic scheme; 2) propose panel attention, local-to-global efficient attention by pixel-unshuffling, embedding with updated UPANets V2 in a RIS scheme toward big object detection with global receptive field; 3) develop and implement AMEM, an efficient algorithm of automatic M-mode echocardiography measurement enabling fast and accurate automatic labelling among diagnosis. The experimental results show that RAMEM surpasses existing RIS backbones (with non-local attention) in PASCAL 2012 SBD and human performances in real-time MEIS tested. The code of MEIS and dataset are available at https://github.com/hanktseng131415go/RAME.

PaperPDFCode

Code

hanktseng131415go/ramem officialmentioned in papermentioned on GitHubpytorch report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Instance SegmentationMedical Image SegmentationObject DetectionReal-time Instance SegmentationReal-time instance measurementSemantic Segmentationobject-detection

Datasets

Introduced by this paper, per the archive.

MEIS

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Real-time Instance Segmentation MEIS maYOLACT ResNet50 FLOPs (G) 0.4826 #1 of 2 Archive leaderboard report
Real-time Instance Segmentation MEIS maYOLACT ResNet50 Frame (fps) 36.13 #1 of 2 Archive leaderboard report
Real-time Instance Segmentation MEIS maYOLACT ResNet50 Size (M) 30.38 #1 of 2 Archive leaderboard report
Real-time Instance Segmentation MEIS maYOLACT ResNet50 avgAP (mask AP + box AP) 46.29 #1 of 2 Archive leaderboard report
Real-time Instance Segmentation MEIS maYOLACT ResNet50 boxAP 49.59 #1 of 2 Archive leaderboard report
Real-time Instance Segmentation MEIS maYOLACT ResNet50 maskAP 42.99 #1 of 2 Archive leaderboard report
Real-time Instance Segmentation MEIS RAMEM UPANet80 V2 FLOPs (G) 100.85 #2 of 2 Archive leaderboard report
Real-time Instance Segmentation MEIS RAMEM UPANet80 V2 Frame (fps) 52.22 #2 of 2 Archive leaderboard report
Real-time Instance Segmentation MEIS RAMEM UPANet80 V2 Size (M) 40.28 #2 of 2 Archive leaderboard report
Real-time Instance Segmentation MEIS RAMEM UPANet80 V2 avgAP (mask AP + box AP) 47.15 #2 of 2 Archive leaderboard report
Real-time Instance Segmentation MEIS RAMEM UPANet80 V2 boxAP 51.2 #2 of 2 Archive leaderboard report
Real-time Instance Segmentation MEIS RAMEM UPANet80 V2 maskAP 43.09 #2 of 2 Archive leaderboard report
Real-time Instance Segmentation PASCAL VOC 2012 RAMEM UPANet80 V2 FLOPs (G) 100.85 #1 of 3 Archive leaderboard report
Real-time Instance Segmentation PASCAL VOC 2012 RAMEM UPANet80 V2 Frame (fps) 60.93 #1 of 3 Archive leaderboard report
Real-time Instance Segmentation PASCAL VOC 2012 RAMEM UPANet80 V2 Size (M) 40.32 #1 of 3 Archive leaderboard report
Real-time Instance Segmentation PASCAL VOC 2012 RAMEM UPANet80 V2 avgAP (mask AP + box AP) 42.69 #1 of 3 Archive leaderboard report
Real-time Instance Segmentation PASCAL VOC 2012 RAMEM UPANet80 V2 boxAP 42.96 #1 of 3 Archive leaderboard report
Real-time Instance Segmentation PASCAL VOC 2012 RAMEM UPANet80 V2 maskAP 42.42 #1 of 3 Archive leaderboard report
Real-time Instance Segmentation PASCAL VOC 2012 maYOLACT ResNet50 FLOPs (G) 48.26 #2 of 3 Archive leaderboard report
Real-time Instance Segmentation PASCAL VOC 2012 maYOLACT ResNet50 Frame (fps) 81.27 #2 of 3 Archive leaderboard report
Real-time Instance Segmentation PASCAL VOC 2012 maYOLACT ResNet50 Size (M) 30.41 #2 of 3 Archive leaderboard report
Real-time Instance Segmentation PASCAL VOC 2012 maYOLACT ResNet50 avgAP (mask AP + box AP) 37.39 #2 of 3 Archive leaderboard report
Real-time Instance Segmentation PASCAL VOC 2012 maYOLACT ResNet50 boxAP 37.50 #2 of 3 Archive leaderboard report
Real-time Instance Segmentation PASCAL VOC 2012 maYOLACT ResNet50 maskAP 37.27 #2 of 3 Archive leaderboard report
Real-time Instance Segmentation PASCAL VOC 2012 YOLACT ResNet50 FLOPs (G) 48.26 #3 of 3 Archive leaderboard report
Real-time Instance Segmentation PASCAL VOC 2012 YOLACT ResNet50 Frame (fps) 81.11 #3 of 3 Archive leaderboard report
Real-time Instance Segmentation PASCAL VOC 2012 YOLACT ResNet50 Size (M) 30.41 #3 of 3 Archive leaderboard report
Real-time Instance Segmentation PASCAL VOC 2012 YOLACT ResNet50 avgAP (mask AP + box AP) 35.73 #3 of 3 Archive leaderboard report
Real-time Instance Segmentation PASCAL VOC 2012 YOLACT ResNet50 boxAP 36.65 #3 of 3 Archive leaderboard report
Real-time Instance Segmentation PASCAL VOC 2012 YOLACT ResNet50 maskAP 35.12 #3 of 3 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Methods

Convolution

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections