Papers › Exploring a Fine-Grained Multiscale Method for Cross-Modal Remote Sensing Image Retrieval

Exploring a Fine-Grained Multiscale Method for Cross-Modal Remote Sensing Image Retrieval

21 Apr 2022arXiv:2204.09868archive 2025-07-28

Zhiqiang Yuan, Wenkai Zhang, Kun fu, Xuan Li, Chubo Deng, Hongqi Wang, Xian Sun

Remote sensing (RS) cross-modal text-image retrieval has attracted extensive attention for its advantages of flexible input and efficient query. However, traditional methods ignore the characteristics of multi-scale and redundant targets in RS image, leading to the degradation of retrieval accuracy. To cope with the problem of multi-scale scarcity and target redundancy in RS multimodal retrieval task, we come up with a novel asymmetric multimodal feature matching network (AMFMN). Our model adapts to multi-scale feature inputs, favors multi-source retrieval methods, and can dynamically filter redundant features. AMFMN employs the multi-scale visual self-attention (MVSA) module to extract the salient features of RS image and utilizes visual features to guide the text representation. Furthermore, to alleviate the positive samples ambiguity caused by the strong intraclass similarity in RS image, we propose a triplet loss function with dynamic variable margin based on prior similarity of sample pairs. Finally, unlike the traditional RS image-text dataset with coarse text and higher intraclass similarity, we construct a fine-grained and more challenging Remote sensing Image-Text Match dataset (RSITMD), which supports RS image retrieval through keywords and sentence separately and jointly. Experiments on four RS text-image datasets demonstrate that the proposed model can achieve state-of-the-art performance in cross-modal RS text-image retrieval task.

PaperPDFCode

In Syntology View this paper on Syntology: its repositories, every harvested function with whether it ran, its licence and the call to fetch it.

Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

Code

xiaoyuan1996/AMFMN officialmentioned in paperpytorch report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Cross-Modal RetrievalImage RetrievalRetrievalSentence

1 archive task tag without a task page not shown.

Datasets

Introduced by this paper, per the archive.

RSITMD

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Cross-Modal Retrieval RSICD AMFMN Image-to-text R@1 5.21% #10 of 10 Archive leaderboard report
Cross-Modal Retrieval RSICD AMFMN Mean Recall 15.53% #10 of 10 Archive leaderboard report
Cross-Modal Retrieval RSICD AMFMN text-to-image R@1 4.08% #10 of 10 Archive leaderboard report
Cross-Modal Retrieval RSITMD AMFMN Image-to-text R@1 10.63% #10 of 10 Archive leaderboard report
Cross-Modal Retrieval RSITMD AMFMN Mean Recall 29.72% #10 of 10 Archive leaderboard report
Cross-Modal Retrieval RSITMD AMFMN text-to-imageR@1 11.51% #10 of 10 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Methods

Triplet Loss

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections