Papers › LILE: Look In-Depth before Looking Elsewhere -- A Dual Attention Network using...

LILE: Look In-Depth before Looking Elsewhere -- A Dual Attention Network using Transformers for Cross-Modal Information Retrieval in Histopathology Archives

2 Mar 2022arXiv:2203.01445archive 2025-07-28

Danial Maleki, H. R Tizhoosh

The volume of available data has grown dramatically in recent years in many applications. Furthermore, the age of networks that used multiple modalities separately has practically ended. Therefore, enabling bidirectional cross-modality data retrieval capable of processing has become a requirement for many domains and disciplines of research. This is especially true in the medical field, as data comes in a multitude of types, including various types of images and reports as well as molecular data. Most contemporary works apply cross attention to highlight the essential elements of an image or text in relation to the other modalities and try to match them together. However, regardless of their importance in their own modality, these approaches usually consider features of each modality equally. In this study, self-attention as an additional loss term will be proposed to enrich the internal representation provided into the cross attention module. This work suggests a novel architecture with a new loss term to help represent images and texts in the joint latent space. Experiment results on two benchmark datasets, i.e. MS-COCO and ARCH, show the effectiveness of the proposed method.

PaperPDF

Code

No code repository is listed for this paper in the archive or in Syntology's graph.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Cross-Modal Information RetrievalCross-Modal RetrievalInformation RetrievalRetrieval

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Cross-Modal Retrieval COCO 2014 LILE Image-to-text R@1 55.6 #29 of 36 Archive leaderboard report
Cross-Modal Retrieval COCO 2014 LILE Image-to-text R@10 91.0 #29 of 36 Archive leaderboard report
Cross-Modal Retrieval COCO 2014 LILE Image-to-text R@5 82.4 #29 of 36 Archive leaderboard report
Cross-Modal Retrieval COCO 2014 LILE Text-to-image R@1 41.5 #29 of 36 Archive leaderboard report
Cross-Modal Retrieval COCO 2014 LILE Text-to-image R@10 82.2 #29 of 36 Archive leaderboard report
Cross-Modal Retrieval COCO 2014 LILE Text-to-image R@5 72.1 #29 of 36 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Methods

ARCH

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections