Papers › LILE: Look In-Depth before Looking Elsewhere -- A Dual Attention Network using...
LILE: Look In-Depth before Looking Elsewhere -- A Dual Attention Network using Transformers for Cross-Modal Information Retrieval in Histopathology Archives
Danial Maleki, H. R Tizhoosh
The volume of available data has grown dramatically in recent years in many applications. Furthermore, the age of networks that used multiple modalities separately has practically ended. Therefore, enabling bidirectional cross-modality data retrieval capable of processing has become a requirement for many domains and disciplines of research. This is especially true in the medical field, as data comes in a multitude of types, including various types of images and reports as well as molecular data. Most contemporary works apply cross attention to highlight the essential elements of an image or text in relation to the other modalities and try to match them together. However, regardless of their importance in their own modality, these approaches usually consider features of each modality equally. In this study, self-attention as an additional loss term will be proposed to enrich the internal representation provided into the cross attention module. This work suggests a novel architecture with a new loss term to help represent images and texts in the joint latent space. Experiment results on two benchmark datasets, i.e. MS-COCO and ARCH, show the effectiveness of the proposed method.
Code
No code repository is listed for this paper in the archive or in Syntology's graph.
Code Syntology ran Syntology
Not run by Syntology. Nothing on this page verifies that the listed code works.
Tasks
Results from the paper archive 2025-07-28
| Task | Dataset | Model | Metric | Value | Rank at snapshot | Leaderboard | Report |
|---|---|---|---|---|---|---|---|
| Cross-Modal Retrieval | COCO 2014 | LILE | Image-to-text R@1 | 55.6 | #29 of 36 | Archive leaderboard | report |
| Cross-Modal Retrieval | COCO 2014 | LILE | Image-to-text R@10 | 91.0 | #29 of 36 | Archive leaderboard | report |
| Cross-Modal Retrieval | COCO 2014 | LILE | Image-to-text R@5 | 82.4 | #29 of 36 | Archive leaderboard | report |
| Cross-Modal Retrieval | COCO 2014 | LILE | Text-to-image R@1 | 41.5 | #29 of 36 | Archive leaderboard | report |
| Cross-Modal Retrieval | COCO 2014 | LILE | Text-to-image R@10 | 82.2 | #29 of 36 | Archive leaderboard | report |
| Cross-Modal Retrieval | COCO 2014 | LILE | Text-to-image R@5 | 72.1 | #29 of 36 | Archive leaderboard | report |
Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.
Methods
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections