Papers › Improved Bengali Image Captioning via deep convolutional neural network based...

Improved Bengali Image Captioning via deep convolutional neural network based encoder-decoder model

14 Feb 2021arXiv:2102.07192archive 2025-07-28

Mohammad Faiyaz Khan, S. M. Sadiq-Ur-Rahman Shifath, Md. Saiful Islam

Image Captioning is an arduous task of producing syntactically and semantically correct textual descriptions of an image in natural language with context related to the image. Existing notable pieces of research in Bengali Image Captioning (BIC) are based on encoder-decoder architecture. This paper presents an end-to-end image captioning system utilizing a multimodal architecture by combining a one-dimensional convolutional neural network (CNN) to encode sequence information with a pre-trained ResNet-50 model image encoder for extracting region-based visual features. We investigate our approach's performance on the BanglaLekhaImageCaptions dataset using the existing evaluation metrics and perform a human evaluation for qualitative analysis. Experiments show that our approach's language encoder captures the fine-grained information in the caption, and combined with the image features, it generates accurate and diversified caption. Our work outperforms all the existing BIC works and achieves a new state-of-the-art (SOTA) performance by scoring 0.651 on BLUE-1, 0.572 on CIDEr, 0.297 on METEOR, 0.434 on ROUGE, and 0.357 on SPICE.

PaperPDFCode

Code

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

DecoderImage Captioning

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Image Captioning BanglaLekhaImageCaptions CNN + 1D CNN BLEU-1 65.1 #1 of 1 Archive leaderboard report
Image Captioning BanglaLekhaImageCaptions CNN + 1D CNN BLEU-2 42.6 #1 of 1 Archive leaderboard report
Image Captioning BanglaLekhaImageCaptions CNN + 1D CNN BLEU-3 27.8 #1 of 1 Archive leaderboard report
Image Captioning BanglaLekhaImageCaptions CNN + 1D CNN BLEU-4 17.5 #1 of 1 Archive leaderboard report
Image Captioning BanglaLekhaImageCaptions CNN + 1D CNN CIDEr 57.2 #1 of 1 Archive leaderboard report
Image Captioning BanglaLekhaImageCaptions CNN + 1D CNN METEOR 29.7 #1 of 1 Archive leaderboard report
Image Captioning BanglaLekhaImageCaptions CNN + 1D CNN ROUGE-L 43.4 #1 of 1 Archive leaderboard report
Image Captioning BanglaLekhaImageCaptions CNN + 1D CNN SPICE 35.7 #1 of 1 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Methods

1D CNN

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections