Papers › Multispectral Fusion for Object Detection with Cyclic Fuse-and-Refine Blocks

Multispectral Fusion for Object Detection with Cyclic Fuse-and-Refine Blocks

26 Sep 2020arXiv:2009.12664archive 2025-07-28

Heng Zhang, Elisa Fromont, Sébastien Lefevre, Bruno Avignon

Multispectral images (e.g. visible and infrared) may be particularly useful when detecting objects with the same model in different environments (e.g. day/night outdoor scenes). To effectively use the different spectra, the main technical problem resides in the information fusion process. In this paper, we propose a new halfway feature fusion method for neural networks that leverages the complementary/consistency balance existing in multispectral features by adding to the network architecture, a particular module that cyclically fuses and refines each spectral feature. We evaluate the effectiveness of our fusion method on two challenging multispectral datasets for object detection. Our results show that implementing our Cyclic Fuse-and-Refine module in any network improves the performance on both datasets compared to other state-of-the-art multispectral object detection methods.

PaperPDFCode

In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

Code

ZHANGHeng19931123/CFR officialmentioned on GitHubMIT report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Multispectral Object DetectionObjectObject Detectionobject-detection

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Multispectral Object Detection FLIR CFR_3 (VGG16) mAP50 72.4% #15 of 18 Archive leaderboard report
Multispectral Object Detection FLIR Halfway Fusion (VGG16) mAP50 71.2% #16 of 18 Archive leaderboard report
Multispectral Object Detection KAIST Multispectral Pedestrian Detection Benchmark CFR Reasonable Miss Rate 6.13 #16 of 17 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections