Multispectral Object Detection

Description from the archive archive 2025-07-28.

Benchmarks archive 2025-07-28

4 leaderboard tables shown for this task, 4 with rows (a “benchmark” on this site is a table with at least one row, as on /sota), ordered by row count. “Best model” is the first row in the archive's own order at snapshot; nothing is re-ranked here and metric direction is not recorded in the archive. PwC's Trend sparklines are not in the archive, so that column is omitted.

Syntology column: samples harvested from the paper's repositories and executed on synthesized fixtures; “ran” is not a correctness claim and does not order the table. A dash means no Syntology record for that paper, not a recorded non-run. Read from the graph 2026-09-24.

Libraries

Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.

Datasets archive 2025-07-28

4 datasets whose archive record lists this task, ordered by the archive's paper count.

Subtasks archive 2025-07-28

No subtask under this task in the archive's task tree.

Most implemented papers archive 2025-07-28

26 shown of 26 papers with code (39 tagged with this task in all), ordered by repositories listed in the archive, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers without a page here are shown as plain text.

• Fully Convolutional Networks for Semantic Segmentation
  14 Nov 2014 51 repositories listed Syntology ran 3 of 4 samples · 1 unverified · 4 pointer-only (licence)
  Convolutional networks are powerful visual models that yield hierarchies of features.
• 𝐂²Former: Calibrated and Complementary Transformer for RGB-Infrared Object Detection
  28 Jun 2023 2 repositories listed
  In C²Former, we design an Inter-modality Cross-Attention (ICA) module to obtain the calibrated and complementary features by learning the cross-attention relationship between the RGB and IR modality.
• Improving Multispectral Pedestrian Detection by Addressing Modality Imbalance Problems
  7 Aug 2020 2 repositories listed
  Compared with traditional pedestrian detection, we find multispectral pedestrian detection suffers from modality imbalance problems which will hinder the optimization process of dual-modality network and depress the…
• Multispectral Deep Neural Networks for Pedestrian Detection
  8 Nov 2016 2 repositories listed Syntology ran 1 of 7 samples · 6 unverified
  Multispectral pedestrian detection is essential for around-the-clock applications, e.
• YOLOv11-RGBT: Towards a Comprehensive Single-Stage Multispectral Object Detection Framework
  17 Jun 2025 1 repository listed
  To address these, based on the YOLOv11 framework, we present YOLOv11-RGBT, a new comprehensive multimodal object detection framework.
• Multispectral Detection Transformer with Infrared-Centric Sensor Fusion
  21 May 2025 1 repository listed
  Multispectral object detection aims to leverage complementary information from visible (RGB) and infrared (IR) modalities to enable robust performance under diverse environmental conditions.
• When Pedestrian Detection Meets Multi-Modal Learning: Generalist Model and Benchmark Dataset
  14 Jul 2024 1 repository listed
  With multi-modal joint training, our model achieves state-of-the-art performance on a wide range of pedestrian detection benchmarks, surpassing leading models tailored for specific sensor modality.
• Rethinking Early-Fusion Strategies for Improved Multispectral Object Detection
  25 May 2024 1 repository listed
  In this paper, we address this issue by improving the performance of efficient single-branch structures.
• MiPa: Mixed Patch Infrared-Visible Modality Agnostic Object Detection
  29 Apr 2024 1 repository listed
  Multimodal learning is a common way to leverage these modalities, where multiple modality-specific encoders and a fusion module are used to improve performance.
• UniRGB-IR: A Unified Framework for RGB-Infrared Semantic Tasks via Adapter Tuning
  26 Apr 2024 1 repository listed
  Semantic analysis on visible (RGB) and infrared (IR) images has gained attention for its ability to be more accurate and robust under low-illumination and complex weather conditions.
• CFMW: Cross-modality Fusion Mamba for Multispectral Object Detection under Adverse Weather Conditions
  25 Apr 2024 1 repository listed Syntology ran 4 of 7 samples · 3 unverified · 7 pointer-only (licence)
  Furthermore, we introduce the Cross-modality Fusion Mamba with Weather-removal (CFMW) to augment detection accuracy in adverse weather conditions.
• INSANet: INtra-INter Spectral Attention Network for Effective Feature Fusion of Multispectral Pedestrian Detection
  10 Feb 2024 1 repository listed
  Extensive experiments demonstrate the effectiveness of the proposed methods, which achieve state-of-the-art performance on the KAIST dataset and LLVIP dataset.
• Removal then Selection: A Coarse-to-Fine Fusion Perspective for RGB-Infrared Object Detection
  19 Jan 2024 1 repository listed
  Specifically, following this perspective, we design a Redundant Spectrum Removal module to remove interfering information within each modality coarsely and a Dynamic Feature Selection module to finely select the desired…
• RGB-X Object Detection via Scene-Specific Fusion Modules
  30 Oct 2023 1 repository listed
  Multimodal deep sensor fusion has the potential to enable autonomous vehicles to visually understand their surrounding environments in all weather conditions.
• ICAFusion: Iterative Cross-Attention Guided Feature Fusion for Multispectral Object Detection
  15 Aug 2023 1 repository listed
  Effective feature fusion of multispectral images plays a crucial role in multi-spectral object detection.
• TFDet: Target-Aware Fusion for RGB-T Pedestrian Detection
  26 May 2023 1 repository listed
  Different from them, we comprehensively analyze the impacts of false positives on the detection performance and find that enhancing feature contrast can significantly reduce these false positives.
• Confidence-aware Fusion using Dempster-Shafer Theory for Multispectral Pedestrian Detection
  21 Mar 2022 1 repository listed
  Multispectral pedestrian detection is an important and valuable task in many applications, which could provide a more accurate and reliable pedestrian detection result by using the complementary visual information from…
• CMX: Cross-Modal Fusion for RGB-X Semantic Segmentation with Transformers
  9 Mar 2022 1 repository listed Syntology ran 2 of 2 samples · 0 unverified
  Pixel-wise semantic segmentation of RGB images can be advanced by exploiting complementary features from the supplementary modality (X-modality).
• ADJUST: A Dictionary-Based Joint Reconstruction and Unmixing Method for Spectral Tomography
  21 Dec 2021 1 repository listed
  However, these methods inherently suffer from the ill-posedness of the joint reconstruction problem.
• Cross-Modality Fusion Transformer for Multispectral Object Detection
  30 Oct 2021 1 repository listed
  Multispectral image pairs can provide the combined information, making object detection applications more reliable and robust in the open world.
• LLVIP: A Visible-infrared Paired Dataset for Low-light Vision
  24 Aug 2021 1 repository listed
  It is very challenging for various visual tasks such as image fusion, pedestrian detection and image-to-image translation in low light conditions due to the loss of effective target areas.
• MLPD: Multi-Label Pedestrian Detector in Multispectral Domain
  26 Jul 2021 1 repository listed
  In this letter, we tackle multispectral pedestrian detection, where all input data are not paired.
• Guided Attentive Feature Fusion for Multispectral Pedestrian Detection
  3 Jan 2021 1 repository listed
  Multispectral image pairs can provide complementary visual information, making pedestrian detection systems more robust and reliable.
• Multispectral Fusion for Object Detection with Cyclic Fuse-and-Refine Blocks
  26 Sep 2020 1 repository listed
  Multispectral images (e.
• CIAN: Cross-Image Affinity Net for Weakly Supervised Semantic Segmentation
  27 Nov 2018 1 repository listed
  Weakly supervised semantic segmentation with only image-level labels saves large human effort to annotate pixel-level labels.
• Multispectral Pedestrian Detection via Simultaneous Detection and Segmentation
  14 Aug 2018 1 repository listed
  To narrow this gap, we propose a network fusion architecture, which consists of a multispectral proposal network to generate pedestrian proposals, and a subsequent multispectral classification network to distinguish…

Syntology lines on 4 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced. Read from the graph 2026-09-24.