Multi-modal Classification

Benchmarks archive 2025-07-28

2 leaderboard tables shown for this task, 2 with rows (a “benchmark” on this site is a table with at least one row, as on /sota), ordered by row count. “Best model” is the first row in the archive's own order at snapshot; nothing is re-ranked here and metric direction is not recorded in the archive. PwC's Trend sparklines are not in the archive, so that column is omitted.

Syntology column: samples harvested from the paper's repositories and executed on synthesized fixtures; “ran” is not a correctness claim and does not order the table. A dash means no Syntology record for that paper, not a recorded non-run. Read from the graph 2026-09-24.

Libraries

Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.

Datasets archive 2025-07-28

4 datasets whose archive record lists this task, ordered by the archive's paper count.

Subtasks archive 2025-07-28

1 subtask in the archive's task tree.

Parent tasks archive 2025-07-28

Most implemented papers archive 2025-07-28

12 shown of 12 papers with code (31 tagged with this task in all), ordered by repositories listed in the archive, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers without a page here are shown as plain text.

• What Makes Training Multi-Modal Classification Networks Hard?
  29 May 2019 3 repositories listed Syntology ran 1 of 11 samples · 10 unverified
  Consider end-to-end training of a multi-modal vs.
• Multimodal Learning with Uncertainty Quantification based on Discounted Belief Fusion
  23 Dec 2024 1 repository listed
  Multimodal AI models are increasingly used in fields like healthcare, finance, and autonomous driving, where information is drawn from multiple sources or modalities such as images, texts, audios, videos.
• Hateful Meme Detection through Context-Sensitive Prompting and Fine-Grained Labeling
  13 Nov 2024 1 repository listed
  The prevalence of multi-modal content on social media complicates automated moderation strategies.
• PromptStyler: Prompt-driven Style Generation for Source-free Domain Generalization
  27 Jul 2023 1 repository listed Syntology ran 0 of 1 samples · 1 unverified
  In a joint vision-language space, a text feature (e.
• FAME-ViL: Multi-Tasking Vision-Language Model for Heterogeneous Fashion Tasks
  4 Mar 2023 1 repository listed
  In the fashion domain, there exists a variety of vision-and-language (V+L) tasks, including cross-modal retrieval, text-guided image retrieval, multi-modal classification, and image captioning.
• Contrastive Audio-Visual Masked Autoencoder
  2 Oct 2022 1 repository listed Syntology ran 0 of 1 samples · 1 unverified
  In this paper, we first extend the recent Masked Auto-Encoder (MAE) model from a single modality to audio-visual multi-modalities.
• UAVM: Towards Unifying Audio and Visual Models
  29 Jul 2022 1 repository listed Syntology ran 6 of 14 samples · 8 unverified
  Conventional audio-visual models have independent audio and video branches.
• On Modality Bias Recognition and Reduction
  25 Feb 2022 1 repository listed
  From the results on four datasets regarding the above three tasks, our method yields remarkable performance improvements compared with the baselines, demonstrating its superiority on reducing the modality bias problem.
• Multimodal Dynamics: Dynamical Fusion for Trustworthy Multimodal Classification
  1 Jan 2022 1 repository listed
  To the best of our knowledge, this is the first work to jointly model both feature and modality variation for different samples to provide trustworthy fusion in multi-modal classification.
• Multi-modal Sarcasm Detection and Humor Classification in Code-mixed Conversations
  20 May 2021 1 repository listed
  In this work, we make two major contributions considering the above limitations: (1) we develop a Hindi-English code-mixed dataset, MaSaC, for the multi-modal sarcasm detection and humor classification in conversational…
• Look, Read and Enrich. Learning from Scientific Figures and their Captions
  19 Sep 2019 1 repository listed
  Compared to natural images, understanding scientific figures is particularly hard for machines.
• Image and Encoded Text Fusion for Multi-Modal Classification
  3 Oct 2018 1 repository listed
  To learn feature representations of resulting images, standard Convolutional Neural Networks (CNNs) are employed for the classification task.

Syntology lines on 4 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced. Read from the graph 2026-09-24.