Browse State-of-the-Art › Multi-modal Knowledge Graph
Multi-modal Knowledge Graph
15 papers with code · 0 benchmarks · 2 datasets archive 2025-07-28
Link to A Survey for Multi-modal Knowledge Graphs. Papers integrating Knowledge Graphs (KGs) and Multi-Modal Learning, focusing on research in two principal aspects: KG-driven Multi-Modal (KG4MM) learning, where KGs support multi-modal tasks, and Multi-Modal Knowledge Graph (MM4KG), which extends KG studies into the MMKG realm.
Description from the archive archive 2025-07-28.
Benchmarks archive 2025-07-28
No benchmark for this task in the archive.
Libraries
Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.
Datasets archive 2025-07-28
2 datasets whose archive record lists this task, ordered by the archive's paper count.
Subtasks archive 2025-07-28
No subtask under this task in the archive's task tree.
Most implemented papers archive 2025-07-28
15 shown of 15 papers with code (26 tagged with this task in all), ordered by repositories listed in the archive, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers without a page here are shown as plain text.
-
8 Feb 2024 6 repositories listed Syntology ran 9 of 18 samples · 9 unverifiedIn this survey, we carefully review over 300 articles, focusing on KG-aware research in two principal aspects: KG-driven Multi-Modal (KG4MM) learning, where KGs support multi-modal tasks, and Multi-Modal Knowledge Graph…
-
27 Aug 2024 2 repositories listedMulti-modal knowledge graphs (MMKGs), which ground various non-symbolic data (e.
-
15 Apr 2024 2 repositories listedTo further augment the multi-modal representations, MyGO incorporates fine-grained contrastive learning to highlight the specificity of the entity representations.
-
DO-RAG: A Domain-Specific QA Framework Using Knowledge Graph-Enhanced Retrieval-Augmented Generation15 May 2025 1 repository listedDomain-specific QA systems require not just generative fluency but high factual accuracy grounded in structured expert knowledge.
-
27 May 2024 1 repository listed Syntology ran 6 of 8 samples · 2 unverified · 8 pointer-only (licence)Learning high-quality multi-modal entity representations is an important goal of multi-modal knowledge graph (MMKG) representation learning, which can enhance reasoning tasks within the MMKGs, such as MMKG completion…
-
12 Mar 2024 1 repository listed Syntology ran 20 of 25 samples · 5 unverifiedCompared to this, editing Large Vision-Language Models (LVLMs) faces extra challenges from diverse data modalities and complicated model components, and data for LVLMs editing are limited.
-
11 Mar 2024 1 repository listedIn this work, we explore the efficacy of models in accurately embedding entities within MMKGs through two pivotal tasks: Multi-modal Knowledge Graph Completion (MKGC) and Multi-modal Entity Alignment (MMEA).
-
22 Feb 2024 1 repository listedTo address the mentioned problems, we propose Adaptive Multi-modal Fusion and Modality Adversarial Training (AdaMF-MAT) to unleash the power of imbalanced modality information for MMKGC.
-
31 Jan 2024 1 repository listedThis study introduces a novel approach, DESAlign, which addresses these issues by applying a theoretical framework based on Dirichlet energy to ensure semantic consistency.
-
10 Oct 2023 1 repository listedTo address these challenges, we propose a novel MMEA transformer, called MoAlign, that hierarchically introduces neighbor features, multi-modal attributes, and entity types to enhance the alignment task.
-
13 Aug 2023 1 repository listedNevertheless, existing methods emphasize the design of elegant KGC models to facilitate modality interaction, neglecting the real-life problem of missing modalities in KGs.
-
9 Aug 2023 1 repository listedMulti-modal knowledge graphs (MMKGs) combine different modal data (e.
-
23 Apr 2023 1 repository listedNegative sampling (NS) is widely used in knowledge graph embedding (KGE), which aims to generate negative triples to make a positive-negative contrast during training.
-
14 Aug 2022 1 repository listedTo deal with that problem, in this paper, we propose a novel Multi-modal Siamese Network for Entity Alignment (MSNEA) to align entities in different MMKGs, in which multi-modal knowledge could be comprehensively…
-
20 Apr 2022 1 repository listedThe medical conversational system can relieve the burden of doctors and improve the efficiency of healthcare, especially during the pandemic.
Syntology lines on 3 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced. Read from the graph 2026-09-24.
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections