3D dense captioning

Description from the archive archive 2025-07-28.

Benchmarks archive 2025-07-28

2 leaderboard tables shown for this task, 2 with rows (a “benchmark” on this site is a table with at least one row, as on /sota), ordered by row count. “Best model” is the first row in the archive's own order at snapshot; nothing is re-ranked here and metric direction is not recorded in the archive. PwC's Trend sparklines are not in the archive, so that column is omitted.

Syntology column: samples harvested from the paper's repositories and executed on synthesized fixtures; “ran” is not a correctness claim and does not order the table. A dash means no Syntology record for that paper, not a recorded non-run. Read from the graph 2026-09-24.

Libraries

Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.

Datasets archive 2025-07-28

2 datasets whose archive record lists this task, ordered by the archive's paper count.

Subtasks archive 2025-07-28

No subtask under this task in the archive's task tree.

Parent tasks archive 2025-07-28

Most implemented papers archive 2025-07-28

13 shown of 13 papers with code (26 tagged with this task in all), ordered by repositories listed in the archive, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers without a page here are shown as plain text.

• MARVEL-40M+: Multi-Level Visual Elaboration for High-Fidelity Text-to-3D Content Creation
  26 Nov 2024 2 repositories listed Syntology ran 0 of 6 samples · 6 unverified
  Generating high-fidelity 3D content from text prompts remains a significant challenge in computer vision due to the limited size, diversity, and annotation depth of the existing datasets.
• 3D CoCa: Contrastive Learners are 3D Captioners
  13 Apr 2025 1 repository listed
  3D captioning, which aims to describe the content of 3D scenes in natural language, remains highly challenging due to the inherent sparsity of point clouds and weak cross-modal alignment in existing methods.
• Rethinking 3D Dense Caption and Visual Grounding in A Unified Framework through Prompt-based Localization
  17 Apr 2024 1 repository listed
  3D Visual Grounding (3DVG) and 3D Dense Captioning (3DDC) are two crucial tasks in various 3D applications, which require both shared and complementary information in localization and visual-language relationships.
• TOD3Cap: Towards 3D Dense Captioning in Outdoor Scenes
  28 Mar 2024 1 repository listed Syntology ran 10 of 16 samples · 6 unverified · 16 pointer-only (licence)
  However, the exploration of 3D dense captioning in outdoor scenes is hindered by two major challenges: 1) the domain gap between indoor and outdoor scenes, such as dynamics and sparse visual inputs, makes it difficult…
• LL3DA: Visual Interactive Instruction Tuning for Omni-3D Understanding Reasoning and Planning
  1 Jan 2024 1 repository listed
  Recent progress in Large Multimodal Models (LMM) has opened up great possibilities for various applications in the field of human-machine interactions.
• LL3DA: Visual Interactive Instruction Tuning for Omni-3D Understanding, Reasoning, and Planning
  30 Nov 2023 1 repository listed Syntology ran 6 of 6 samples · 0 unverified
  However, developing LMMs that can comprehend, reason, and plan in complex and diverse 3D environments remains a challenging topic, especially considering the demand for understanding permutation-invariant point cloud 3D…
• An Embodied Generalist Agent in 3D World
  18 Nov 2023 1 repository listed Syntology ran 3 of 13 samples · 10 unverified
  However, several significant challenges remain: (i) most of these models rely on 2D images yet exhibit a limited capacity for 3D input; (ii) these models rarely explore the tasks inherently defined in 3D world, e.
• Vote2Cap-DETR++: Decoupling Localization and Describing for End-to-End 3D Dense Captioning
  6 Sep 2023 1 repository listed
  Moreover, we argue that object localization and description generation require different levels of scene understanding, which could be challenging for a shared set of queries to capture.
• End-to-End 3D Dense Captioning with Vote2Cap-DETR
  6 Jan 2023 1 repository listed Syntology ran 1 of 3 samples · 2 unverified
  Compared with prior arts, our framework has several appealing advantages: 1) Without resorting to numerous hand-crafted components, our method is based on a full transformer encoder-decoder architecture with a learnable…
• Context-Aware Alignment and Mutual Masking for 3D-Language Pre-Training
  1 Jan 2023 1 repository listed
  The current approaches for 3D visual reasoning are task-specific, and lack pre-training methods to learn generic representations that can transfer across various tasks.
• Spatiality-guided Transformer for 3D Dense Captioning on Point Clouds
  22 Apr 2022 1 repository listed
  Dense captioning in 3D point clouds is an emerging vision-and-language task involving object-level 3D scene understanding.
• MORE: Multi-Order RElation Mining for Dense Captioning in 3D Scenes
  10 Mar 2022 1 repository listed Syntology ran 2 of 9 samples · 7 unverified
  3D dense captioning is a recently-proposed novel task, where point clouds contain more geometric information than the 2D counterpart.
• X-Trans2Cap: Cross-Modal Knowledge Transfer using Transformer for 3D Dense Captioning
  2 Mar 2022 1 repository listed
  Thus, a more faithful caption can be generated only using point clouds during the inference.

Syntology lines on 6 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced. Read from the graph 2026-09-24.