Papers › Bi-directional Contextual Attention for 3D Dense Captioning
Bi-directional Contextual Attention for 3D Dense Captioning
Minjung Kim, Hyung Suk Lim, Soonyoung Lee, Bumsoo Kim, Gunhee Kim
3D dense captioning is a task involving the localization of objects and the generation of descriptions for each object in a 3D scene. Recent approaches have attempted to incorporate contextual information by modeling relationships with object pairs or aggregating the nearest neighbor features of an object. However, the contextual information constructed in these scenarios is limited in two aspects: first, objects have multiple positional relationships that exist across the entire global scene, not only near the object itself. Second, it faces with contradicting objectives--where localization and attribute descriptions are generated better with tight localization, while descriptions involving global positional relations are generated better with contextualized features of the global scene. To overcome this challenge, we introduce BiCA, a transformer encoder-decoder pipeline that engages in 3D dense captioning for each object with Bi-directional Contextual Attention. Leveraging parallelly decoded instance queries for objects and context queries for non-object contexts, BiCA generates object-aware contexts, where the contexts relevant to each object is summarized, and context-aware objects, where the objects relevant to the summarized object-aware contexts are aggregated. This extension relieves previous methods from the contradicting objectives, enhancing both localization performance and enabling the aggregation of contextual features throughout the global scene; thus improving caption generation performance simultaneously. Extensive experiments on two of the most widely-used 3D dense captioning datasets demonstrate that our proposed method achieves a significant improvement over prior methods.
In Syntology View this paper on Syntology: its repositories, every harvested function with whether it ran, its licence and the call to fetch it.
Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.
Code
No code repository is listed for this paper in the archive or in Syntology's graph.
Code Syntology ran Syntology
Not run by Syntology. Nothing on this page verifies that the listed code works.
Tasks
Results from the paper archive 2025-07-28
| Task | Dataset | Model | Metric | Value | Rank at snapshot | Leaderboard | Report |
|---|---|---|---|---|---|---|---|
| 3D dense captioning | Nr3D | BiCA | BLEU-4 | 28.35 | #2 of 10 | Archive leaderboard | report |
| 3D dense captioning | Nr3D | BiCA | CIDEr | 48.77 | #2 of 10 | Archive leaderboard | report |
| 3D dense captioning | Nr3D | BiCA | METEOR | 25.60 | #2 of 10 | Archive leaderboard | report |
| 3D dense captioning | Nr3D | BiCA | ROUGE-L | 55.81 | #2 of 10 | Archive leaderboard | report |
| 3D dense captioning | ScanRefer Dataset | BiCA | BLEU-4 | 40.16 | #3 of 12 | Archive leaderboard | report |
| 3D dense captioning | ScanRefer Dataset | BiCA | CIDEr | 80.14 | #3 of 12 | Archive leaderboard | report |
| 3D dense captioning | ScanRefer Dataset | BiCA | METEOR | 27.76 | #3 of 12 | Archive leaderboard | report |
| 3D dense captioning | ScanRefer Dataset | BiCA | ROUGE-L | 56.10 | #3 of 12 | Archive leaderboard | report |
Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.
Methods
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections