Papers › 4DContrast: Contrastive Learning with Dynamic Correspondences for 3D Scene Understanding

4DContrast: Contrastive Learning with Dynamic Correspondences for 3D Scene Understanding

6 Dec 2021arXiv:2112.02990archive 2025-07-28

Yujin Chen, Matthias Nießner, Angela Dai

We present a new approach to instill 4D dynamic object priors into learned 3D representations by unsupervised pre-training. We observe that dynamic movement of an object through an environment provides important cues about its objectness, and thus propose to imbue learned 3D representations with such dynamic understanding, that can then be effectively transferred to improved performance in downstream 3D semantic scene understanding tasks. We propose a new data augmentation scheme leveraging synthetic 3D shapes moving in static 3D environments, and employ contrastive learning under 3D-4D constraints that encode 4D invariances into the learned 3D representations. Experiments demonstrate that our unsupervised representation learning results in improvement in downstream 3D semantic segmentation, object detection, and instance segmentation tasks, and moreover, notably improves performance in data-scarce scenarios.

PaperPDF

In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

Code

No code repository is listed for this paper in the archive or in Syntology's graph.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

3D Instance Segmentation3D Semantic SegmentationContrastive LearningData AugmentationInstance SegmentationObjectObject DetectionRepresentation LearningScene UnderstandingSegmentationSemantic SegmentationUnsupervised Pre-trainingobject-detection

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
3D Instance Segmentation ScanNet(v2) 4DContrast mAP @ 50 57.6 #23 of 32 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Methods

Contrastive Learning

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections