Papers › ContactDB: Analyzing and Predicting Grasp Contact via Thermal Imaging

ContactDB: Analyzing and Predicting Grasp Contact via Thermal Imaging

15 Apr 2019CVPR 2019 6arXiv:1904.06830archive 2025-07-28

Samarth Brahmbhatt, Cusuh Ham, Charles C. Kemp, James Hays

Grasping and manipulating objects is an important human skill. Since hand-object contact is fundamental to grasping, capturing it can lead to important insights. However, observing contact through external sensors is challenging because of occlusion and the complexity of the human hand. We present ContactDB, a novel dataset of contact maps for household objects that captures the rich hand-object contact that occurs during grasping, enabled by use of a thermal camera. Participants in our study grasped 3D printed objects with a post-grasp functional intent. ContactDB includes 3750 3D meshes of 50 household objects textured with contact maps and 375K frames of synchronized RGB-D+thermal images. To the best of our knowledge, this is the first large-scale dataset that records detailed contact maps for human grasps. Analysis of this data shows the influence of functional intent and object size on grasping, the tendency to touch/avoid 'active areas', and the high frequency of palm and proximal finger contact. Finally, we train state-of-the-art image translation and 3D convolution algorithms to predict diverse contact patterns from object shape. Data, code and models are available at https://contactdb.cc.gatech.edu.

PaperPDFConference PDFCode

In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

Code

samarth-robo/contactdb_prediction officialmentioned on GitHubpytorchGPL-3.0 report
samarth-robo/contactdb_utils officialmentioned on GitHubGPL-3.0 report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Grasp Contact PredictionObjectTranslation

Datasets

Introduced by this paper, per the archive.

ContactDB

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Grasp Contact Prediction ContactDB DiverseNet-VoxNet Error rate 8.72 #1 of 4 Archive leaderboard report
Grasp Contact Prediction ContactDB sMCL-VoxNet Error rate 17.27 #2 of 4 Archive leaderboard report
Grasp Contact Prediction ContactDB DiverseNet-PointNet Error rate 21.82 #3 of 4 Archive leaderboard report
Grasp Contact Prediction ContactDB sMCL-PointNet Error rate 29.89 #4 of 4 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Methods

3D ConvolutionConvolution

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections