Papers › NeuralPCI: Spatio-temporal Neural Field for 3D Point Cloud Multi-frame Non-linear Interpolation

NeuralPCI: Spatio-temporal Neural Field for 3D Point Cloud Multi-frame Non-linear Interpolation

27 Mar 2023CVPR 2023 1arXiv:2303.15126archive 2025-07-28

Zehan Zheng, Danni Wu, Ruisi Lu, Fan Lu, Guang Chen, Changjun Jiang

In recent years, there has been a significant increase in focus on the interpolation task of computer vision. Despite the tremendous advancement of video interpolation, point cloud interpolation remains insufficiently explored. Meanwhile, the existence of numerous nonlinear large motions in real-world scenarios makes the point cloud interpolation task more challenging. In light of these issues, we present NeuralPCI: an end-to-end 4D spatio-temporal Neural field for 3D Point Cloud Interpolation, which implicitly integrates multi-frame information to handle nonlinear large motions for both indoor and outdoor scenarios. Furthermore, we construct a new multi-frame point cloud interpolation dataset called NL-Drive for large nonlinear motions in autonomous driving scenes to better demonstrate the superiority of our method. Ultimately, NeuralPCI achieves state-of-the-art performance on both DHB (Dynamic Human Bodies) and NL-Drive datasets. Beyond the interpolation task, our method can be naturally extended to point cloud extrapolation, morphing, and auto-labeling, which indicates its substantial potential in other domains. Codes are available at https://github.com/ispc-lab/NeuralPCI.

PaperPDFConference PDFCode

In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

Code

ispc-lab/neuralpci officialmentioned in papermentioned on GitHubpytorch report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

3D Point Cloud InterpolationAutonomous Driving

Datasets

Introduced by this paper, per the archive.

NL-Drive

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
3D Point Cloud Interpolation DHB Dataset NeuralPCI CD 0.54 #1 of 5 Archive leaderboard report
3D Point Cloud Interpolation DHB Dataset NeuralPCI EMD 3.68 #1 of 5 Archive leaderboard report
3D Point Cloud Interpolation DHB Dataset PV-RAFT CD 0.92 #2 of 5 Archive leaderboard report
3D Point Cloud Interpolation DHB Dataset PV-RAFT EMD 6.14 #2 of 5 Archive leaderboard report
3D Point Cloud Interpolation DHB Dataset PointINet CD 0.96 #3 of 5 Archive leaderboard report
3D Point Cloud Interpolation DHB Dataset PointINet EMD 12.25 #3 of 5 Archive leaderboard report
3D Point Cloud Interpolation DHB Dataset IDEA-Net CD 1.02 #4 of 5 Archive leaderboard report
3D Point Cloud Interpolation DHB Dataset IDEA-Net EMD 12.03 #4 of 5 Archive leaderboard report
3D Point Cloud Interpolation DHB Dataset NSFP CD 1.22 #5 of 5 Archive leaderboard report
3D Point Cloud Interpolation DHB Dataset NSFP EMD 7.81 #5 of 5 Archive leaderboard report
3D Point Cloud Interpolation NL-Drive NeuralPCI CD 0.80 #1 of 4 Archive leaderboard report
3D Point Cloud Interpolation NL-Drive NeuralPCI EMD 97.03 #1 of 4 Archive leaderboard report
3D Point Cloud Interpolation NL-Drive PointINet CD 1.06 #2 of 4 Archive leaderboard report
3D Point Cloud Interpolation NL-Drive PointINet EMD 101.12 #2 of 4 Archive leaderboard report
3D Point Cloud Interpolation NL-Drive PV-RAFT CD 1.64 #3 of 4 Archive leaderboard report
3D Point Cloud Interpolation NL-Drive PV-RAFT EMD 140.42 #3 of 4 Archive leaderboard report
3D Point Cloud Interpolation NL-Drive NSFP CD 1.75 #4 of 4 Archive leaderboard report
3D Point Cloud Interpolation NL-Drive NSFP EMD 132.13 #4 of 4 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections