Papers › Depth estimation from 4D light field videos

Depth estimation from 4D light field videos

5 Dec 2020arXiv:2012.03021archive 2025-07-28

Takahiro Kinoshita, Satoshi Ono

Depth (disparity) estimation from 4D Light Field (LF) images has been a research topic for the last couple of years. Most studies have focused on depth estimation from static 4D LF images while not considering temporal information, i.e., LF videos. This paper proposes an end-to-end neural network architecture for depth estimation from 4D LF videos. This study also constructs a medium-scale synthetic 4D LF video dataset that can be used for training deep learning-based methods. Experimental results using synthetic and real-world 4D LF videos show that temporal information contributes to the improvement of depth estimation accuracy in noisy regions. Dataset and code is available at: https://mediaeng-lfv.github.io/LFV_Disparity_Estimation

PaperPDFCode

In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

Code

mediaeng-lfv/LFV_Disparity_Estimation officialmentioned on GitHubtf report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Depth EstimationDisparity Estimation

Datasets

Introduced by this paper, per the archive.

Sintel 4D LFV

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Disparity Estimation Sintel 4D LFV - ambushfight5 Two-stream CNN+CLSTM BadPix(0.01) 62.0493 #1 of 1 Archive leaderboard report
Disparity Estimation Sintel 4D LFV - ambushfight5 Two-stream CNN+CLSTM BadPix(0.03) 22.8762 #1 of 1 Archive leaderboard report
Disparity Estimation Sintel 4D LFV - ambushfight5 Two-stream CNN+CLSTM BadPix(0.07) 8.3404 #1 of 1 Archive leaderboard report
Disparity Estimation Sintel 4D LFV - ambushfight5 Two-stream CNN+CLSTM MSE*100 21.67 #1 of 1 Archive leaderboard report
Disparity Estimation Sintel 4D LFV - bamboo3 Two-stream CNN+CLSTM BadPix(0.01) 53.2985 #1 of 1 Archive leaderboard report
Disparity Estimation Sintel 4D LFV - bamboo3 Two-stream CNN+CLSTM BadPix(0.03) 21.8162 #1 of 1 Archive leaderboard report
Disparity Estimation Sintel 4D LFV - bamboo3 Two-stream CNN+CLSTM BadPix(0.07) 8.9475 #1 of 1 Archive leaderboard report
Disparity Estimation Sintel 4D LFV - bamboo3 Two-stream CNN+CLSTM MSE*100 21.59 #1 of 1 Archive leaderboard report
Disparity Estimation Sintel 4D LFV - shaman2 Two-stream CNN+CLSTM BadPix(0.01) 74.7733 #1 of 1 Archive leaderboard report
Disparity Estimation Sintel 4D LFV - shaman2 Two-stream CNN+CLSTM BadPix(0.03) 50.6706 #1 of 1 Archive leaderboard report
Disparity Estimation Sintel 4D LFV - shaman2 Two-stream CNN+CLSTM BadPix(0.07) 32.7585 #1 of 1 Archive leaderboard report
Disparity Estimation Sintel 4D LFV - shaman2 Two-stream CNN+CLSTM MSE*100 2.4421 #1 of 1 Archive leaderboard report
Disparity Estimation Sintel 4D LFV - thebigfight2 Two-stream CNN+CLSTM BadPix(0.01) 17.7493 #1 of 1 Archive leaderboard report
Disparity Estimation Sintel 4D LFV - thebigfight2 Two-stream CNN+CLSTM BadPix(0.03) 3.6084 #1 of 1 Archive leaderboard report
Disparity Estimation Sintel 4D LFV - thebigfight2 Two-stream CNN+CLSTM BadPix(0.05) 1.0688 #1 of 1 Archive leaderboard report
Disparity Estimation Sintel 4D LFV - thebigfight2 Two-stream CNN+CLSTM MSE*100 3.67 #1 of 1 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Methods

3D ConvolutionConvLSTMConvolution

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections