Papers › Unifying Correspondence, Pose and NeRF for Pose-Free Novel View Synthesis from Stereo Pairs

Unifying Correspondence, Pose and NeRF for Pose-Free Novel View Synthesis from Stereo Pairs

12 Dec 2023arXiv:2312.07246archive 2025-07-28

Sunghwan Hong, Jaewoo Jung, Heeseong Shin, Jiaolong Yang, Seungryong Kim, Chong Luo

This work delves into the task of pose-free novel view synthesis from stereo pairs, a challenging and pioneering task in 3D vision. Our innovative framework, unlike any before, seamlessly integrates 2D correspondence matching, camera pose estimation, and NeRF rendering, fostering a synergistic enhancement of these tasks. We achieve this through designing an architecture that utilizes a shared representation, which serves as a foundation for enhanced 3D geometry understanding. Capitalizing on the inherent interplay between the tasks, our unified framework is trained end-to-end with the proposed training strategy to improve overall model accuracy. Through extensive evaluations across diverse indoor and outdoor scenes from two real-world datasets, we demonstrate that our approach achieves substantial improvement over previous methodologies, especially in scenarios characterized by extreme viewpoint changes and the absence of accurate camera poses.

PaperPDFCodeCode Syntology ran

In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

For agents, Syntology's MCP tool lists every function and class Syntology harvested from this paper and whether it ran (how to connect): get_harvested_code_for_paper(arxiv_id="2312.07246")

Code

Syntology Ran 16 of 21 code samples harvested from 1 repository linked to this paper; 5 have no recorded run. Of those that ran: 1 ran · our draft was wrong; 1 ran · fixture could not drive it; 14 ran with no contract checked.

By repository: official repository: 21 samples from 1 repository, 16 ran. The run record, sample by sample. “Ran” means executed on a synthesized input, not that the code is correct or reproduces the paper.

KU-CVLAB/CoPoNeRF officialmentioned on GitHubjax report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

21 samples harvested; 16 ran; 0 honoured the contract we drafted; 5 have no recorded run. Read from Syntology's graph 2026-09-24; that is when this build read the record, not when the samples ran.

1ran · our draft was wrong
1ran · fixture could not drive it
14ran
5unverified

Licence: 21 of the 21 samples are pointer only, meaning Syntology does not serve that copy's text. This page shows no code text for any sample; each one links to its file in the repository.

Harvested from KU-CVLAB/CoPoNeRF. “Ran” means the sample executed on a synthesized input. It does not mean the output is correct, and nothing here reproduces the paper's results. “Honoured” and “violated” refer to a contract Syntology drafted from the code itself; “our draft was wrong” and “fixture could not drive it” are failures of Syntology's instrument, not of the code.

Each sample ends with its code_sha256, Syntology's identity for that exact code. An agent fetches the stored sample with Syntology's MCP tool get_code(code_sha256="…") (how to connect); click an identity to copy that call.

Repository labels, per sample. official repository: The archive marks this repository official for the paper. named in the paper: The archive records that the paper mentions this repository; it is not marked official. community (archive-listed): In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper. found in paper text by Syntology: Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted. community: Not in the archive's code links for this paper; a community repository Syntology harvested. Samples from a repository marked official are listed first. Licence labels name the repository's licence as recorded at harvest. “Pointer only” means Syntology does not serve that copy's text, for one of four reasons: no licence file was found; the licence was not identified; the licence is recorded as permissive but that copy's record is not marked cleared; or the licence is outside the permissive list Syntology serves text under (MIT, Apache-2.0, BSD and similar). Some licences outside that list permit redistribution, such as WTFPL, and GPL-3.0 under its conditions; they are simply not on the list. Hover a licence label for the reason. File links open the file on GitHub at the default branch, which may have changed since the harvest.

check_invalid_gradients KU-CVLAB/CoPoNeRF/wrapper.py official repository ran no licence file found · pointer only · 349ea67a87e43d9c · report
drawpointslines KU-CVLAB/CoPoNeRF/summary/inspect_epipolar_geometry.py official repository ran no licence file found · pointer only · b61b82f87ea100ce · report
drop_path KU-CVLAB/CoPoNeRF/models/backbone.py official repository ran · fixture could not drive it no licence file found · pointer only · 39eace7e2822504f · report
homogenize_points KU-CVLAB/CoPoNeRF/models/epipolar.py official repository ran fingerprinted no licence file found · pointer only · e61745fc09b4f41d · report
homogenize_vecs KU-CVLAB/CoPoNeRF/models/epipolar.py official repository ran fingerprinted no licence file found · pointer only · 6626e70260f1ded8 · report
image_loss KU-CVLAB/CoPoNeRF/models/loss_function.py official repository ran no licence file found · pointer only · bb18d832d1cf86c8 · report
interpolate2d_token KU-CVLAB/CoPoNeRF/models/aggregation.py official repository ran no licence file found · pointer only · 195bfbe9394fe2cf · report
interpolate4d KU-CVLAB/CoPoNeRF/models/aggregation.py official repository ran no licence file found · pointer only · e4ec5660afd116b8 · report
overlay_semantic_mask KU-CVLAB/CoPoNeRF/summary/summaries.py official repository ran no licence file found · pointer only · a196581cceeeb34f · report
process KU-CVLAB/CoPoNeRF/data_download/generate_acid.py official repository ran no licence file found · pointer only · 19eb01023b5619ac · report
project KU-CVLAB/CoPoNeRF/models/epipolar.py official repository ran fingerprinted no licence file found · pointer only · e1998dc5f23b08ea · report
skew KU-CVLAB/CoPoNeRF/summary/inspect_epipolar_geometry.py official repository ran fingerprinted no licence file found · pointer only · 6bd09766d7ad212b · report
transpose4d KU-CVLAB/CoPoNeRF/models/conv4d.py official repository ran no licence file found · pointer only · 62b4091f05ba7be6 · report
two_view_geometry KU-CVLAB/CoPoNeRF/summary/inspect_epipolar_geometry.py official repository ran no licence file found · pointer only · a377b67abe1e64ff · report
unnormalise_and_convert_mapping_to_flow KU-CVLAB/CoPoNeRF/models/aggregation.py official repository ran · our draft was wrong no licence file found · pointer only · b2bf0025a986b118 · report
wrap_process KU-CVLAB/CoPoNeRF/data_download/generate_acid.py official repository ran no licence file found · pointer only · 55444e385cd23a1f · report
compute_geodesic_distance_from_two_matrices KU-CVLAB/CoPoNeRF/summary/summaries.py official repository unverified no licence file found · pointer only · c1765c4e3affd9d9 · report
create_window KU-CVLAB/CoPoNeRF/models/loss_function.py official repository unverified no licence file found · pointer only · 3fe23507aa4d496c · report
gaussian KU-CVLAB/CoPoNeRF/models/loss_function.py official repository unverified no licence file found · pointer only · 761d9c2202c2f8c4 · report
get_l1_positional_encodings KU-CVLAB/CoPoNeRF/models/backbone.py official repository unverified no licence file found · pointer only · 98fd7383ff77d328 · report
get_positional_encodings KU-CVLAB/CoPoNeRF/models/backbone.py official repository unverified no licence file found · pointer only · 9dae97e3e3b536da · report

Tasks

3D geometryCamera Pose EstimationNeRFNovel View SynthesisPose Estimation

Results from the paper archive 2025-07-28

No leaderboard rows for this paper in the archive.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections