A differential geometry approach to camera-independent image correspondence

Molnár, József and Eichhardt, Iván (2018) A differential geometry approach to camera-independent image correspondence. COMPUTER VISION AND IMAGE UNDERSTANDING, 169. pp. 90-107. ISSN 1077-3142 10.1016/j.cviu.2018.02.005

[img] Text
Molnar_90_3364430_z.pdf
Restricted to Registered users only

Download (2MB) | Request a copy

Abstract

Projective geometry is a standard mathematical tool for image-based 3D reconstruction. Most reconstruction methods establish pointwise image correspondences using projective geometry. We present an alternative approach based on differential geometry using oriented patches rather than points. Our approach assumes that the scene to be reconstructed is observed by any camera, existing or potential, that satisfies very general conditions, namely, the differentiability of the surface and the bijective projection functions. We show how the notions of the differential geometry such as diffeomorphism, pushforward and pullback are related to the reconstruction problem. A unified theory applicable to various 3D reconstruction problems is presented. Considering two views of the surface, we derive reconstruction equations for oriented patches and pose equations to determine the relative pose of the two cameras. Then we discuss the generalized epipolar geometry and derive the generalized epipolar constraint (compatibility equation) along the epipolar curves. Applying the proposed theory to the projective camera and assuming that affine mapping between small corresponding regions has been estimated, we obtain the minimal pose equation for the case when a fully calibrated camera is moved with its internal parameters unchanged. Equations for the projective epipolar constraints and the fundamental matrix are also derived. Finally, two important nonlinear camera types, the axial and the spherical, are examined. © 2018 Elsevier Inc.

Item Type: Article
Uncontrolled Keywords: GEOMETRY; Epipolar geometry; surface reconstruction; image reconstruction; image processing; Cameras; UNIFIED THEORY; Generalized epipolar geometry; Fundamental matrix; Epipolar constraints; differential geometry; Camera-independent approach
Subjects: Q Science > QA Mathematics and Computer Science > QA75 Electronic computers. Computer science / számítástechnika, számítógéptudomány
Divisions: Distributed Events Analysis Research Laboratory
SWORD Depositor: MTMT Injector
Depositing User: MTMT Injector
Date Deposited: 06 Sep 2018 07:26
Last Modified: 06 Sep 2018 07:26
URI: https://eprints.sztaki.hu/id/eprint/9415

Update Item Update Item