XSlit cameras for free navigation with depth image-based rendering

Sarah Fachada; Gauthier Lafruit

doi:10.1117/12.2553069

30 March 2020 XSlit cameras for free navigation with depth image-based rendering

Sarah Fachada, Gauthier Lafruit

Proceedings Volume 11350, Digital Optics for Immersive Displays II; 113500A (2020) https://doi.org/10.1117/12.2553069
Event: SPIE Photonics Europe, 2020, Online Only

Abstract

In free navigation applications, any viewpoint to a three-dimensional scene can be synthesized through Depth Image-Based Rendering (DIBR). In this paper we show that XSlit cameras achieve up to 3 dB PSNR gain over conventional pinhole camera arrays when synthesizing virtual views to the scene with DIBR for small camera displacements. XSlit cameras are a type of general linear cameras where the light rays pass through two non-intersecting slits instead of a single point (the optical center of conventional cameras), resulting in a different epipolar geometry and projection equations. Instead of synthesizing virtual views with DIBR from a set of conventional pinhole cameras, e.g. a stereo camera pair, a single XSlit camera exploits the distance between its slits and their relative rotation to obtain disparity, out of which DIBR virtual views can be synthesized. We first present a theoretical study to present the parameters of XSlit cameras, different from pinhole cameras, at the same time making sure that the XSlit camera is physically implementable. We then validate the study with DIBR achieved on synthetic content using perfect depth maps obtained from an in-house modified version of Blender’s engine Cycles to simulate XSlit cameras. The virtual view synthesis uses an adapted version of the Reference View Synthesis software used in MPEG, the worldwide standardization committee for media compression. Our experiments show that for the same overall space covered by the studied camera architectures, XSlit cameras often obtain better DIBR view synthesis results, with up to 3 dB PSNR gain.

Conference Presentation

Citation Download Citation

Sarah Fachada and Gauthier Lafruit "XSlit cameras for free navigation with depth image-based rendering", Proc. SPIE 11350, Digital Optics for Immersive Displays II, 113500A (30 March 2020); https://doi.org/10.1117/12.2553069

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available