Three dimensional reconstruction using a lenslet light field camera

Wentao Zhang; Shengqian Chang; Xiao Tao; Chang Wang; Chenning Tao; Peizheng Huang; Zhenrong Zheng

doi:10.1117/12.2319552

17 September 2018 Three dimensional reconstruction using a lenslet light field camera

Wentao Zhang, Shengqian Chang, Xiao Tao, Chang Wang, Chenning Tao, Peizheng Huang, Zhenrong Zheng

Proceedings Volume 10752, Applications of Digital Image Processing XLI; 1075209 (2018) https://doi.org/10.1117/12.2319552
Event: SPIE Optical Engineering + Applications, 2018, San Diego, California, United States

Abstract

A novel method is proposed in this paper to accurately reconstruct the three-dimensional scenes by using a passive single-shot exposure with a lenslet light field camera. This method has better performance of 3D scenes reconstruction with both defocus and disparity depth cues captured by light field camera. First, the light field data is used to refocus and shift viewpoints to get a focal stack and multi-view images. In refocusing procedure, the phase shift theorem in the Fourier domain is first introduced to substitute shift in spatial domain, and sharper focal stacks can be obtained with less blurriness. Thus, 3D scenes can be reconstructed more accurately. Next, through multi-view images, disparity depth cues are obtained by performing correspondence measure. Then, the focal stack is used to compute defocus depth cues by focus measure based on gray variance. Finally, the focus cost is built to integrate both defocus and disparity depth cues, and the accurate depth map is estimated by using Graph Cuts based on the focus cost. Using this accurate depth map and all-in-focus image, the 3D structure in real world are accurately reconstructed. Our method is verified by a number of synthetic and real-world examples captured with a dense camera array and a Lytro light field camera.

Conference Presentation

Citation Download Citation

Wentao Zhang, Shengqian Chang, Xiao Tao, Chang Wang, Chenning Tao, Peizheng Huang, and Zhenrong Zheng "Three dimensional reconstruction using a lenslet light field camera", Proc. SPIE 10752, Applications of Digital Image Processing XLI, 1075209 (17 September 2018); https://doi.org/10.1117/12.2319552

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available