Real-time integral imaging pickup system using camera array

Yan Xing; Zhao-Long Xiong; Min Zhao; Qiong-Hua Wang

doi:10.1117/12.2286089

19 February 2018 Real-time integral imaging pickup system using camera array

Yan Xing, Zhao-Long Xiong, Min Zhao, Qiong-Hua Wang

Proceedings Volume 10556, Advances in Display Technologies VIII; 105560D (2018) https://doi.org/10.1117/12.2286089
Event: SPIE OPTO, 2018, San Francisco, California, United States

Abstract

Three-dimensional (3D) information acquirement in integral imaging (II) is becoming popular with the development of inexpensive digital image sensors. In this study, we present a real-time II pickup system in which multiple video streams are recorded, compressed, transmitted, and synthesized for II display. The system consists of an 8×8 network camera array, three Gigabit Ethernet switches, a single PC, and an II display. With the help of multi-thread technology, multi-view video streams from the network camera array are first captured in real-time. Then, we adopt camera array calibration and image alignment methods based on planar parallax to achieve good image quality. Finally, the aligned video streams are interweaved to synthesize the elemental image array (EIA) for the II display. We also present a remapping algorithm to accelerate the generation of the EIA. In the remapping algorithm, the mapping matrices from original parallaxes to the EIA are directly calculated. Therefore, the camera array calibration process, the parallax alignment process and the synthesizing process are simplified into a simple remapping operation. The video stream processing is fully performed on a graphics processing unit (GPU). Our proposed system achieves high-quality II video rendering at up to 37fps depending on rendering parameters. Experimental results verify the feasibility of the proposed system and high-quality EIAs synthesized from dynamic 3D scene.

Citation Download Citation

Yan Xing, Zhao-Long Xiong, Min Zhao, and Qiong-Hua Wang "Real-time integral imaging pickup system using camera array", Proc. SPIE 10556, Advances in Display Technologies VIII, 105560D (19 February 2018); https://doi.org/10.1117/12.2286089

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $17.00

Non-members: $21.00 ADD TO CART

PROCEEDINGS
7 PAGES

DOWNLOAD PAPER SAVE TO MY LIBRARY

GET CITATION

RIGHTS & PERMISSIONS

Get copyright permission Get copyright permission on Copyright Marketplace

KEYWORDS

Cameras

Video

Video acceleration

Imaging systems

3D image processing

3D displays

Calibration

Show All Keywords

Keywords/Phrases

Search In:

Publication Years