Real-time viewpoint image synthesis using strips of multi-camera images

Munekazu Date; Hideaki Takada; Akira Kojima

doi:10.1117/12.2083011

17 March 2015 Real-time viewpoint image synthesis using strips of multi-camera images

Munekazu Date, Hideaki Takada, Akira Kojima

Proceedings Volume 9391, Stereoscopic Displays and Applications XXVI; 939109 (2015) https://doi.org/10.1117/12.2083011
Event: SPIE/IS&T Electronic Imaging, 2015, San Francisco, California, United States

Abstract

A real-time viewpoint image generation method is achieved. Video communications with a high sense of reality are needed to make natural connections between users at different places. One of the key technologies to achieve a sense of high reality is image generation corresponding to an individual user's viewpoint. However, generating viewpoint images requires advanced image processing, which is usually too heavy to use for real-time and low-latency purposes. In this paper we propose a real-time viewpoint image generation method using simple blending of multiple camera images taken at equal horizontal intervals and convergence obtained by using approximate information of an object's depth. An image generated from the nearest camera images is visually perceived as an intermediate viewpoint image due to the visual effect of depth-fused 3D (DFD). If the viewpoint is not on the line of the camera array, a viewpoint image could be generated by region splitting. We made a prototype viewpoint image generation system and achieved real-time full-frame operation for stereo HD videos. The users can see their individual viewpoint image for left-and-right and back-and-forth movement toward the screen. Our algorithm is very simple and promising as a means for achieving video communication with high reality.

Citation Download Citation

Munekazu Date, Hideaki Takada, and Akira Kojima "Real-time viewpoint image synthesis using strips of multi-camera images", Proc. SPIE 9391, Stereoscopic Displays and Applications XXVI, 939109 (17 March 2015); https://doi.org/10.1117/12.2083011

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available