Multiview interpolation for ray-space coding

Koji Yamanaka; Tomohiro Yendo; Toshiaki Fujii; Masayuki Tanimoto

doi:10.1117/12.630378

15 November 2005 Multiview interpolation for ray-space coding

Koji Yamanaka, Tomohiro Yendo, Toshiaki Fujii, Masayuki Tanimoto

Proceedings Volume 6016, Three-Dimensional TV, Video, and Display IV; 60160D (2005) https://doi.org/10.1117/12.630378
Event: Optics East 2005, 2005, Boston, MA, United States

Abstract

This paper proposes a novel multiple-image coding technique using Ray-Space interpolation. Ray-Space, an image-based rendering technique to generate arbitrary views from multiple cameras, describes three- dimensional space based on only ray information from a large number of cameras. Therefore, data compression is needed. We leverage the correlation of time and space aiming for high compression. H.264/AVC is employed for dynamic image coding, and studies have been conducted on using the AVC in time domain. Here we propose a novel algorithm that uses view-interpolation for coding in space domain. Interpolation is a method to generate the middle view in a stereoscopic setup. By generating interpolated images from coded images as reference ones, coding performance should give better results. Therefore, interpolation accuracy is important for coding performance. In this paper, we propose an interpolation technique using geometric information in a linear camera arrangement. By calculating the trace of each point considering camera arrangement, and obtaining its corresponding point, the middle image is generated. In so doing, the interpolation method is an intensity-based scheme, constrained by smoothness in disparity domain. Experiment of coding using interpolation outperforms the standard AVC by 1~2 dB in all bitrates. Moreover, we deal with occlusion regions by means of extrapolation using four images. To detect occlusion regions, we use two criteria, one is minimum error, second is ratio of minimum error between four images. In occlusion region, the intensity of middle image is generated using extrapolated images. This method gives up to 1~3 dB improvement compared to occlusion-ignored algorithm.

Citation Download Citation

Koji Yamanaka, Tomohiro Yendo, Toshiaki Fujii, and Masayuki Tanimoto "Multiview interpolation for ray-space coding", Proc. SPIE 6016, Three-Dimensional TV, Video, and Display IV, 60160D (15 November 2005); https://doi.org/10.1117/12.630378

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $17.00

Non-members: $21.00 ADD TO CART

PROCEEDINGS
10 PAGES

DOWNLOAD PAPER SAVE TO MY LIBRARY

GET CITATION

RIGHTS & PERMISSIONS

Get copyright permission Get copyright permission on Copyright Marketplace

KEYWORDS

Cameras

Image compression

Image processing

Data compression

3D acquisition

3D modeling

Distortion

Show All Keywords

Keywords/Phrases

Search In:

Publication Years