Improved inter-layer prediction for light field content coding with display scalability

Caroline Conti; Luís Ducla Soares; Paulo Nunes

doi:10.1117/12.2237198

27 September 2016 Improved inter-layer prediction for light field content coding with display scalability

Caroline Conti, Luís Ducla Soares, Paulo Nunes

Proceedings Volume 9971, Applications of Digital Image Processing XXXIX; 99710P (2016) https://doi.org/10.1117/12.2237198
Event: SPIE Optical Engineering + Applications, 2016, San Diego, California, United States

Abstract

Light field imaging based on microlens arrays – also known as plenoptic, holoscopic and integral imaging – has recently risen up as feasible and prospective technology due to its ability to support functionalities not straightforwardly available in conventional imaging systems, such as: post-production refocusing and depth of field changing. However, to gradually reach the consumer market and to provide interoperability with current 2D and 3D representations, a display scalable coding solution is essential. In this context, this paper proposes an improved display scalable light field codec comprising a three-layer hierarchical coding architecture (previously proposed by the authors) that provides interoperability with 2D (Base Layer) and 3D stereo and multiview (First Layer) representations, while the Second Layer supports the complete light field content. For further improving the compression performance, novel exemplar-based inter-layer coding tools are proposed here for the Second Layer, namely: (i) an inter-layer reference picture construction relying on an exemplar-based optimization algorithm for texture synthesis, and (ii) a direct prediction mode based on exemplar texture samples from lower layers. Experimental results show that the proposed solution performs better than the tested benchmark solutions, including the authors’ previous scalable codec.

Conference Presentation

Citation Download Citation

Caroline Conti, Luís Ducla Soares, and Paulo Nunes "Improved inter-layer prediction for light field content coding with display scalability", Proc. SPIE 9971, Applications of Digital Image Processing XXXIX, 99710P (27 September 2016); https://doi.org/10.1117/12.2237198

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available