Temporal consistent depth map upscaling for 3DTV

Sebastian Schwarz; Mårten Sjöström; Roger Olsson

doi:10.1117/12.2032697

6 March 2014 Temporal consistent depth map upscaling for 3DTV

Sebastian Schwarz, Mårten Sjöström, Roger Olsson

Proceedings Volume 9013, Three-Dimensional Image Processing, Measurement (3DIPM), and Applications 2014; 901302 (2014) https://doi.org/10.1117/12.2032697
Event: IS&T/SPIE Electronic Imaging, 2014, San Francisco, California, United States

Abstract

The ongoing success of three-dimensional (3D) cinema fuels increasing efforts to spread the commercial success of 3D to new markets. The possibilities of a convincing 3D experience at home, such as three-dimensional television (3DTV), has generated a great deal of interest within the research and standardization community. A central issue for 3DTV is the creation and representation of 3D content. Acquiring scene depth information is a fundamental task in computer vision, yet complex and error-prone. Dedicated range sensors, such as the Time of-Flight camera (ToF), can simplify the scene depth capture process and overcome shortcomings of traditional solutions, such as active or passive stereo analysis. Admittedly, currently available ToF sensors deliver only a limited spatial resolution. However, sophisticated depth upscaling approaches use texture information to match depth and video resolution. At Electronic Imaging 2012 we proposed an upscaling routine based on error energy minimization, weighted with edge information from an accompanying video source. In this article we develop our algorithm further. By adding temporal consistency constraints to the upscaling process, we reduce disturbing depth jumps and flickering artifacts in the final 3DTV content. Temporal consistency in depth maps enhances the 3D experience, leading to a wider acceptance of 3D media content. More content in better quality can boost the commercial success of 3DTV.

Citation Download Citation

Sebastian Schwarz, Mårten Sjöström, and Roger Olsson "Temporal consistent depth map upscaling for 3DTV", Proc. SPIE 9013, Three-Dimensional Image Processing, Measurement (3DIPM), and Applications 2014, 901302 (6 March 2014); https://doi.org/10.1117/12.2032697

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available