Depth map upscaling through edge-weighted optimization

Sebastian Schwarz; Mårten Sjöström; Roger Olsson

doi:10.1117/12.903921

30 January 2012 Depth map upscaling through edge-weighted optimization

Sebastian Schwarz, Mårten Sjöström, Roger Olsson

Proceedings Volume 8290, Three-Dimensional Image Processing (3DIP) and Applications II; 829008 (2012) https://doi.org/10.1117/12.903921
Event: IS&T/SPIE Electronic Imaging, 2012, Burlingame, California, United States

Abstract

Accurate depth maps are a pre-requisite in three-dimensional television, e.g. for high quality view synthesis, but this information is not always easily obtained. Depth information gained by correspondence matching from two or more views suffers from disocclusions and low-texturized regions, leading to erroneous depth maps. These errors can be avoided by using depth from dedicated range sensors, e.g. time-of-flight sensors. Because these sensors only have restricted resolution, the resulting depth data need to be adjusted to the resolution of the appropriate texture frame. Standard upscaling methods provide only limited quality results. This paper proposes a solution for upscaling low resolution depth data to match high resolution texture data. We introduce We introduce the Edge Weighted Optimization Concept (EWOC) for fusing low resolution depth maps with corresponding high resolution video frames by solving an overdetermined linear equation system. Similar to other approaches, we take information from the high resolution texture, but additionally validate this information with the low resolution depth to accentuate correlated data. Objective tests show an improvement in depth map quality in comparison to other upscaling approaches. This improvement is subjectively confirmed in the resulting view synthesis.

Citation Download Citation

Sebastian Schwarz, Mårten Sjöström, and Roger Olsson "Depth map upscaling through edge-weighted optimization", Proc. SPIE 8290, Three-Dimensional Image Processing (3DIP) and Applications II, 829008 (30 January 2012); https://doi.org/10.1117/12.903921

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available