A novel sparse-to-dense depth map generation framework for monocular videos

Runze Zhang; Zhiguo Cao; Qian Zhang; Yang Xiao; Ruibo Li

doi:10.1117/12.2269885

26 June 2017 A novel sparse-to-dense depth map generation framework for monocular videos

Runze Zhang, Zhiguo Cao, Qian Zhang, Yang Xiao, Ruibo Li

Proceedings Volume 10334, Automated Visual Inspection and Machine Vision II; 103340H (2017) https://doi.org/10.1117/12.2269885
Event: SPIE Optical Metrology, 2017, Munich, Germany

Abstract

Generally, the process of monocular depth map generation consists of two stages: structure from motion and multi-view stereo. The multi-view stereo relies on the accuracy of the estimated camera pose and the photo-consistency assumption. However, the current methods cannot tackle the multi-view matching problem well because of the dependence on the accurate camera pose as well as the matching uncertainty. In this paper, to handle these issues, a new sparse-to-dense diffusion framework is put forward. First, the scene information is reconstructed from SFM (Structure From Motion) and the sparse point cloud is available instead of the camera pose. Secondly, the sparse depth point is re-projected to every frame as the depth label. Finally, the depth label is spread to the remaining pixels through a diffusion process. In addition, the edge detectors are used to make the propagation better-regulated. Experimentally, the results show that the proposed framework can robustly generate the depth map from monocular videos.

Citation Download Citation

Runze Zhang, Zhiguo Cao, Qian Zhang, Yang Xiao, and Ruibo Li "A novel sparse-to-dense depth map generation framework for monocular videos", Proc. SPIE 10334, Automated Visual Inspection and Machine Vision II, 103340H (26 June 2017); https://doi.org/10.1117/12.2269885

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available