A study of colored point cloud completion for a human head

Yuki Ishida; Yoshitsugu Manabe; Noriko Yata

doi:10.1117/12.2626073

30 April 2022 A study of colored point cloud completion for a human head

Yuki Ishida, Yoshitsugu Manabe, Noriko Yata

Proceedings Volume 12177, International Workshop on Advanced Imaging Technology (IWAIT) 2022; 121772A (2022) https://doi.org/10.1117/12.2626073
Event: International Workshop on Advanced Imaging Technology 2022 (IWAIT 2022), 2022, Hong Kong, China

Abstract

A depth image of a single RGBD camera has many occlusions and noises, so it is not easy to obtain 3D data of the whole human head. Point cloud deep learning has recently attracted much attention, which allows direct input and output of point clouds. One of them, the point cloud completion, which creates a complete point cloud from a partial point cloud, has been studied. However, existing studies of point cloud completion evaluated only the shape and have not focused on colored point clouds. Therefore, this study proposes a colored point cloud completion method for the human head based on machine learning. For deep learning training, the CG dataset was created from the face and hair dataset. The proposed network inputs and outputs point cloud with XYZ coordinates, and 𝐿 ∗𝑎 ∗𝑏 ∗ color information optionally has a Discriminator that processes 𝐿 ∗𝑎 ∗𝑏 ∗ -D images by a differentiable point renderer. This study experimented using the network and the dataset and evaluated using point domain and image domain metrics.

Citation Download Citation

Yuki Ishida, Yoshitsugu Manabe, and Noriko Yata "A study of colored point cloud completion for a human head", Proc. SPIE 12177, International Workshop on Advanced Imaging Technology (IWAIT) 2022, 121772A (30 April 2022); https://doi.org/10.1117/12.2626073

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available