Two-step method for geometry reconstruction using differentiable rendering

Anatoly I. Lysykh; Dmitry D. Zhdanov; Andrei D. Zhdanov

doi:10.1117/12.3036450

22 November 2024 Two-step method for geometry reconstruction using differentiable rendering

Anatoly I. Lysykh, Dmitry D. Zhdanov, Andrei D. Zhdanov

Author Affiliations +

Proceedings Volume 13239, Optoelectronic Imaging and Multimedia Technology XI; 132390H (2024) https://doi.org/10.1117/12.3036450
Event: SPIE/COS Photonics Asia, 2024, Nantong, Jiangsu, China

Abstract

The task of reconstructing real-world objects arises in many areas of human life. Inverse rendering methods show high efficiency in solving this problem. For accurate reconstruction of object geometry from a set of images, we propose a geometry reconstruction method based on differentiable rendering. This method consists of two steps: forming a bounding volume and optimizing the geometry. To achieve high-speed geometry reconstruction, we suggest reducing the time spent on optimizing the silhouette gradients by conducting an initial stage of constructing the bounding volume of the object. The article considers the possibility of using three-dimensional visual hulls as a primary representation for optimizing geometry using differentiable rendering methods. Introducing this stage of geometry reconstruction allows the inverse rendering to start with the condition of matching the reconstructed object's contour and topology. Thus, geometry optimization occurs considering shading gradients, eliminating the need to account for object silhouette gradients. The proposed approach solves the problem related to potential distortion of the object's geometry, such as normal inversion or self-intersecting triangles. The paper presents the results of applying the proposed method to reconstruct test objects from image sets and demonstrates the increase in accuracy of geometry reconstruction.

(2024) Published by SPIE. Downloading of the abstract is permitted for personal use only.

Citation Download Citation

Anatoly I. Lysykh, Dmitry D. Zhdanov, and Andrei D. Zhdanov "Two-step method for geometry reconstruction using differentiable rendering", Proc. SPIE 13239, Optoelectronic Imaging and Multimedia Technology XI, 132390H (22 November 2024); https://doi.org/10.1117/12.3036450

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

;

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $17.00

Non-members: $21.00 ADD TO CART

PROCEEDINGS
11 PAGES

DOWNLOAD PAPER SAVE TO MY LIBRARY

GET CITATION

RIGHTS & PERMISSIONS

Get copyright permission Get copyright permission on Copyright Marketplace

KEYWORDS

Visualization

Cameras

Image segmentation

Reconstruction algorithms

Neural networks

Image restoration

Mathematical optimization

Show All Keywords

Keywords/Phrases

Search In:

Publication Years