Deep learning approach for creating the natural vergence-accommodation conditions in virtual and mixed reality systems

German Gebel; Andrey Zhdanov; Igor Kinev; Dmitry Zhdanov; Igor Potemin; Yan Wang

doi:10.1117/12.2644156

4 January 2023 Deep learning approach for creating the natural vergence-accommodation conditions in virtual and mixed reality systems

German Gebel, Andrey Zhdanov, Igor Kinev, Dmitry Zhdanov, Igor Potemin, Yan Wang

Author Affiliations +

Proceedings Volume 12317, Optoelectronic Imaging and Multimedia Technology IX; 123171B (2023) https://doi.org/10.1117/12.2644156
Event: SPIE/COS Photonics Asia, 2022, Online Only

Conference Poster

Abstract

A study was made of the causes of the vergence-accommodation conflict of human vision in virtual and mixed reality systems. The technical and algorithmic approaches to reduce and eliminate the vergence-accommodation conflict in virtual reality systems are considered. As a technical solution, an approach was chosen that provides adaptive focusing of the eyepiece of the virtual reality system to the point of convergence of the human eyes, determined by the tracking system of his pupils. Possible algorithmic solutions are considered that provide focusing of the virtual reality image in accordance with the expected accommodation of human eyes. The main solutions are the classical solution of image filtering in accordance with the defocusing caused by natural accommodation at a given distance, and the solution in which the corresponding filtering is performed using neural network technologies. The advantages and disadvantages of the proposed solutions are considered. As a criterion of correctness, we used a visual comparison of the results of image defocusing with the solution obtained by the method of physically correct rendering using the human eye model. As a basis for physically correct rendering, the method of bidirectional stochastic ray tracing with backward photon maps was used. The paper presents an analysis of the advantages and disadvantages of the proposed solutions.

Conference Presentation

Citation Download Citation

German Gebel, Andrey Zhdanov, Igor Kinev, Dmitry Zhdanov, Igor Potemin, and Yan Wang "Deep learning approach for creating the natural vergence-accommodation conditions in virtual and mixed reality systems", Proc. SPIE 12317, Optoelectronic Imaging and Multimedia Technology IX, 123171B (4 January 2023); https://doi.org/10.1117/12.2644156

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available