Towards reconstructing HDR light fields by combining 2D and 3D CNN architectures

Mary Guindy; Adhikarla V. Kiran; Peter A. Kara; Tibor Balogh; Aniko Simon

doi:10.1117/12.2618993

31 May 2022 Towards reconstructing HDR light fields by combining 2D and 3D CNN architectures

Mary Guindy, Adhikarla V. Kiran, Peter A. Kara, Tibor Balogh, Aniko Simon

Proceedings Volume 12097, Big Data IV: Learning, Analytics, and Applications; 120970M (2022) https://doi.org/10.1117/12.2618993
Event: SPIE Defense + Commercial Sensing, 2022, Orlando, Florida, United States

Abstract

High dynamic range imaging has become a technological trend in the past couple of decades, particularly through its integration into many applications. Numerous attempts were made to reconstruct HDR images from lowdynamic-range data. Such reconstruction techniques can be classified into single-camera and multi-camera approaches. Single-camera setups are less expensive, yet multi-camera setups are more efficient. At the time of this paper, there is already a great number of algorithms for single-camera HDR image reconstruction, but there are only a few for HDR video reconstruction. The latter takes into account the temporal coherence between consecutive video frames, leading to better results. For light field images, this remains a challenging open issue, as the HDR video reconstruction methods do not work as efficiently for light field images as HDR image reconstruction algorithms do. However, analogously to 2D videos, where consecutive frames have temporal coherence, many similarities can be found between the adjacent views of light field contents. In this paper, we investigate the theoretical possibilities of combining CNN architectures utilized for HDR images and videos, in order to enhance the outputs of HDR light field image reconstruction. The concept of our work is to exploit the similarities between light field images since they all visualize the same scene from different angular perspectives.

Conference Presentation

Citation Download Citation

Mary Guindy, Adhikarla V. Kiran, Peter A. Kara, Tibor Balogh, and Aniko Simon "Towards reconstructing HDR light fields by combining 2D and 3D CNN architectures", Proc. SPIE 12097, Big Data IV: Learning, Analytics, and Applications, 120970M (31 May 2022); https://doi.org/10.1117/12.2618993

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available