Joint tone mapping and denoising of thermal infrared images via multi-scale Retinex and multi-task learning

Axel Gödrich; Daniel König; Gabriel Eilertsen; Michael Teutsch

doi:10.1117/12.2663745

13 June 2023 Joint tone mapping and denoising of thermal infrared images via multi-scale Retinex and multi-task learning

Axel Gödrich, Daniel König, Gabriel Eilertsen, Michael Teutsch

Author Affiliations +

Proceedings Volume 12534, Infrared Technology and Applications XLIX; 1253417 (2023) https://doi.org/10.1117/12.2663745
Event: SPIE Defense + Commercial Sensing, 2023, Orlando, Florida, United States

Abstract

Cameras digitize real-world scenes as pixel intensity values with a limited value range given by the available bits per pixel (bpp). High Dynamic Range (HDR) cameras capture those luminance values in higher resolution through an increase in the number of bpp. Most displays, however, are limited to 8 bpp. Naïve HDR compression methods lead to a loss of the rich information contained in those HDR images. In this paper, tone mapping algorithms for thermal infrared images with 16 bpp are investigated that can preserve this information. An optimized multi-scale Retinex algorithm sets the baseline. This algorithm is then approximated with a deep learning approach based on the popular U-Net architecture. The remaining noise in the images after tone mapping is reduced implicitly by utilizing a self-supervised deep learning approach that can be jointly trained with the tone mapping approach in a multi-task learning scheme. Further discussions are provided on denoising and deflickering for thermal infrared video enhancement in the context of tone mapping. Extensive experiments on the public FLIR ADAS Dataset prove the effectiveness of our proposed method in comparison with the state-of-the-art.

Conference Presentation

Citation Download Citation

Axel Gödrich, Daniel König, Gabriel Eilertsen, and Michael Teutsch "Joint tone mapping and denoising of thermal infrared images via multi-scale Retinex and multi-task learning", Proc. SPIE 12534, Infrared Technology and Applications XLIX, 1253417 (13 June 2023); https://doi.org/10.1117/12.2663745

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available