Closed-set thermal face recognition via the synthesis approach

Oren Girshkin; Yitzhak Yitzhaky

doi:10.1117/12.2600521

12 September 2021 Closed-set thermal face recognition via the synthesis approach

Oren Girshkin, Yitzhak Yitzhaky

Proceedings Volume 11869, Counterterrorism, Crime Fighting, Forensics, and Surveillance Technologies V; 118690L (2021) https://doi.org/10.1117/12.2600521
Event: SPIE Security + Defence, 2021, Online Only

Abstract

Thermal face recognition has various applications in security, video-surveillance, military and government industries, etc. In contrast to the visible-light domain case, there is a lack of sufficiently large databases of thermal-face images. Therefore, it is difficult to construct a good face recognition system directly through learning procedures. We address this problem by using the synthesis approach, in which artificial visible-domain images of faces are generated from thermal face images and then identified in the visible-light domain. The generation of the artificial face images is done using a conditional Generative Adversarial Network, and the face identification is done by another, separate, deep neural network. Generating visible face images from thermal ones using DNNs requires large datasets of pairs of thermal and visible face images of the same persons, taken from the same position, time and imaging conditions, with two different cameras. The available datasets of such pairs are of relatively very low amount of subjects. Therefore, as in other similar studies, we approach this problem as a closed-set face recognition task, in which all testing identities are predefined in the training set. We train the face identification network itself using the synthesized images together with the original ground-truth visible-domain images to create a recognition system that is suitable to the characteristics of the artificially generated images. Thus, the recognition network will be optimized specifically for the thermal face recognition.

Conference Presentation

Citation Download Citation

Oren Girshkin and Yitzhak Yitzhaky "Closed-set thermal face recognition via the synthesis approach", Proc. SPIE 11869, Counterterrorism, Crime Fighting, Forensics, and Surveillance Technologies V, 118690L (12 September 2021); https://doi.org/10.1117/12.2600521

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available