Evaluation of the generated visible-to-infrared images using CycleGAN and Pix2Pix based on pre-sorted AVIID-3 dataset

Xiaolu Zhan; Shaozhe Cui; Guojin Feng; Qi Zang; Zuo Chen; Wende Liu; Yongsheng Lv; Haiyong Gan

doi:10.1117/12.3037099

4 December 2024 Evaluation of the generated visible-to-infrared images using CycleGAN and Pix2Pix based on pre-sorted AVIID-3 dataset

Xiaolu Zhan, Shaozhe Cui, Guojin Feng, Qi Zang, Zuo Chen, Wende Liu, Yongsheng Lv, Haiyong Gan

Author Affiliations +

Proceedings Volume 13283, Conference on Spectral Technology and Applications (CSTA 2024); 132833C (2024) https://doi.org/10.1117/12.3037099
Event: Conference on Spectral Technology and Applications (CSTA 2024), 2024, Dalian, China

Abstract

The infrared cameras capture images based on the infrared radiation energy. In fact, the sensor's reception of this radiation is affected by various factors, such as the emissivity and reflectivity of the target surface, the temperatures of both the environment and the target, the radiation intensity of the environment, and the heat dissipation effects. When using GANs (Generative Adversarial Networks) for visible-to-infrared image generation for different targets, it is not possible to analyze the target differences in feature transformation for different targets using overall image quality evaluation metrics, such as MSE (Mean Squared Error). This paper focuses on four typical targets from the AVIID-3 dataset and employs the rotational object detection network YOLOv8 OBB (YOLOv8 Oriented Bounding Boxes) as an evaluation tool. By comparing the absolute values of the mAP (Mean Average Precision) differences in YOLOv8 OBB detection between the CycleGAN and Pix2Pix generated visible-to-infrared targets and the real infrared targets, we evaluate the visible-to-infrared generation effects for the four types of targets. Additionally, this paper proposes an optimal generation strategy for the four typical targets without altering the network structure.

(2024) Published by SPIE. Downloading of the abstract is permitted for personal use only.

Citation Download Citation

Xiaolu Zhan, Shaozhe Cui, Guojin Feng, Qi Zang, Zuo Chen, Wende Liu, Yongsheng Lv, and Haiyong Gan "Evaluation of the generated visible-to-infrared images using CycleGAN and Pix2Pix based on pre-sorted AVIID-3 dataset", Proc. SPIE 13283, Conference on Spectral Technology and Applications (CSTA 2024), 132833C (4 December 2024); https://doi.org/10.1117/12.3037099

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

;

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $17.00

Non-members: $21.00 ADD TO CART

PROCEEDINGS
9 PAGES

DOWNLOAD PAPER SAVE TO MY LIBRARY

GET CITATION

RIGHTS & PERMISSIONS

Get copyright permission Get copyright permission on Copyright Marketplace

KEYWORDS

Infrared radiation

Infrared imaging

Object detection

Target detection

Infrared detectors

Thermal modeling

Visible radiation

Keywords/Phrases

Search In:

Publication Years