Perceptual evaluation of colorized nighttime imagery

Alexander Toet; Michael J. de Jong; Maarten A. Hogervorst; Ignace T. C. Hooge

doi:10.1117/12.2042409

25 February 2014 Perceptual evaluation of colorized nighttime imagery

Alexander Toet, Michael J. de Jong, Maarten A. Hogervorst, Ignace T. C. Hooge

Proceedings Volume 9014, Human Vision and Electronic Imaging XIX; 901412 (2014) https://doi.org/10.1117/12.2042409
Event: IS&T/SPIE Electronic Imaging, 2014, San Francisco, California, United States

Abstract

We recently presented a color transform that produces fused nighttime imagery with a realistic color appearance (Hogervorst and Toet, 2010, Information Fusion, 11-2, 69-77). To assess the practical value of this transform we performed two experiments in which we compared human scene recognition for monochrome intensified (II) and longwave infrared (IR) imagery, and color daylight (REF) and fused multispectral (CF) imagery. First we investigated the amount of detail observers can perceive in a short time span (the gist of the scene). Participants watched brief image presentations and provided a full report of what they had seen. Our results show that REF and CF imagery yielded the highest precision and recall measures, while both II and IR imagery yielded significantly lower values. This suggests that observers have more difficulty extracting information from monochrome than from color imagery. Next, we measured eye fixations of participants who freely explored the images. Although the overall fixation behavior was similar across image modalities, the order in which certain details were fixated varied. Persons and vehicles were typically fixated first in REF, CF and IR imagery, while they were fixated later in II imagery. In some cases, color remapping II imagery and fusion with IR imagery restored the fixation order of these image details. We conclude that color remapping can yield enhanced scene perception compared to conventional monochrome nighttime imagery, and may be deployed to tune multispectral image representation such that the resulting fixation behavior resembles the fixation behavior for daylight color imagery.

Citation Download Citation

Alexander Toet, Michael J. de Jong, Maarten A. Hogervorst, and Ignace T. C. Hooge "Perceptual evaluation of colorized nighttime imagery", Proc. SPIE 9014, Human Vision and Electronic Imaging XIX, 901412 (25 February 2014); https://doi.org/10.1117/12.2042409

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available