Quantifying uncertainty in machine learning for hyperspectral target detection and identification

Natalie Klein; Adra Carr; Zigfried Hampel-Arias; Amanda Ziemann; Eric Flynn; Kevin Mitchell

doi:10.1117/12.2622926

31 May 2022 Quantifying uncertainty in machine learning for hyperspectral target detection and identification

Natalie Klein, Adra Carr, Zigfried Hampel-Arias, Amanda Ziemann, Eric Flynn, Kevin Mitchell

Proceedings Volume 12094, Algorithms, Technologies, and Applications for Multispectral and Hyperspectral Imaging XXVIII; 120940B (2022) https://doi.org/10.1117/12.2622926
Event: SPIE Defense + Commercial Sensing, 2022, Orlando, Florida, United States

Abstract

Machine learning approaches, such as deep neural networks, have shown recent success for target detection and identification problems in hyperspectral imagery. However, when deployed “in the wild,” there are no guarantees about the behavior of these black box algorithms when encountering new materials or environmental conditions that were not part of the training data. In addition, neural networks typically lack properties of linear identification methods in that their predictions tend to select a single class with high confidence even when there are multiple classes that could match a given input spectrum. To provide estimates of confidence in neural network predictions (i.e., target identifications) and to produce indicators of uncertainty, we apply stateof-the-art uncertainty quantification techniques to neural networks trained on hyperspectral data. Specifically, we assess recently proposed methods from the machine learning community including Monte Carlo dropout, ensembles of neural networks, and variational Bayesian neural networks. We report not only the accuracy of the resulting model-averaged networks on in-distribution data, but also the usefulness of uncertainty metrics on noisy or out-of-distribution data. We also compare ensemble neural network target identification results to a linear method on airborne long-wave infrared (LWIR) hyperspectral data with real targets. Finally, we offer some guidelines for applying these methods to hyperspectral target detection/identification problems.

Conference Presentation

Citation Download Citation

Natalie Klein, Adra Carr, Zigfried Hampel-Arias, Amanda Ziemann, Eric Flynn, and Kevin Mitchell "Quantifying uncertainty in machine learning for hyperspectral target detection and identification", Proc. SPIE 12094, Algorithms, Technologies, and Applications for Multispectral and Hyperspectral Imaging XXVIII, 120940B (31 May 2022); https://doi.org/10.1117/12.2622926

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available