Empirical comparison of robustness of classifiers on IR imagery

Peng Zhang; Jing Peng; Kun Zhang; S. Richard F. Sims

doi:10.1117/12.604163

19 May 2005 Empirical comparison of robustness of classifiers on IR imagery

Peng Zhang, Jing Peng, Kun Zhang, S. Richard F. Sims

Proceedings Volume 5807, Automatic Target Recognition XV; (2005) https://doi.org/10.1117/12.604163
Event: Defense and Security, 2005, Orlando, Florida, United States

Abstract

Many classifiers have been proposed for ATR applications. Given a set of training data, a classifier is built from the labeled training data, and then applied to predict the label of a new test point. If there is enough training data, and the test points are drawn from the same distribution (i.i.d.) as training data, then many classifiers perform quite well. However, in reality, there will never be enough training data or with limited computational resources we can only use part of the training data. Likewise, the distribution of new test points might be different from that of the training data, whereby the training data is not representative of the test data. In this paper, we empirically compare several classifiers, namely support vector machines, regularized least squares classifiers, C4.4, C4.5, random decision trees, bagged C4.4, and bagged C4.5 on IR imagery. We reduce the training data by half (less representative of the test data) each time and evaluate the resulting classifiers on the test data. This allows us to assess the robustness of classifiers against a varying knowledge base. A robust classifier is the one whose accuracy is the least sensitive to changes in the training data. Our results show that ensemble methods (random decision trees, bagged C4.4 and bagged C4.5) outlast single classifiers as the training data size decreases.

Citation Download Citation

Peng Zhang, Jing Peng, Kun Zhang, and S. Richard F. Sims "Empirical comparison of robustness of classifiers on IR imagery", Proc. SPIE 5807, Automatic Target Recognition XV, (19 May 2005); https://doi.org/10.1117/12.604163

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available