Using performance efficiency for testing and optimization of visual attention models

Brian J. Stankiewicz; Nathan J. Anderson; Richard J. Moore

doi:10.1117/12.872388

24 January 2011 Using performance efficiency for testing and optimization of visual attention models

Brian J. Stankiewicz, Nathan J. Anderson, Richard J. Moore

Proceedings Volume 7867, Image Quality and System Performance VIII; 78670Y (2011) https://doi.org/10.1117/12.872388
Event: IS&T/SPIE Electronic Imaging, 2011, San Francisco Airport, California, United States

Abstract

When developing a predictive tool for human performance one needs to have clear metrics to evaluate the model's performance. In the area of Visual Attention Modeling (VAM) one typically compares eye-tracking data collected on a group of human observers to the predictions made by a model. To evaluate the performance of these models one typically uses signal detection (Receiver Operating Characteristic (ROC)) that measures the predictive power of the system by comparing the model's predictions for an image to human eye tracking data. These ROC curves take into account the model's hit and false alarm rates and by averaging over a set of test images provides a final measure of the system's performance. In releasing a commercial visual attention system, we have spent considerable effort in developing metrics that allow for regression testing, that are useful for optimizing our visual attention model that takes into account the Upper-Theoretical Performance Limit for an image or classes of images. We describe how the Upper- Theoretical Performance Limit is calculated and how regression testing and parameter optimization benefit from this approach.

Citation Download Citation

Brian J. Stankiewicz, Nathan J. Anderson, and Richard J. Moore "Using performance efficiency for testing and optimization of visual attention models", Proc. SPIE 7867, Image Quality and System Performance VIII, 78670Y (24 January 2011); https://doi.org/10.1117/12.872388

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available