Performance metrics as aids for fusion algorithm validation

Richard D. Teichgraeber

doi:10.1117/12.543448

25 August 2004 Performance metrics as aids for fusion algorithm validation

Richard D. Teichgraeber

Proceedings Volume 5428, Signal and Data Processing of Small Targets 2004; (2004) https://doi.org/10.1117/12.543448
Event: Defense and Security, 2004, Orlando, Florida, United States

Abstract

Performance Metrics (PMs) may be used to evaluate correlation and fusion algorithm performance, particularly in conjunction with Monte Carlo runs of candidate algorithms. These PMs, in some cases, have been used for many years by researchers; less often in industry applications. A survey of recent literature in tracking and fusion shows there are many PMs from which to choose. A few of the more popular metrics include: percent of miscorrelations, percent of correct correlations, total tracking time (tracking persistence), time on target, and percent of total targets tracked and correlated. These types of statistics may be obtained from Monte Carlo simulation test runs. Determination of and access to the truth data for comparison purposes are only part of the problem when using a performance metric. A versatile test tool which can be tailored to the application is also essential. Use of Monte Carlo simulation test results to compute performance metrics is reviewed. Recent experience with PM usage in algorithm development projects is recounted in case studies with appropriate tables and charts. Factors affecting algorithm performance and hence, PM values are considered and discussed. Several questions are posed (and partly answered) regarding ultimate use of PM results.

Citation Download Citation

Richard D. Teichgraeber "Performance metrics as aids for fusion algorithm validation", Proc. SPIE 5428, Signal and Data Processing of Small Targets 2004, (25 August 2004); https://doi.org/10.1117/12.543448

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available