START for evaluation of target detection and tracking

Scott K. Ralph; Mark R. Stevens; John Irvine; Jeremy Marvel; Magnús Snorrason; Andrew Rice

doi:10.1117/12.666384

17 May 2006 START for evaluation of target detection and tracking

Scott K. Ralph, Mark R. Stevens, John Irvine, Jeremy Marvel, Magnús Snorrason, Andrew Rice

Proceedings Volume 6235, Signal Processing, Sensor Fusion, and Target Recognition XV; 62350H (2006) https://doi.org/10.1117/12.666384
Event: Defense and Security Symposium, 2006, Orlando (Kissimmee), Florida, United States

Abstract

A major challenge for ATR evaluation is developing an accurate image truth that can be compared to an ATR algorithm's decisions to assess performance. We have developed a semi-automated video truthing application, called START, that greatly improves the productivity of an operator truthing video sequences. The user, after previewing the video selects a set of salient frames (called "keyframes"), each corresponding to significant events in the video. These keyframes are then manually truthed. We provide a spectrum of truthing tools that generates truth for additional frames from the keyframes. These tools include: fully-automatic feature tracking, interpolation, and completely manual methods. The application uses a set of diagnostic measures to manage the user's attention, flagging portions in the video for which the computed truth needs review. This changes the role of the operator from raw data entry, to that of expert appraiser supervising the quality of the image truth. We have implemented a number of graphical displays summarizing the video truthing at various timescales. Additionally, we can view the track information, showing only the lifespan information of the entities involved. A combination of these displays allows the user to manage their resources more effectively. Two studies have been conducted that have shown the utility of START: one focusing on the accuracy of the automated truthing process, and the other focusing on usability issues of the application by a set of expert users.

Citation Download Citation

Scott K. Ralph, Mark R. Stevens, John Irvine, Jeremy Marvel, Magnús Snorrason, and Andrew Rice "START for evaluation of target detection and tracking", Proc. SPIE 6235, Signal Processing, Sensor Fusion, and Target Recognition XV, 62350H (17 May 2006); https://doi.org/10.1117/12.666384

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $17.00

Non-members: $21.00 ADD TO CART

PROCEEDINGS
11 PAGES

DOWNLOAD PAPER SAVE TO MY LIBRARY

GET CITATION

RIGHTS & PERMISSIONS

Get copyright permission Get copyright permission on Copyright Marketplace

KEYWORDS

Video

Optical tracking

Detection and tracking algorithms

Diagnostics

Automatic target recognition

Image quality

Video processing

Show All Keywords

Keywords/Phrases

Search In:

Publication Years