Connecting a cognitive architecture to robotic perception

Unmesh Kurup; Christian Lebiere; Anthony Stentz; Martial Hebert

doi:10.1117/12.919417

25 May 2012 Connecting a cognitive architecture to robotic perception

Unmesh Kurup, Christian Lebiere, Anthony Stentz, Martial Hebert

Proceedings Volume 8387, Unmanned Systems Technology XIV; 83870X (2012) https://doi.org/10.1117/12.919417
Event: SPIE Defense, Security, and Sensing, 2012, Baltimore, Maryland, United States

Abstract

We present an integrated architecture in which perception and cognition interact and provide information to each other leading to improved performance in real-world situations. Our system integrates the Felzenswalb et. al. object-detection algorithm with the ACT-R cognitive architecture. The targeted task is to predict and classify pedestrian behavior in a checkpoint scenario, most specifically to discriminate between normal versus checkpoint-avoiding behavior. The Felzenswalb algorithm is a learning-based algorithm for detecting and localizing objects in images. ACT-R is a cognitive architecture that has been successfully used to model human cognition with a high degree of fidelity on tasks ranging from basic decision-making to the control of complex systems such as driving or air traffic control. The Felzenswalb algorithm detects pedestrians in the image and provides ACT-R a set of features based primarily on their locations. ACT-R uses its pattern-matching capabilities, specifically its partial-matching and blending mechanisms, to track objects across multiple images and classify their behavior based on the sequence of observed features. ACT-R also provides feedback to the Felzenswalb algorithm in the form of expected object locations that allow the algorithm to eliminate false-positives and improve its overall performance. This capability is an instance of the benefits pursued in developing a richer interaction between bottom-up perceptual processes and top-down goal-directed cognition. We trained the system on individual behaviors (only one person in the scene) and evaluated its performance across single and multiple behavior sets.

Citation Download Citation

Unmesh Kurup, Christian Lebiere, Anthony Stentz, and Martial Hebert "Connecting a cognitive architecture to robotic perception", Proc. SPIE 8387, Unmanned Systems Technology XIV, 83870X (25 May 2012); https://doi.org/10.1117/12.919417

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available