Acquiring neural signals for developing a perception and cognition model

Wei Li; Yunyi Li; Genshe Chen; Dan Shen; Erik Blasch; Khanh Pham; Robert Lynch

doi:10.1117/12.918767

24 May 2012 Acquiring neural signals for developing a perception and cognition model

Wei Li, Yunyi Li, Genshe Chen, Dan Shen, Erik Blasch, Khanh Pham, Robert Lynch

Proceedings Volume 8385, Sensors and Systems for Space Applications V; 83850I (2012) https://doi.org/10.1117/12.918767
Event: SPIE Defense, Security, and Sensing, 2012, Baltimore, Maryland, United States

Abstract

The understanding of how humans process information, determine salience, and combine seemingly unrelated information is essential to automated processing of large amounts of information that is partially relevant, or of unknown relevance. Recent neurological science research in human perception, and in information science regarding contextbased modeling, provides us with a theoretical basis for using a bottom-up approach for automating the management of large amounts of information in ways directly useful for human operators. However, integration of human intelligence into a game theoretic framework for dynamic and adaptive decision support needs a perception and cognition model. For the purpose of cognitive modeling, we present a brain-computer-interface (BCI) based humanoid robot system to acquire brainwaves during human mental activities of imagining a humanoid robot-walking behavior. We use the neural signals to investigate relationships between complex humanoid robot behaviors and human mental activities for developing the perception and cognition model. The BCI system consists of a data acquisition unit with an electroencephalograph (EEG), a humanoid robot, and a charge couple CCD camera. An EEG electrode cup acquires brainwaves from the skin surface on scalp. The humanoid robot has 20 degrees of freedom (DOFs); 12 DOFs located on hips, knees, and ankles for humanoid robot walking, 6 DOFs on shoulders and arms for arms motion, and 2 DOFs for head yaw and pitch motion. The CCD camera takes video clips of the human subject's hand postures to identify mental activities that are correlated to the robot-walking behaviors. We use the neural signals to investigate relationships between complex humanoid robot behaviors and human mental activities for developing the perception and cognition model.

Citation Download Citation

Wei Li, Yunyi Li, Genshe Chen, Dan Shen, Erik Blasch, Khanh Pham, and Robert Lynch "Acquiring neural signals for developing a perception and cognition model", Proc. SPIE 8385, Sensors and Systems for Space Applications V, 83850I (24 May 2012); https://doi.org/10.1117/12.918767

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available