Using virtual 3D audio in multispeech channel and multimedia environments

Michael D. Orosz; Walter J. Karplus; Jerry D. Balakrishnan

doi:10.1117/12.397743

28 August 2000 Using virtual 3D audio in multispeech channel and multimedia environments

Michael D. Orosz, Walter J. Karplus, Jerry D. Balakrishnan

Proceedings Volume 4022, Cockpit Displays VII: Displays for Defense Applications; (2000) https://doi.org/10.1117/12.397743
Event: AeroSense 2000, 2000, Orlando, FL, United States

Abstract

The advantages and disadvantages of using virtual 3-D audio in mission-critical, multimedia display interfaces were evaluated. The 3D audio platform seems to be an especially promising candidate for aircraft cockpits, flight control rooms, and other command and control environments in which operators must make mission-critical decisions while handling demanding and routine tasks. Virtual audio signal processing creates the illusion for a listener wearing conventional earphones that each of a multiplicity of simultaneous speech or audio channels is originating from a different, program- specified location in virtual space. To explore the possible uses of this new, readily available technology, a test bed simulating some of the conditions experienced by the chief flight test coordinator at NASA's Dryden Flight Research Center was designed and implemented. Thirty test subjects simultaneously performed routine tasks requiring constant hand-eye coordination, while monitoring four speech channels, each generating continuous speech signals, for the occurrence of pre-specified keywords. Performance measures included accuracy in identifying the keywords, accuracy in identifying the speaker of the keyword, and response time. We found substantial improvements on all of these measures when comparing virtual audio with conventional, monaural transmissions. We also explored the effect on operator performance of different spatial configurations of the audio sources in 3-D space, simulated movement (dither) in the source locations, and of providing graphical redundancy. Some of these manipulations were less effective and may even decrease performance efficiency, even though they improve some aspects of the virtual space simulation.

Citation Download Citation

Michael D. Orosz, Walter J. Karplus, and Jerry D. Balakrishnan "Using virtual 3D audio in multispeech channel and multimedia environments", Proc. SPIE 4022, Cockpit Displays VII: Displays for Defense Applications, (28 August 2000); https://doi.org/10.1117/12.397743

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $17.00

Non-members: $21.00 ADD TO CART

PROCEEDINGS
11 PAGES

DOWNLOAD PAPER SAVE TO MY LIBRARY

GET CITATION

RIGHTS & PERMISSIONS

Get copyright permission Get copyright permission on Copyright Marketplace

KEYWORDS

Visualization

Human-machine interfaces

3D displays

Head

Multimedia

Radar

Space operations

Show All Keywords

Keywords/Phrases

Search In:

Publication Years