Visual signal processing, speechreading, and related issues

Harry Levitt

doi:10.1117/12.501207

17 June 2003 Visual signal processing, speechreading, and related issues

Harry Levitt

Proceedings Volume 5007, Human Vision and Electronic Imaging VIII; (2003) https://doi.org/10.1117/12.501207
Event: Electronic Imaging 2003, 2003, Santa Clara, CA, United States

Abstract

People with hearing loss make use of visual speech cues to supplement the impoverished speech signal. This process, known as speechreading (or lipreading) can be very effective because of the complementary nature of auditory and visual speech cues. Despite the importance of visual speech cues (for both normal-hearing and hearing-impaired people) research on the visual characteristics of speech has lagged behind research on the acoustic characteristics of speech. The field of acoustic phonetics benefited substantially from the availability of powerful techniques for acoustic signal analysis. The substantial, recent advances in optical signal processing have opened up new vistas for visual speech analysis analogous to the way technological innovation revolutionized the field of acoustic phonetics. This paper describes several experiments in the emerging field of optic phonetics.

Citation Download Citation

Harry Levitt "Visual signal processing, speechreading, and related issues", Proc. SPIE 5007, Human Vision and Electronic Imaging VIII, (17 June 2003); https://doi.org/10.1117/12.501207

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available