Sign language perception research for improving automatic sign language recognition

Gineke A. ten Holt; Jeroen Arendsen; Huib de Ridder; Andrea J. Koenderink-van Doorn; Marcel J. T. Reinders; Emile A. Hendriks

doi:10.1117/12.808750

10 February 2009 Sign language perception research for improving automatic sign language recognition

Gineke A. ten Holt, Jeroen Arendsen, Huib de Ridder, Andrea J. Koenderink-van Doorn, Marcel J. T. Reinders, Emile A. Hendriks

Author Affiliations +

Proceedings Volume 7240, Human Vision and Electronic Imaging XIV; 72400C (2009) https://doi.org/10.1117/12.808750
Event: IS&T/SPIE Electronic Imaging, 2009, San Jose, California, United States

Abstract

Current automatic sign language recognition (ASLR) seldom uses perceptual knowledge about the recognition of sign language. Using such knowledge can improve ASLR because it can give an indication which elements or phases of a sign are important for its meaning. Also, the current generation of data-driven ASLR methods has shortcomings which may not be solvable without the use of knowledge on human sign language processing. Handling variation in the precise execution of signs is an example of such shortcomings: data-driven methods (which include almost all current methods) have difficulty recognizing signs that deviate too much from the examples that were used to train the method. Insight into human sign processing is needed to solve these problems. Perceptual research on sign language can provide such insights. This paper discusses knowledge derived from a set of sign perception experiments, and the application of such knowledge in ASLR. Among the findings are the facts that not all phases and elements of a sign are equally informative, that defining the 'correct' form for a sign is not trivial, and that statistical ASLR methods do not necessarily arrive at sign representations that resemble those of human beings. Apparently, current ASLR methods are quite different from human observers: their method of learning gives them different sign definitions, they regard each moment and element of a sign as equally important and they employ a single definition of 'correct' for all circumstances. If the object is for an ASLR method to handle natural sign language, then the insights from sign perception research must be integrated into ASLR.

Citation Download Citation

Gineke A. ten Holt, Jeroen Arendsen, Huib de Ridder, Andrea J. Koenderink-van Doorn, Marcel J. T. Reinders, and Emile A. Hendriks "Sign language perception research for improving automatic sign language recognition", Proc. SPIE 7240, Human Vision and Electronic Imaging XIV, 72400C (10 February 2009); https://doi.org/10.1117/12.808750

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available