Kinect-based sign language recognition of static and dynamic hand movements

Rando C. Dalawis; Kenneth Deniel R. Olayao; Evan Geoffrey I. Ramos; Mary Jane C. Samonte

doi:10.1117/12.2266729

8 February 2017 Kinect-based sign language recognition of static and dynamic hand movements

Rando C. Dalawis, Kenneth Deniel R. Olayao, Evan Geoffrey I. Ramos, Mary Jane C. Samonte

Proceedings Volume 10225, Eighth International Conference on Graphic and Image Processing (ICGIP 2016); 102250I (2017) https://doi.org/10.1117/12.2266729
Event: Eighth International Conference on Graphic and Image Processing, 2016, Tokyo, Japan

Abstract

A different approach of sign language recognition of static and dynamic hand movements was developed in this study using normalized correlation algorithm. The goal of this research was to translate fingerspelling sign language into text using MATLAB and Microsoft Kinect. Digital input image captured by Kinect devices are matched from template samples stored in a database. This Human Computer Interaction (HCI) prototype was developed to help people with communication disability to express their thoughts with ease. Frame segmentation and feature extraction was used to give meaning to the captured images. Sequential and random testing was used to test both static and dynamic fingerspelling gestures. The researchers explained some factors they encountered causing some misclassification of signs.

Citation Download Citation

Rando C. Dalawis, Kenneth Deniel R. Olayao, Evan Geoffrey I. Ramos, and Mary Jane C. Samonte "Kinect-based sign language recognition of static and dynamic hand movements ", Proc. SPIE 10225, Eighth International Conference on Graphic and Image Processing (ICGIP 2016), 102250I (8 February 2017); https://doi.org/10.1117/12.2266729

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available