GAN-based data augmentation for visual finger spelling recognition

Bogdan Kwolek

doi:10.1117/12.2522935

15 March 2019 GAN-based data augmentation for visual finger spelling recognition

Bogdan Kwolek

Proceedings Volume 11041, Eleventh International Conference on Machine Vision (ICMV 2018); 110411U (2019) https://doi.org/10.1117/12.2522935
Event: Eleventh International Conference on Machine Vision (ICMV 2018), 2018, Munich, Germany

Abstract

In this work we extend WGAN-GP in order to achieve better generation of synthesized images for finger spelling classification. The main difference between the ordinary WGAN-GP and the proposed algorithm is that in the training we employ both training samples and training labels. These training labels are fed to the generator, that generates the synthetic images using both the randomized latent input and the input label. In ordinary WGAN-GP, latent input variables are usually sampled from an unconditional prior. In the proposed algorithm the latent input vector is a concatenation of random part, the class labels and additional variables that are drawn from Gaussian distributions representing hand poses or gesture attributes. The JSL dataset for Hiragana sign recognition has been balanced using the rendered samples on the basis of a 3D hand model as well as the extended WGAN-GP.

Citation Download Citation

Bogdan Kwolek "GAN-based data augmentation for visual finger spelling recognition", Proc. SPIE 11041, Eleventh International Conference on Machine Vision (ICMV 2018), 110411U (15 March 2019); https://doi.org/10.1117/12.2522935

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available