Video-based face recognition via convolutional neural networks

Tianlong Bao; Chunhui Ding; Saleem Karmoshi; Ming Zhu

doi:10.1117/12.2280286

19 June 2017 Video-based face recognition via convolutional neural networks

Tianlong Bao, Chunhui Ding, Saleem Karmoshi, Ming Zhu

Proceedings Volume 10443, Second International Workshop on Pattern Recognition; 104430I (2017) https://doi.org/10.1117/12.2280286
Event: Second International Workshop on Pattern Recognition, 2017, Singapore, Singapore

Abstract

Face recognition has been widely studied recently while video-based face recognition still remains a challenging task because of the low quality and large intra-class variation of video captured face images. In this paper, we focus on two scenarios of video-based face recognition: 1)Still-to-Video(S2V) face recognition, i.e., querying a still face image against a gallery of video sequences; 2)Video-to-Still(V2S) face recognition, in contrast to S2V scenario. A novel method was proposed in this paper to transfer still and video face images to an Euclidean space by a carefully designed convolutional neural network, then Euclidean metrics are used to measure the distance between still and video images. Identities of still and video images that group as pairs are used as supervision. In the training stage, a joint loss function that measures the Euclidean distance between the predicted features of training pairs and expanding vectors of still images is optimized to minimize the intra-class variation while the inter-class variation is guaranteed due to the large margin of still images. Transferred features are finally learned via the designed convolutional neural network. Experiments are performed on COX face dataset. Experimental results show that our method achieves reliable performance compared with other state-of-the-art methods.

Citation Download Citation

Tianlong Bao, Chunhui Ding, Saleem Karmoshi, and Ming Zhu "Video-based face recognition via convolutional neural networks", Proc. SPIE 10443, Second International Workshop on Pattern Recognition, 104430I (19 June 2017); https://doi.org/10.1117/12.2280286

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available