An effective and efficient real-time facial expression recognition method in the wild

Yuhang Zhang; Lanfang Dong; Xuesong Liu; Meng Mao; Guoming Li

doi:10.1117/12.3004653

9 October 2023 An effective and efficient real-time facial expression recognition method in the wild

Yuhang Zhang, Lanfang Dong, Xuesong Liu, Meng Mao, Guoming Li

Proceedings Volume 12791, Third International Conference on Advanced Algorithms and Neural Networks (AANN 2023); 127911Q (2023) https://doi.org/10.1117/12.3004653
Event: Third International Conference on Advanced Algorithms and Neural Networks (AANN 2023), 2023, Qingdao, SD, China

Abstract

In human communication, besides direct verbal speech, facial expressions are also the main method to convey inner thoughts and emotions. By analyzing facial expressions, it is possible to obtain information about human inner emotions. Applying expression analysis algorithms in social robots can help robots accurately understand users' emotions and intentions, which in turn leads to better human-computer interaction.Therefore, in this paper, an effective & efficient expression recognition method is designed. The network uses the Ghost Module as the core module, and the lightweight attention module is used to increase the accuracy of expression recognition. In addition, the network is trained with a distributed label loss in order to solve the problems of insufficient data and long-tail of the facial expression dataset. Experiments prove that the network is superior, performs well on the RAF-DB dataset, with 86.8% accuracy without pretraining and has a fast processing speed. We also designed a real-time expression analysis system with this network as the backbone to simulate the actual working scenario of the robot, and found superior results to satisfy the functions of real-time human-computer interaction and efficient expression recognition.

(2023) Published by SPIE. Downloading of the abstract is permitted for personal use only.

Citation Download Citation

Yuhang Zhang, Lanfang Dong, Xuesong Liu, Meng Mao, and Guoming Li "An effective and efficient real-time facial expression recognition method in the wild", Proc. SPIE 12791, Third International Conference on Advanced Algorithms and Neural Networks (AANN 2023), 127911Q (9 October 2023); https://doi.org/10.1117/12.3004653

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available