Research on facial expression feature decoupling algorithm based on generative adversarial network

Neng Sheng Bao; Zhao Peng Luo; Sheng Bao Guo; Yu Chen Fan; Jia Hua Jiang; Li Wei

doi:10.1117/12.2660851

2 February 2023 Research on facial expression feature decoupling algorithm based on generative adversarial network

Neng Sheng Bao, Zhao Peng Luo, Sheng Bao Guo, Yu Chen Fan, Jia Hua Jiang, Li Wei

Proceedings Volume 12462, Third International Symposium on Computer Engineering and Intelligent Communications (ISCEIC 2022); 124622P (2023) https://doi.org/10.1117/12.2660851
Event: International Symposium on Computer Engineering and Intelligent Communications (ISCEIC 2022), 2022, Xi'an, China

Abstract

In the field of facial expression recognition, problems exist in traditional dataset acquisition, including high economic cost, time-consuming process, and difficulties in avoiding subjective factors. However, expression synthesis methods have provided solutions for such problems. In expression synthesis, facial expression trait decoupling is a key technology that affects the image quality. As such, in targeting incomplete separation of the two main types of features, identity features and expression features, new methods for finishing trait decoupling were proposed in the present study. ResNet50 was used to obtain the initial features and the latent codes were obtained by mapping network. A progressive generative adversarial network was used to generate images of different resolution layers. Subsequently, a feedback network was constructed to obtain latent codes. Thus, the separation of identity features and expression features was achieved, and the FID and SSIM between the generated images and the raw images were smaller. Through the proposed method, the accuracy of facial feature editing can be improved.

Citation Download Citation

Neng Sheng Bao, Zhao Peng Luo, Sheng Bao Guo, Yu Chen Fan, Jia Hua Jiang, and Li Wei "Research on facial expression feature decoupling algorithm based on generative adversarial network", Proc. SPIE 12462, Third International Symposium on Computer Engineering and Intelligent Communications (ISCEIC 2022), 124622P (2 February 2023); https://doi.org/10.1117/12.2660851

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available