Paper
23 May 2023 A dynamic gesture recognition method fused with MGN-LSTM network
Yong Zhang, QingSong Hong, TianXiang Zhao
Author Affiliations +
Proceedings Volume 12645, International Conference on Computer, Artificial Intelligence, and Control Engineering (CAICE 2023); 1264535 (2023) https://doi.org/10.1117/12.2681610
Event: International Conference on Computer, Artificial Intelligence, and Control Engineering (CAICE 2023), 2023, Hangzhou, China
Abstract
In order to solve the problem of insufficient feature expression ability in gesture recognition in emergency rescue, this paper proposes a multi-feature fusion dynamic gesture recognition network (MGN-LSTM). The model first extracts the global information and local information of each granularity through a Multiple Granularity Network (MGN). Then, a layer of Long Short-Term Memory network (LSTM) is used to extract the time information of gestures. Finally, in the model prediction stage, the candy algorithm is added to detect the edge feature information of the gesture, and the recognition result is obtained by combining the global, local and time information. The experimental results show that the multi-feature fusion method proposed in this paper has good feature expression ability and has been verified in both the self-built emergency rescue gesture dataset and the public dataset IsoGD, which improves the accuracy of gesture recognition.
© (2023) COPYRIGHT Society of Photo-Optical Instrumentation Engineers (SPIE). Downloading of the abstract is permitted for personal use only.
Yong Zhang, QingSong Hong, and TianXiang Zhao "A dynamic gesture recognition method fused with MGN-LSTM network", Proc. SPIE 12645, International Conference on Computer, Artificial Intelligence, and Control Engineering (CAICE 2023), 1264535 (23 May 2023); https://doi.org/10.1117/12.2681610
Advertisement
Advertisement
RIGHTS & PERMISSIONS
Get copyright permission  Get copyright permission on Copyright Marketplace
KEYWORDS
Gesture recognition

Feature extraction

Back to Top