9 March 2023 Long and short spatial-temporal relations model for automatic generation of Labanotation
Shanshan Gong, Wanru Xu, Zhenjiang Miao, Xinxiu Qiu, Lihuan Zheng
Author Affiliations +
Abstract

As a major research field in computer vision, automatic generation of Labanotation has been attracting the attention of many researchers. These researchers use various methods to engage in dance education and protection, but the existing methods do not consider the spatial-temporal dependence modeling of dance movements. Therefore, they do not represent complex dance movements optimally. We propose an automatic generation network of Labanotation based on the long and short spatial-temporal relations. It includes local spatial-temporal feature extraction network, global spatial-temporal feature extraction network, and local and global feature fusion network. It can align the input and output sequences while modeling the skeletal spatial-temporal relation. The local spatial-temporal features among short interval skeleton sequence relationship are obtained through the multi-scale convolution of time and space. The global spatial-temporal features are learned through the transformer network to obtain the relationship among skeleton sequences with long interval. For the output of the two networks, we use the pyramid squeeze attention network to exchange information in long and short spatial-temporal information, achieving complementarity to improve the accuracy of action recognition. Experimental results show that the proposed method outperforms the state-of-the-art methods on laban16 and laban48, which are common datasets for the research of Labanotation.

© 2023 SPIE and IS&T
Shanshan Gong, Wanru Xu, Zhenjiang Miao, Xinxiu Qiu, and Lihuan Zheng "Long and short spatial-temporal relations model for automatic generation of Labanotation," Journal of Electronic Imaging 32(2), 023006 (9 March 2023). https://doi.org/10.1117/1.JEI.32.2.023006
Received: 17 October 2022; Accepted: 15 February 2023; Published: 9 March 2023
Advertisement
Advertisement
RIGHTS & PERMISSIONS
Get copyright permission  Get copyright permission on Copyright Marketplace
KEYWORDS
Feature extraction

Data modeling

Spatial learning

Convolution

Feature fusion

Transformers

Matrices

Back to Top