A Motion Capture Data-Driven Automatic Labanotation Generation Model Using the Convolutional Neural Network Algorithm

被引:4
|
作者
Yao, Jiang [1 ]
Chen, Yang [1 ]
机构
[1] Shenzhen Univ, Sch Mus & Dance, Shenzhen 518060, Peoples R China
关键词
ACTION RECOGNITION;
D O I
10.1155/2022/2618940
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
All human movements can be effectively represented with labanotation, which is simple to read and preserve. However, manually recording the labanotation takes a long time, so figuring out how to use the labanotation to accurately and quickly record and preserve traditional dance movements is a key research question. An automatic labanotation generation algorithm based on DL (deep learning) is proposed in this study. The BVH file is first analyzed, and the data are then converted. On this foundation, a CNN (convolutional neural network) algorithm for generating the dance spectrum of human lower-limb movements is proposed, which is very good at learning action space information. The algorithm performs admirably in terms of classification and recognition. Finally, a spatial segmentation-based automatic labanotation generation algorithm is proposed. To begin, every frame of data is converted into a symbol sequence using spatial law, resulting in a very dense motion sequence. The motion sequence is then regulated according to the minimum beat of motion obtained through wavelet analysis. To arrive at the final result, the classifier is used to determine whether each symbol is reserved or not. As a result, we will be able to create more accurate dance music for simple human movements.
引用
收藏
页数:9
相关论文
共 50 条
  • [1] Automatic Labanotation Generation Based on Human Motion Capture Data
    Guo, Hao
    Miao, Zhenjiang
    Zhu, Feiyue
    Zhang, Gang
    Li, Song
    PATTERN RECOGNITION (CCPR 2014), PT I, 2014, 483 : 426 - 435
  • [2] A System for Automatic Generation of Labanotation from Motion Capture Data
    Zhou, Ziming
    Miao, Zhenjiang
    Wang, Jiaji
    PROCEEDINGS OF 2016 IEEE 13TH INTERNATIONAL CONFERENCE ON SIGNAL PROCESSING (ICSP 2016), 2016, : 1031 - 1034
  • [3] Data-driven reduced order model with temporal convolutional neural network
    Wu, Pin
    Sun, Junwu
    Chang, Xuting
    Zhang, Wenjie
    Arcucci, Rossella
    Guo, Yike
    Pain, Christopher C.
    COMPUTER METHODS IN APPLIED MECHANICS AND ENGINEERING, 2020, 360
  • [4] Labanotation Generation Based On BLSTM-CTC Network With Continuous Motion Capture Data
    Hao, Shanshan
    Miao, Zhenjiang
    Ma, Cong
    Li, Min
    Zhang, Ruyi
    2019 CHINESE AUTOMATION CONGRESS (CAC2019), 2019, : 5138 - 5142
  • [5] DeepSegment: Segmentation of motion capture data using deep convolutional neural network
    Yasin, Hashim
    Hayat, Saqib
    IMAGE AND VISION COMPUTING, 2021, 109 (109)
  • [6] A novel construction method of convolutional neural network model based on data-driven
    Zou, Guo-feng
    Fu, Gui-xia
    Gao, Ming-liang
    Shen, Jin
    Yin, Li-ju
    Ben, Xian-ye
    MULTIMEDIA TOOLS AND APPLICATIONS, 2019, 78 (06) : 6969 - 6987
  • [7] A novel construction method of convolutional neural network model based on data-driven
    Guo-feng Zou
    Gui-xia Fu
    Ming-liang Gao
    Jin Shen
    Li-ju Yin
    Xian-ye Ben
    Multimedia Tools and Applications, 2019, 78 : 6969 - 6987
  • [8] A New Data-Driven Intelligent Fault Diagnosis by Using Convolutional Neural Network
    Wen, Long
    Gao, Liang
    Li, Xinyu
    Xie, Minzhao
    Li, Guomin
    2017 IEEE INTERNATIONAL CONFERENCE ON INDUSTRIAL ENGINEERING AND ENGINEERING MANAGEMENT (IEEM), 2017, : 813 - 817
  • [9] Data-driven modeling of sluice gate flows using a convolutional neural network
    Yan, Xiaohui
    Wang, Yan
    Fan, Boyuan
    Mohammadian, Abdolmajid
    Liu, Jianwei
    Zhu, Zuhao
    JOURNAL OF HYDROINFORMATICS, 2023, 25 (05) : 1629 - 1647
  • [10] AN ATTENTION-SEQ2SEQ MODEL BASED ON CRNN ENCODING FOR AUTOMATIC LABANOTATION GENERATION FROM MOTION CAPTURE DATA
    Li, Min
    Miao, Zhenjiang
    Zhang, Xiao-Ping
    Xu, Wanru
    2021 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP 2021), 2021, : 4185 - 4189