Adoption of Artificial Intelligence Along with Gesture Interactive Robot in Musical Perception Education Based on Deep Learning Method

被引:8
|
作者
Zhang, Chao [1 ]
Li, Huizi [1 ]
机构
[1] Univ China Beijing, Sch Music & Recording Arts Commun, Beijing 100024, Peoples R China
关键词
Robot; gesture recognition; DCCNN; two-stream CNN; interactive robot system; NEURAL-NETWORKS; RECOGNITION; ART;
D O I
10.1142/S0219843622400084
中图分类号
TP24 [机器人技术];
学科分类号
080202 ; 1405 ;
摘要
The present work aims to improve students' interest in music teaching and promote modern teaching. A distributed application system of artificial intelligence gesture interactive robot is designed through deep learning technology and applied to music perception education. First, the user's gesture instruction data is collected through the double channel convolution neural network (DCCNN). It uses the double-size convolution kernel to extract feature information in the image and collect the video frame's gesture instruction. Secondly, a two-stream convolutional neural network (two-stream CNN) recognizes the collected gesture instruction data. The spatial and temporal information is extracted from RGB color mode (RGB) images and optical flow images and input into the two-stream CNN to fuse the prediction results of each network as the final detection result. Then, the distributed system used by the interactive robot is introduced. This structure can improve the stability of the interactive systems and reduce the requirements for local hardware performance. Finally, experiments are conducted to test the gesture command acquisition and recognition network, and the performance of the gesture interactive robot in practice. The results indicate that combining convolution kernels of 5 x 5 and 7 x 7 can increase the recognition accuracy of DCCNN to 98% and effectively collect gesture instruction data. The gesture recognition accuracy of two-stream CNN after training reaches 90%, higher than the mainstream dynamic gesture recognition algorithm trained with the same data set. Finally, the recognition test of gesture instructions is carried out on the gesture interactive robot reported here. The results show that the recognition accuracy of the gesture interactive robots is more than 90%, meeting the routine interaction needs. Therefore, the interactive gesture robot has good reliability and stability and is applicable to music perception teaching. The research reported here has guiding significance for establishing music teaching with multiple perception modes.
引用
收藏
页数:18
相关论文
共 50 条
  • [41] Research on the effectiveness of interactive e-learning mode based on artificial intelligence in English learning
    Geng, Chunling
    ENTERTAINMENT COMPUTING, 2024, 51
  • [42] Social entertainment robot based on artificial intelligence algorithm application in interactive mode of music classroom
    Song, Qianwen
    ENTERTAINMENT COMPUTING, 2024, 51
  • [43] A better method for the dynamic, precise estimating of blood/haemoglobin loss based on deep learning of artificial intelligence
    Li, Yu-Jie
    Zhang, Li-Ge
    Zhi, Hong-Yu
    Zhong, Kun-Hua
    He, Wen-Quan
    Chen, Yang
    Yang, Zhi-Yong
    Chen, Lin
    Bai, Xue-Hong
    Qin, Xiao-Lin
    Li, Dan-Feng
    Wang, Dan-Dan
    Gu, Jian-Teng
    Ning, Jiao-Lin
    Lu, Kai-Zhi
    Zhang, Ju
    Xia, Zheng-Yuan
    Chen, Yu-Wen
    Yi, Bin
    ANNALS OF TRANSLATIONAL MEDICINE, 2020, 8 (19)
  • [44] A Method for Constructing a Knowledge Graph of Electric Power Digital Marketing Based on Artificial Intelligence Deep Learning
    Xu, Jianing
    Lou, Fei
    Jiang, Ying
    Chen, Bo
    Zhong, Zhenyuan
    PROCEEDINGS OF 2024 INTERNATIONAL CONFERENCE ON POWER ELECTRONICS AND ARTIFICIAL INTELLIGENCE, PEAI 2024, 2024, : 582 - 587
  • [45] Research on CT Scan Image of Lung Cancer Based on Deep Learning Method in Artificial Intelligence Field
    Yi, Xiaochen
    Sun, Zongze
    Yu, Baolong
    Yang, Munan
    Zhang, Zhuo
    JOURNAL OF MEDICAL IMAGING AND HEALTH INFORMATICS, 2020, 10 (04) : 934 - 939
  • [46] Artificial Intelligence With Deep Learning Based Automated Ear Infection Detection
    Mehedi, Ibrahim M.
    Hanif, Muhammad Shehzad
    Bilal, Muhammad
    Vellingiri, Mahendiran T.
    Palaniswamy, Thangam
    IEEE ACCESS, 2024, 12 : 48335 - 48348
  • [47] Identification and reconstruction of concrete mesostructure based on deep learning in artificial intelligence
    Ying, Jingwei
    Tian, Jiashuo
    Xiao, Jianzhuang
    Tan, Zhiyun
    CONSTRUCTION AND BUILDING MATERIALS, 2022, 352
  • [48] A review of artificial intelligence based malware detection using deep learning
    Mustafa Majid A.-A.
    Alshaibi A.J.
    Kostyuchenko E.
    Shelupanov A.
    Materials Today: Proceedings, 2023, 80 : 2678 - 2683
  • [49] Artificial intelligence in neuropathology: deep learning-based assessment of tauopathy
    Signaevsky, Maxim
    Prastawa, Marcel
    Farrell, Kurt
    Tabish, Nabil
    Baldwin, Elena
    Han, Natalia
    Iida, Megan A.
    Koll, John
    Bryce, Clare
    Purohit, Dushyant
    Haroutunian, Vahram
    McKee, Ann C.
    Stein, Thor D.
    White, Charles L., III
    Walker, Jamie
    Richardson, Timothy E.
    Hanson, Russell
    Donovan, Michael J.
    Cordon-Cardo, Carlos
    Zeineh, Jack
    Fernandez, Gerardo
    Crary, John F.
    LABORATORY INVESTIGATION, 2019, 99 (07) : 1019 - 1029
  • [50] Artificial Intelligence-based Deep Learning Architecture for Tuberculosis Detection
    Gupta, Puja
    Srivastava, Sumit
    Nath, Vijay
    WIRELESS PERSONAL COMMUNICATIONS, 2024, 138 (03) : 1937 - 1953