Adoption of Artificial Intelligence Along with Gesture Interactive Robot in Musical Perception Education Based on Deep Learning Method

被引:8
|
作者
Zhang, Chao [1 ]
Li, Huizi [1 ]
机构
[1] Univ China Beijing, Sch Music & Recording Arts Commun, Beijing 100024, Peoples R China
关键词
Robot; gesture recognition; DCCNN; two-stream CNN; interactive robot system; NEURAL-NETWORKS; RECOGNITION; ART;
D O I
10.1142/S0219843622400084
中图分类号
TP24 [机器人技术];
学科分类号
080202 ; 1405 ;
摘要
The present work aims to improve students' interest in music teaching and promote modern teaching. A distributed application system of artificial intelligence gesture interactive robot is designed through deep learning technology and applied to music perception education. First, the user's gesture instruction data is collected through the double channel convolution neural network (DCCNN). It uses the double-size convolution kernel to extract feature information in the image and collect the video frame's gesture instruction. Secondly, a two-stream convolutional neural network (two-stream CNN) recognizes the collected gesture instruction data. The spatial and temporal information is extracted from RGB color mode (RGB) images and optical flow images and input into the two-stream CNN to fuse the prediction results of each network as the final detection result. Then, the distributed system used by the interactive robot is introduced. This structure can improve the stability of the interactive systems and reduce the requirements for local hardware performance. Finally, experiments are conducted to test the gesture command acquisition and recognition network, and the performance of the gesture interactive robot in practice. The results indicate that combining convolution kernels of 5 x 5 and 7 x 7 can increase the recognition accuracy of DCCNN to 98% and effectively collect gesture instruction data. The gesture recognition accuracy of two-stream CNN after training reaches 90%, higher than the mainstream dynamic gesture recognition algorithm trained with the same data set. Finally, the recognition test of gesture instructions is carried out on the gesture interactive robot reported here. The results show that the recognition accuracy of the gesture interactive robots is more than 90%, meeting the routine interaction needs. Therefore, the interactive gesture robot has good reliability and stability and is applicable to music perception teaching. The research reported here has guiding significance for establishing music teaching with multiple perception modes.
引用
收藏
页数:18
相关论文
共 50 条
  • [21] Introduction to artificial intelligence and deep learning using interactive electronic programming notebooks
    Menke, Janosch
    Homberg, Samuel
    Koch, Oliver
    ARCHIV DER PHARMAZIE, 2023, 356 (07)
  • [22] Design and Implementation of Virtual Reality Interactive Product Software Based on Artificial Intelligence Deep Learning Algorithm
    Wang, Yi
    Sun, Junhai
    ADVANCES IN MULTIMEDIA, 2022, 2022
  • [23] Deep Learning-Based Artificial Intelligence for Mammography
    Yoon, Jung Hyun
    Kim, Eun Kyung
    KOREAN JOURNAL OF RADIOLOGY, 2021, 22 (08) : 1225 - 1239
  • [24] Deep Learning Based Gesture Classification for Hand Physical Therapy Interactive Program
    Rungruanganukul, Maleewan
    Siriborvornratanakul, Thitirat
    DIGITAL HUMAN MODELING AND APPLICATIONS IN HEALTH, SAFETY, ERGONOMICS AND RISK MANAGEMENT. POSTURE, MOTION AND HEALTH, DHM 2020, PT I, 2020, 12198 : 349 - 358
  • [25] Artificial Intelligence and Machine (Deep) Learning in Medical Education: A Bibliometric Analysis Based on VOSviewer and CiteSpace
    Liu, Jiaqi
    Chui, Kwok Tai
    Lee, Lap-Kei
    Wang, Fu Lee
    Cheung, Simon K. S.
    Hui, Yan Keung
    2024 INTERNATIONAL SYMPOSIUM ON EDUCATIONAL TECHNOLOGY, ISET, 2024, : 80 - 86
  • [26] An artificial intelligence-based classifier for musical emotion expression in media education
    Lian, Jue
    PEERJ COMPUTER SCIENCE, 2023, 9
  • [27] Modeling of Interactive Teaching and Learning System for Students Based on Artificial Intelligence
    Liu, Jiaming
    Zou, Han
    ADVANCES IN MULTIMEDIA, 2022, 2022
  • [28] Human body gesture recognition method based on deep learning
    Chen, Liang
    Li, Yue
    Liu, Yunting
    PROCEEDINGS OF THE 32ND 2020 CHINESE CONTROL AND DECISION CONFERENCE (CCDC 2020), 2020, : 587 - 591
  • [29] DIAGNOSIS AND TREATMENT SYSTEM BASED ON ARTIFICIAL INTELLIGENCE AND DEEP LEARNING
    Zheng, Xiaoxi
    Fan, Qili
    Wang, Geng
    SCALABLE COMPUTING-PRACTICE AND EXPERIENCE, 2024, 25 (05): : 4360 - 4367
  • [30] Action Recognition Based on Deep Learning and Artificial Intelligence Planning
    Zheng X.-H.
    Sun X.-Q.
    Lu J.-X.
    Xian Z.-Z.
    Li L.
    Tien Tzu Hsueh Pao/Acta Electronica Sinica, 2019, 47 (08): : 1661 - 1668