The Relationship Between Sound of VR Concert and Motion Activity of Audience

In studies on the spectators of events, there have been several attempts at analyzing the excitement of spectators. In this work, we focus on the music performance using VR technology (VR concert) and propose the kinect-based motion recording system to analyze the relationship between the sound of VR concert and the motion activity of the audience in VR concert. For the motion recording system, we used a head mounted display (HMD), motion capture equipment and two host computers to show a music performance video to the audience by Unity and to record motion data of the audience by MATLAB (R). Moreover, we used the equation to calculate the motion activity of the audience from the mean of whole joint's inter-frame coordinate translation in recorded motion data. To evaluate the motion recording system, we conducted experiments of watching a music performance video including background sound and recording motion data on examinees including 3 different conditions: Resting state (C1), watching a music performance video (C2) and watching a music performance video with sound of studio version (C3). The result shows that the mean of motion activity in C3 is larger than one in C2 and that there is few difference in the standard deviation of motion activity in each condition; which found that the background sound does not always increase the audience's motion.