Enhanced Autonomous Control in Interactive Multi-Sensory Environments

iMUSE (Interactive Multi-Sensory Environments) promote expression and wellbeing with disabled and older people through the expressive use of sound. This is enabled through the use of non-invasive technology so that participants have the opportunity to exert a degree of control. They can use hand or arm movements to generate sound with accompanying images and vibration. However control of secondary parameters such as the audio timbre and visualisation colour scheme currently have to be adjusted by the facilitator. This paper describes methods of enabling autonomous control for selected aspects of iMUSE in order to enhance the health and wellbeing of the participants. The project focuses on research into potential user interface types and the development of corresponding hardware and software enabling control using simple participant actions. The 'vibration level' and 'visualisation colour' were the parameters chosen as being most relevant to the users. The system is currently being trialled and some preliminary participant observations are given. It is already clear that the MIDI-to-control mapping methodology devised for this project has potential to extend both to other aspects of iMUSE, and to other projects requiring a similar methodology.