AI-mediated interaction in virtual reality art

In this paper, we introduce a novel approach to the use of AI technologies to support user experience in Virtual Reality Art installations. The underlying idea is to use semantic representations for interaction events, so as to modify the course of actions to create specific impressions in the user. The system is based on a game engine ported to a CAVE-like immersive display, and uses the engine's event system to integrate AI-based simulation into the user real-time interaction loop. The combination of a set of transformation operators and heuristic search provides a powerful mechanism to generate chain of events. The work is illustrated by the development of an actual VR Art installation inspired from Lewis Caroll's work, and we illustrate the system performance on several examples from the actual installation.