Low-Cost 3DUI Using Hand Tracking and Controllers

The goal of this project is create and evaluate a 3D user interface with functionalities resembling the interface shown in Bruce Branit's short film, World Builder. This paper describes an interface consisting of a Microsoft Kinect for hand tracking and interaction with the virtual environment in conjunction with Nintendo Wii Nunchuk controllers for navigation and further input. The interface is tested three times; testing the navigation control scheme, the manipulation methods as well as the overall performance. The interface was generally well received, even though the test application has some faults and needs further development.