Real-time interactive projection system based on infrared structured-light method

Interactive technologies have been greatly developed in recent years, especially in projection field. However, at present, most interactive projection systems are based on special designed interactive pens or whiteboards, which is inconvenient and limits the improvement of user experience. In this paper, we introduced our recent progress on theoretically modeling a real-time interactive projection system. The system permits the user to easily operate or draw on the projection screen directly by fingers without any other auxiliary equipment. The projector projects infrared striping patterns onto the screen and the CCD captures the deformational image. We resolve the finger's position and track its movement by processing the deformational image in real-time. A new way to determine whether the finger touches the screen is proposed. The first deformational fringe on the fingertip and the first fringe at the finger shadow are the same one. The correspondence is obtained, so the location parameters can be decided by triangulation. The simulation results are given, and errors are analyzed.