SURFACE SHAPE RECONSTRUCTION OF A NONRIGID TRANSPARENT OBJECT USING REFRACTION AND MOTION

The appearance of a pattern behind a transparent, moving object is distorted by refraction at the moving object's surface. This paper describes an algorithm for reconstructing the surface shape of a nonrigid transparent object, such as water, from the apparent motion of the observed pattern. This algorithm is based on the optical and statistical analysis of the distortions. It consists of the following parts: 1) extraction of optical flow, 2) averaging of each point trajectory obtained from the optical flow sequence, 3) calculation of the surface normal using optical characteristics, and 4) reconstruction of the surface. The algorithm is applied to both synthetic and real images to demonstrate its performance.