A multiscale approach to image sequence analysis

In optic flow based velocity estimation the image brightness constraint equation is used, However, for measurements performed at a certain scale, the brightness constraint equation does not apply. We therefore use a recently developed approach which reconciles optic flow and scale space theory. It specifically incorporates the scale (aperture) of image measurements, leading to a scheme which is essentially different from existing approaches. To obtain a unique velocity field, the data-derived information has to be augmented with physical knowledge, By keeping a strict separation between data-derived and external information, we can locally adapt or modify the user-supplied information without affecting the image-derived information. The two free scale parameters in time and space can be used for attentive vision (selecting particular velocities or objects) and to improve the reliability of velocity estimates. (C) 1997 Academic Press.