Detection of human faces in complex scene images by use of a skin color model and of invariant Fourier-Mellin moments

We use a skin color model based on the Mahalanobis metric and a shape analysis based on invariant Fourier-Mellin moments to automatically detect and locate human faces in two-dimensional complex scene images. First, color segmentation of an input image is performed by thresholding in a normalized hue-saturation color space where the effects of the variability of human skin color and the dependency of chrominance on changes in illumination are reduced. We then group regions of the resulting binary image that have been classified as face candidates into clusters of connected pixels. Discarding the smallest clusters in the image ensures that only a small number of clusters will be used for further analysis. Fully translation-, scale- and in-plane rotation invariant moments are calculated for each remaining cluster. Finally, in order to distinguish faces from distractors, a multilayer perceptron neural network is used with the invariant moments as the input vector Supervised learning of the network is implemented with the backpropagation algorithm, at first for frontal views of faces. Preliminary results show the efficiency of the combination of color segmentation and of invariant moments in detecting faces with a large variety of poses and against relatively complex backgrounds.