Graph cut based multiple view segmentation for 3D reconstruction

In this paper we propose a novel framework for efficiently extracting foreground objects in so called short-baseline image sequences. We apply the obtained segmentation to improve subsequent 3D reconstruction results. Essentially, our framework combines a graph cut based optimization algorithm with an intuitive user interface. At first a meanshift segmentation algorithm partitions each image of the sequence into a certain number of regions. Additionally we provide an intelligent graphical user interface for easy specification of foreground as well as background regions across all images of the sequence. Within the graph cut optimization algorithm we define new energy terms to increase the robustness and to keep the segmentation of the foreground object coherent across all images of the sequence. Finally, a refined graph cut segmentation and several adjustment operations allow an accurate and effective foreground extraction. The obtained results are demonstrated on several real world data sets.