Image panoramic mosaicing with global and local registration

This paper presents techniques for constructing full view panoramic mosaics from sequences of images. The goal of this work is to remove too many limitations for pure panning motion. The best reference block is critical for the block-matching method for improving the robustness and performance. It is automatically selected in the high-frequency image, which always contains the plenty visible features. In order to reduce accumulated registration errors, the global registration using the phase-correlation matching method with rotation adjustment is applied to the whole sequence of images, which results in an optimal image mosaic with resolving translational or rotational motion. The local registration using the Levenberg-Marquardt iterative non-linear minimization algorithm is applied to compensate for small amounts of motion parallax introduced by translations of the camera and other unmodeled distortions, then minimize the discrepancy after applying the global registration. The accumulated misregistration errors may cause a visible gap between the two images. A smoothing filter is introduced, derived from Marr's computer vision theory for removing the visible artifact. By combining both global and local registration, together with artifact smoothing, the quality of the image mosaics is significantly improved, thereby enabling the creation of full view panoramic mosaics with hand-held cameras.