A Multiscale Unsupervised Orientation Estimation Method With Transformers for Remote Sensing Image Matching

Estimating the orientations of remote sensing images is a very important step in remote sensing image matching and is now gradually receiving widespread attention. However, due to the inability to explicitly define the standard orientations of feature points, the current methods still produce feature point orientation estimation errors, resulting in reduced matching accuracy. In this letter, we propose a multiscale unsupervised orientation estimation method with transformers, in which we use a multiscale feature extraction module to aggregate rich semantic features and a transformer-based attention mechanism module to address robust feature extraction in weakly textured regions while predicting the orientations of feature points through a carefully designed loss function. We set up image matching experiments on remote sensing images in different scenes for comparison purposes, and the experimental results show that our proposed method achieves substantially improved orientation estimation accuracy and improved image matching performance.