Coarse-to-Fine Homography Estimation for Infrared and Visible Images

被引:3
|
作者
Wang, Xingyi [1 ]
Luo, Yinhui [1 ]
Fu, Qiang [1 ]
He, Yuanqing [1 ]
Shu, Chang [1 ]
Wu, Yuezhou [1 ]
Liao, Yanhao [1 ]
机构
[1] Civil Aviat Flight Univ China, Sch Comp Sci, Guanghan 618307, Peoples R China
关键词
homography estimation; coarse-to-fine; infrared image; visible image;
D O I
10.3390/electronics12214441
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Homography estimation for infrared and visible images is a critical and fundamental task in multimodal image processing. Recently, the coarse-to-fine strategy has been gradually applied to the homography estimation task and has proved to be effective. However, current coarse-to-fine homography estimation methods typically require the introduction of additional neural networks to acquire multi-scale feature maps and the design of complex homography matrix fusion strategies. In this paper, we propose a new unsupervised homography estimation method for infrared and visible images. First, we design a novel coarse-to-fine strategy. This strategy utilizes different stages in the regression network to obtain multi-scale feature maps, enabling the progressive refinement of the homography matrix. Second, we design a local correlation transformer (LCTrans), which aims to capture the intrinsic connections between local features more precisely, thus highlighting the features crucial for homography estimation. Finally, we design an average feature correlation loss (AFCL) to enhance the robustness of the model. Through extensive experiments, we validated the effectiveness of all the proposed components. Experimental results demonstrate that our method outperforms existing methods on synthetic benchmark datasets in both qualitative and quantitative comparisons.
引用
收藏
页数:20
相关论文
共 50 条
  • [21] A coarse-to-fine approach to prostate boundary segmentation in ultrasound images
    Sahba, Farhang
    Tizhoosh, Hamid R.
    Salama, Magdy M.
    BIOMEDICAL ENGINEERING ONLINE, 2005, 4 (1)
  • [22] Coarse-to-fine Disentangling Demoiring Framework for Recaptured Screen Images
    Wang, Ce
    He, Bin
    Wu, Shengsen
    Wan, Renjie
    Shi, Boxin
    Duan, Ling-Yu
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2023, 45 (08) : 9439 - 9453
  • [23] A coarse-to-fine approach to prostate boundary segmentation in ultrasound images
    Farhang Sahba
    Hamid R Tizhoosh
    Magdy M Salama
    BioMedical Engineering OnLine, 4
  • [24] Coarse-to-Fine Task-Driven Inpainting for Geoscience Images
    Sun, Huiming
    Ma, Jin
    Guo, Qing
    Zou, Qin
    Song, Shaoyue
    Lin, Yuewei
    Yu, Hongkai
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2023, 33 (12) : 7170 - 7182
  • [25] Coarse-to-fine matching via cross fusion of satellite images
    Li, Liangzhi
    Han, Ling
    Gao, Kyle
    He, Hongjie
    Wang, Lanying
    Li, Jonathan
    INTERNATIONAL JOURNAL OF APPLIED EARTH OBSERVATION AND GEOINFORMATION, 2023, 125
  • [26] A Coarse-to-fine Approach for Vehicles Detection from Aerial Images
    Chen, Long
    Jiang, Zhiguo
    Yang, Junli
    Ma, Yibing
    PROCEEDINGS OF INTERNATIONAL CONFERENCE ON COMPUTER VISION IN REMOTE SENSING, 2012, : 221 - 225
  • [27] Circles Detection in Images by Using of Coarse-to-Fine Search Technique
    Fu Hudai
    Wang Hua
    Gao Jingang
    ADVANCES IN MANUFACTURING TECHNOLOGY, PTS 1-4, 2012, 220-223 : 1385 - 1388
  • [28] Learning hyperspectral images from RGB images via a coarse-to-fine CNN
    Shaohui Mei
    Yunhao Geng
    Junhui Hou
    Qian Du
    Science China Information Sciences, 2022, 65
  • [29] A Coarse-to-Fine Method for Cloud Detection in Remote Sensing Images
    Kang, Xudong
    Gao, Guanghao
    Hao, Qiaobo
    Li, Shutao
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2019, 16 (01) : 110 - 114
  • [30] Learning hyperspectral images from RGB images via a coarse-to-fine CNN
    Shaohui MEI
    Yunhao GENG
    Junhui HOU
    Qian DU
    ScienceChina(InformationSciences), 2022, 65 (05) : 51 - 64