Coarse-to-Fine Homography Estimation for Infrared and Visible Images

被引:3
|
作者
Wang, Xingyi [1 ]
Luo, Yinhui [1 ]
Fu, Qiang [1 ]
He, Yuanqing [1 ]
Shu, Chang [1 ]
Wu, Yuezhou [1 ]
Liao, Yanhao [1 ]
机构
[1] Civil Aviat Flight Univ China, Sch Comp Sci, Guanghan 618307, Peoples R China
关键词
homography estimation; coarse-to-fine; infrared image; visible image;
D O I
10.3390/electronics12214441
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Homography estimation for infrared and visible images is a critical and fundamental task in multimodal image processing. Recently, the coarse-to-fine strategy has been gradually applied to the homography estimation task and has proved to be effective. However, current coarse-to-fine homography estimation methods typically require the introduction of additional neural networks to acquire multi-scale feature maps and the design of complex homography matrix fusion strategies. In this paper, we propose a new unsupervised homography estimation method for infrared and visible images. First, we design a novel coarse-to-fine strategy. This strategy utilizes different stages in the regression network to obtain multi-scale feature maps, enabling the progressive refinement of the homography matrix. Second, we design a local correlation transformer (LCTrans), which aims to capture the intrinsic connections between local features more precisely, thus highlighting the features crucial for homography estimation. Finally, we design an average feature correlation loss (AFCL) to enhance the robustness of the model. Through extensive experiments, we validated the effectiveness of all the proposed components. Experimental results demonstrate that our method outperforms existing methods on synthetic benchmark datasets in both qualitative and quantitative comparisons.
引用
收藏
页数:20
相关论文
共 50 条
  • [31] Learning hyperspectral images from RGB images via a coarse-to-fine CNN
    Mei, Shaohui
    Geng, Yunhao
    Hou, Junhui
    Du, Qian
    SCIENCE CHINA-INFORMATION SCIENCES, 2022, 65 (05)
  • [32] COARSE-TO-FINE PARTIAL DISTORTION SEARCH ALGORITHM FOR MOTION ESTIMATION
    Yeh, Chia-Hung
    Wu, Ming-Te
    Chern, Shiunn-Jang
    INTERNATIONAL JOURNAL OF INNOVATIVE COMPUTING INFORMATION AND CONTROL, 2009, 5 (09): : 2523 - 2530
  • [33] Coarse-to-fine Optical Flow Estimation with Image Structure Tensor
    Chen, Zhen
    Zhang, Congxuan
    Li, Ming
    2013 6TH INTERNATIONAL CONGRESS ON IMAGE AND SIGNAL PROCESSING (CISP), VOLS 1-3, 2013, : 741 - 746
  • [34] Sparse-to-dense coarse-to-fine depth estimation for colonoscopy*
    Liu, Ruyu
    Liu, Zhengzhe
    Lu, Jiaming
    Zhang, Guodao
    Zuo, Zhigui
    Sun, Bo
    Zhang, Jianhua
    Sheng, Weiguo
    Guo, Ran
    Zhang, Lejun
    Hua, Xiaozhen
    COMPUTERS IN BIOLOGY AND MEDICINE, 2023, 160
  • [35] Coarse-to-Fine Multi-camera Network Topology Estimation
    Xing, Chang
    Bai, Sichen
    Zhou, Yi
    Zhou, Zhong
    Wu, Wei
    ADVANCES IN MULTIMEDIA INFORMATION PROCESSING - PCM 2017, PT II, 2018, 10736 : 981 - 990
  • [36] Coarse-to-Fine 3D Human Pose Estimation
    Guo, Yu
    Zhao, Lin
    Zhang, Shanshan
    Yang, Jian
    IMAGE AND GRAPHICS, ICIG 2019, PT III, 2019, 11903 : 579 - 592
  • [37] A Coarse-to-Fine Estimation Method for Spatial Layout of Indoor Scenes
    Liu T.
    Gu Y.
    Cao D.
    Dai X.
    Luo J.
    Jiqiren/Robot, 2019, 41 (01): : 58 - 64
  • [38] Coarse-to-fine Planar Regularization for Dense Monocular Depth Estimation
    Liwicki, Stephan
    Zach, Christopher
    Miksik, Ondrej
    Torr, Philip H. S.
    COMPUTER VISION - ECCV 2016, PT II, 2016, 9906 : 458 - 474
  • [39] Visual Face Tracking: a Coarse-to-Fine Target State Estimation
    Bouachir, Wassim
    Bilodeau, Guillaume-Alexandre
    2013 INTERNATIONAL CONFERENCE ON COMPUTER AND ROBOT VISION (CRV), 2013, : 45 - 51
  • [40] 'Coarse-to-fine' cyclopean processing
    Popple, AV
    Findlay, JM
    PERCEPTION, 1999, 28 (02) : 155 - 165