Coarse-to-Fine Homography Estimation for Infrared and Visible Images

被引:3
|
作者
Wang, Xingyi [1 ]
Luo, Yinhui [1 ]
Fu, Qiang [1 ]
He, Yuanqing [1 ]
Shu, Chang [1 ]
Wu, Yuezhou [1 ]
Liao, Yanhao [1 ]
机构
[1] Civil Aviat Flight Univ China, Sch Comp Sci, Guanghan 618307, Peoples R China
关键词
homography estimation; coarse-to-fine; infrared image; visible image;
D O I
10.3390/electronics12214441
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Homography estimation for infrared and visible images is a critical and fundamental task in multimodal image processing. Recently, the coarse-to-fine strategy has been gradually applied to the homography estimation task and has proved to be effective. However, current coarse-to-fine homography estimation methods typically require the introduction of additional neural networks to acquire multi-scale feature maps and the design of complex homography matrix fusion strategies. In this paper, we propose a new unsupervised homography estimation method for infrared and visible images. First, we design a novel coarse-to-fine strategy. This strategy utilizes different stages in the regression network to obtain multi-scale feature maps, enabling the progressive refinement of the homography matrix. Second, we design a local correlation transformer (LCTrans), which aims to capture the intrinsic connections between local features more precisely, thus highlighting the features crucial for homography estimation. Finally, we design an average feature correlation loss (AFCL) to enhance the robustness of the model. Through extensive experiments, we validated the effectiveness of all the proposed components. Experimental results demonstrate that our method outperforms existing methods on synthetic benchmark datasets in both qualitative and quantitative comparisons.
引用
收藏
页数:20
相关论文
共 50 条
  • [41] Coarse-to-fine face detection
    Fleuret, F
    Geman, D
    INTERNATIONAL JOURNAL OF COMPUTER VISION, 2001, 41 (1-2) : 85 - 107
  • [42] Coarse-to-fine manifold learning
    Castro, R
    Willett, R
    Nowak, R
    2004 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, VOL III, PROCEEDINGS: IMAGE AND MULTIDIMENSIONAL SIGNAL PROCESSING SPECIAL SESSIONS, 2004, : 992 - 995
  • [43] Coarse-to-Fine Grained Classification
    Huo, Yuqi
    Lu, Yao
    Niu, Yulei
    Lu, Zhiwu
    Wen, Ji-Rong
    PROCEEDINGS OF THE 42ND INTERNATIONAL ACM SIGIR CONFERENCE ON RESEARCH AND DEVELOPMENT IN INFORMATION RETRIEVAL (SIGIR '19), 2019, : 1033 - 1036
  • [44] Coarse-to-fine dynamic programming
    Raphael, C
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2001, 23 (12) : 1379 - 1390
  • [45] An unsupervised coarse-to-fine algorithm for blood vessel segmentation in fundus images
    Neto, Luiz Camara
    Ramalho, Geraldo L. B.
    Rocha Neto, Jeova F. S.
    Veras, Rodrigo M. S.
    Medeiros, Fatima N. S.
    EXPERT SYSTEMS WITH APPLICATIONS, 2017, 78 : 182 - 192
  • [46] Optic disc detection in retinal images via a coarse-to-fine scheme
    Li, Q. (kenneth_lee_qin@qq.com), 1600, Binary Information Press (10):
  • [47] Coarse-to-Fine Face Detection
    Francois Fleuret
    Donald Geman
    International Journal of Computer Vision, 2001, 41 : 85 - 107
  • [48] Coarse-to-fine tuning knowledgeable system for boundary delineation in medical images
    Peng, Tao
    Wu, Yiyun
    Zhao, Jing
    Wang, Caishan
    Wang, Wenjie
    Shen, Yuntian
    Cai, Jing
    APPLIED INTELLIGENCE, 2023, 53 (24) : 30642 - 30660
  • [49] Active Coarse-to-Fine Segmentation of Moveable Parts from Real Images
    Wang, Ruiqi
    Patil, Akshay Gadi
    Yu, Fenggen
    Zhang, Hao
    COMPUTER VISION - ECCV 2024, PT XXXIV, 2025, 15092 : 111 - 127
  • [50] Segmentation of elastographic images using a coarse-to-fine active contour model
    Liu, W
    Zagzebski, JA
    Varghese, T
    Dyer, CR
    Techavipoo, U
    Hall, TJ
    ULTRASOUND IN MEDICINE AND BIOLOGY, 2006, 32 (03): : 397 - 408