Robust Multi-Modal Image Registration for Image Fusion Enhancement in Infrastructure Inspection

被引:1
|
作者
Shahsavarani, Sara [1 ]
Lopez, Fernando [2 ]
Ibarra-Castanedo, Clemente [1 ]
Maldague, Xavier P. V. [1 ]
机构
[1] Univ Laval, Fac Sci & Engn, Dept Elect & Comp Engn, Comp Vis & Syst Lab CVSL, Quebec City, PQ G1V 0A6, Canada
[2] TORNGATS Serv Tech, 200 Boul Parc Technol, Quebec City, PQ G1P 4S3, Canada
基金
加拿大创新基金会; 加拿大自然科学与工程研究理事会;
关键词
IR and VIS image registration; IR and VIS image fusion; feature-points threshold; non-maximum suppression; homography estimation; template matching; self-supervised learning; MUTUAL INFORMATION; AUTOMATIC REGISTRATION; OPTIMIZATION;
D O I
10.3390/s24123994
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
Efficient multi-modal image fusion plays an important role in the non-destructive evaluation (NDE) of infrastructures, where an essential challenge is the precise visualizing of defects. While automatic defect detection represents a significant advancement, the determination of the precise location of both surface and subsurface defects simultaneously is crucial. Hence, visible and infrared data fusion strategies are essential for acquiring comprehensive and complementary information to detect defects across vast structures. This paper proposes an infrared and visible image registration method based on Euclidean evaluation together with a trade-off between key-point threshold and non-maximum suppression. Moreover, we employ a multi-modal fusion strategy to investigate the robustness of our image registration results.
引用
收藏
页数:18
相关论文
共 50 条
  • [1] Robust Multi-Scale Multi-modal Image Registration
    Holtzman-Gazit, Michal
    Yavneh, Irad
    SIGNAL PROCESSING, SENSOR FUSION, AND TARGET RECOGNITION XIX, 2010, 7697
  • [2] MURF: Mutually Reinforcing Multi-Modal Image Registration and Fusion
    Xu, Han
    Yuan, Jiteng
    Ma, Jiayi
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2023, 45 (10) : 12148 - 12166
  • [3] Dynamic Brightness Adaptation for Robust Multi-modal Image Fusion
    Sun, Yiming
    Cao, Bing
    Zhu, Pengfei
    Hu, Qinghua
    PROCEEDINGS OF THE THIRTY-THIRD INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, IJCAI 2024, 2024, : 1317 - 1325
  • [4] Multi-Modal Deformable Medical Image Registration
    Fookes, Clinton
    Sridharan, Sridha
    ICSPCS: 2ND INTERNATIONAL CONFERENCE ON SIGNAL PROCESSING AND COMMUNICATION SYSTEMS, PROCEEDINGS, 2008, : 661 - 669
  • [5] RFNet: Unsupervised Network for Mutually Reinforcing Multi-modal Image Registration and Fusion
    Xu, Han
    Ma, Jiayi
    Yuan, Jiteng
    Le, Zhuliang
    Liu, Wei
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, : 19647 - 19656
  • [6] Cross-modal attention for multi-modal image registration
    Song, Xinrui
    Chao, Hanqing
    Xu, Xuanang
    Guo, Hengtao
    Xu, Sheng
    Turkbey, Baris
    Wood, Bradford J.
    Sanford, Thomas
    Wang, Ge
    Yan, Pingkun
    MEDICAL IMAGE ANALYSIS, 2022, 82
  • [7] Guided Image Deblurring by Deep Multi-Modal Image Fusion
    Liu, Yuqi
    Sheng, Zehua
    Shen, Hui-Liang
    IEEE ACCESS, 2022, 10 : 130708 - 130718
  • [8] Multi-modal Image Fusion with KNN Matting
    Zhang, Xia
    Lin, Hui
    Kang, Xudong
    Li, Shutao
    PATTERN RECOGNITION (CCPR 2014), PT II, 2014, 484 : 89 - 96
  • [9] An overview of multi-modal medical image fusion
    Du, Jiao
    Li, Weisheng
    Lu, Ke
    Xiao, Bin
    NEUROCOMPUTING, 2016, 215 : 3 - 20
  • [10] Multi-modal and multi-vendor retina image registration
    Li, Zhang
    Huang, Fan
    Zhang, Jiong
    Dashtbozorg, Behdad
    Abbasi-Sureshjani, Samaneh
    Sun, Yue
    Long, Xi
    Yu, Qifeng
    Romeny, Bart ter Haar
    Tan, Tao
    BIOMEDICAL OPTICS EXPRESS, 2018, 9 (02): : 410 - 422