Robust Multi-Modal Image Registration for Image Fusion Enhancement in Infrastructure Inspection

被引:1
|
作者
Shahsavarani, Sara [1 ]
Lopez, Fernando [2 ]
Ibarra-Castanedo, Clemente [1 ]
Maldague, Xavier P. V. [1 ]
机构
[1] Univ Laval, Fac Sci & Engn, Dept Elect & Comp Engn, Comp Vis & Syst Lab CVSL, Quebec City, PQ G1V 0A6, Canada
[2] TORNGATS Serv Tech, 200 Boul Parc Technol, Quebec City, PQ G1P 4S3, Canada
基金
加拿大创新基金会; 加拿大自然科学与工程研究理事会;
关键词
IR and VIS image registration; IR and VIS image fusion; feature-points threshold; non-maximum suppression; homography estimation; template matching; self-supervised learning; MUTUAL INFORMATION; AUTOMATIC REGISTRATION; OPTIMIZATION;
D O I
10.3390/s24123994
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
Efficient multi-modal image fusion plays an important role in the non-destructive evaluation (NDE) of infrastructures, where an essential challenge is the precise visualizing of defects. While automatic defect detection represents a significant advancement, the determination of the precise location of both surface and subsurface defects simultaneously is crucial. Hence, visible and infrared data fusion strategies are essential for acquiring comprehensive and complementary information to detect defects across vast structures. This paper proposes an infrared and visible image registration method based on Euclidean evaluation together with a trade-off between key-point threshold and non-maximum suppression. Moreover, we employ a multi-modal fusion strategy to investigate the robustness of our image registration results.
引用
收藏
页数:18
相关论文
共 50 条
  • [11] Multi-modal image registration: matching MRI with histology
    Alic, Lejla
    Haeck, Joost C.
    Klein, Stefan
    Bol, Karin
    Van Tiel, Sandra T.
    Wielepolski, Piotr A.
    Bijster, Magda
    Niessen, Wiro J.
    Bernsen, Monique
    Veenland, Jifke F.
    de Jong, Marion
    MEDICAL IMAGING 2010: BIOMEDICAL APPLICATIONS IN MOLECULAR, STRUCTURAL, AND FUNCTIONAL IMAGING, 2010, 7626
  • [12] Multi-modal image set registration and atlas formation
    Lorenzen, Peter
    Prastawa, Marcel
    Davis, Brad
    Gerig, Guido
    Bullitt, Elizabeth
    Joshi, Sarang
    MEDICAL IMAGE ANALYSIS, 2006, 10 (03) : 440 - 451
  • [13] Multi-Modal Image Registration Using Structural Features
    Kasiri, Keyvan
    Clausi, David A.
    Fieguth, Paul
    2014 36TH ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY (EMBC), 2014, : 5550 - 5553
  • [14] Multi-Modal Medical Image Elastic Registration Algorithm
    Zhao, Zhichao
    Wu, T. F.
    INDIAN JOURNAL OF PHARMACEUTICAL SCIENCES, 2019, 81 (01) : S61 - S61
  • [15] Hybrid genetic algorithm for multi-modal image registration
    Biomedical Instrument Institute, Shanghai Jiaotong University, Shanghai 200030, China
    J. Harbin Inst. Technol., 2006, 1 (82-87):
  • [16] High-dimensional multi-modal image registration
    Lorenzen, PJ
    Joshi, SC
    BIOMEDICAL IMAGE REGISTRATION, 2003, 2717 : 234 - 243
  • [17] A NEW SIMILARITY MEASURE FOR MULTI-MODAL IMAGE REGISTRATION
    Pickering, Mark R.
    2011 18TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2011,
  • [18] Fast and Robust Multi-modal Image Registration for 3D Knee Kinematics
    Saadat, Shabnam
    Pickering, Mark R.
    Perriman, Diana
    Scarvell, Jennie M.
    Smith, Paul N.
    2017 INTERNATIONAL CONFERENCE ON DIGITAL IMAGE COMPUTING - TECHNIQUES AND APPLICATIONS (DICTA), 2017, : 575 - 579
  • [19] Multi-modal Fundus Image Registration with Deep Feature Matching and Image Scaling
    Kim, Ju-Chan
    Le, Duc-Tai
    Song, Su Jeong
    Son, Chang-Hwan
    Choo, Hyunseung
    PROCEEDINGS OF THE 2022 16TH INTERNATIONAL CONFERENCE ON UBIQUITOUS INFORMATION MANAGEMENT AND COMMUNICATION (IMCOM 2022), 2022,
  • [20] Unsupervised Multi-Modal Image Registration via Geometry Preserving Image-to-Image Translation
    Arar, Moab
    Ginger, Yiftach
    Danon, Dov
    Bermano, Amit H.
    Cohen-Or, Daniel
    2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2020), 2020, : 13407 - 13416