Image registration combining cross-scale point matching and multi-scale feature fusion

被引:0
|
作者
Ou, Zhuolin [1 ]
Lu, Xiaoqi [1 ,2 ]
Gu, Yu [1 ]
机构
[1] Inner Mongolia Univ Sci & Technol, Sch Informat Engn, Baotou 014010, Peoples R China
[2] Inner Mongolia Univ Technol, Sch Informat Engn, Hohhot 010051, Peoples R China
基金
中国国家自然科学基金;
关键词
medical image registration; encoder decoder structure; feature weighting; feature matching; attention mechanism;
D O I
10.37188/CJLCD.2023-0278
中图分类号
O7 [晶体学];
学科分类号
0702 ; 070205 ; 0703 ; 080501 ;
摘要
Image registration plays an important role in computer-aided diagnosis of brain diseases and remote surgery. The U-Net and its variants have been widely used in the field of medical image registration, , achieving good results in registration accuracy and time. However, , existing registration models have difficulty in learning the edge features of small structures in complex image deformations and ignore the correlation of contextual information at different scales. To address these issues, , a registration model is proposed based on cross-scale point matching combined with multi-scale feature fusion. Firstly, , a cross-scale point matching module is introduced into encoding structure of the model to enhance the representation of prominent region features and grasp the edge details of small structure features. Then, , multi-scale features are fused in the decoding structure to form a more comprehensive feature description. Finally, , an attention module is integrated into the multi-scale feature fusion module to highlight spatial and channel information. The experimental results on three brain Magnetic Resonance (MR ) datasets show that, , taking the OASIS-3 dataset as an example, , the registration accuracy has been improved by 23. 5%, , 12. 4%, , 0. 9%, , and 2. 1% compared to methods such as Affine, SyN, VoxelMorph and CycleMorph, , respectively. The corresponding ASD values for each method have decreased by 1. 074, 0. 434, 0. 043, and 0. 076. The proposed model can better grasp the feature information of images, , which improves registration accuracy and has important implications for the development of medical image registration.
引用
收藏
页码:1090 / 1102
页数:13
相关论文
共 26 条
  • [11] Jaderberg M, 2015, ADV NEUR IN, V28
  • [12] CycleMorph: Cycle consistent unsupervised deformable image registration
    Kim, Boah
    Kim, Dong Hwan
    Park, Seong Ho
    Kim, Jieun
    Lee, June-Goo
    Ye, Jong Chul
    [J]. MEDICAL IMAGE ANALYSIS, 2021, 71
  • [13] LaMontagne P.J., 2018, Alzheimer's & Dementia: The Journal of the Alzheimer's Association, V14, pP1097, DOI [10.1016/j.jalz.2018.06.1439, 10.1101/2019.12.13.19014902, DOI 10.1016/J.JALZ.2018.06.1439]
  • [14] PointFlow: Flowing Semantics Through Points for Aerial Image Segmentation
    Li, Xiangtai
    He, Hao
    Li, Xia
    Li, Duo
    Cheng, Guangliang
    Shi, Jianping
    Weng, Lubin
    Tong, Yunhai
    Lin, Zhouchen
    [J]. 2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 4215 - 4224
  • [15] Non-Rigid Registration Algorithm of Lung Computed Tomography Image Based on Multi-Scale Parallel Fully Convolutional Neural Network
    Lin Lihao
    Yi Jianbing
    Cao Feng
    Fang Wangsheng
    [J]. LASER & OPTOELECTRONICS PROGRESS, 2022, 59 (16)
  • [16] Image Super-Resolution with Cross-Scale Non-Local Attention and Exhaustive Self-Exemplars Mining
    Mei, Yiqun
    Fan, Yuchen
    Zhou, Yuqian
    Huang, Lichao
    Huang, Thomas S.
    Shi, Honghui
    [J]. 2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, : 5689 - 5698
  • [17] Concurrent Spatial and Channel 'Squeeze & Excitation' in Fully Convolutional Networks
    Roy, Abhijit Guha
    Navab, Nassir
    Wachinger, Christian
    [J]. MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2018, PT I, 2018, 11070 : 421 - 429
  • [18] Construction of a 3D probabilistic atlas of human cortical structures
    Shattuck, David W.
    Mirza, Mubeena
    Adisetiyo, Vitria
    Hojatkashani, Cornelius
    Salamon, Georges
    Narr, Katherine L.
    Poldrack, Russell A.
    Bilder, Robert M.
    Toga, Arthur W.
    [J]. NEUROIMAGE, 2008, 39 (03) : 1064 - 1080
  • [19] Water body segmentation in remote sensing images based on multi-scale fusion attention module improved UNet
    Shi, Tian-Tan
    Guo, Zhong-Hua
    Yan, Xiang
    Wei, Shi-Qin
    [J]. CHINESE JOURNAL OF LIQUID CRYSTALS AND DISPLAYS, 2023, 38 (03) : 397 - 408
  • [20] Texture filtering based unsupervised registration methods and its application in liver computed tomography images
    Wang P.
    Yan Y.
    Qian L.
    Suo S.
    Guo Y.
    Xu J.
    Wang Y.
    [J]. Shengwu Yixue Gongchengxue Zazhi/Journal of Biomedical Engineering, 2021, 38 (05): : 819 - 827