MSDCNet: Multi-stage and deep residual complementary multi-focus image fusion network based on multi-scale feature learning

被引:0
|
作者
Hu, Gang [1 ,2 ]
Jiang, Jinlin [1 ]
Sheng, Guanglei [1 ]
Wei, Guo [3 ]
机构
[1] Xian Univ Technol, Sch Comp Sci & Engn, Xian 710048, Shaanxi, Peoples R China
[2] Xian Univ Technol, Dept Appl Math, Xian 710054, Shaanxi, Peoples R China
[3] Univ North Carolina Pembroke, Pembroke, NC 28372 USA
基金
中国国家自然科学基金;
关键词
Multi-focus; Image fusion; Deep learning; Multi-scale feature extraction; Residual complementary;
D O I
10.1007/s10489-024-05983-0
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Addressing the boundary blurring problem in focus and out-of-focus regions is a key area of research in multifocus image fusion. Effective utilization of multi-scale modules is essential for enhancing performance. Therefore, this paper proposes a multi-stage feature extraction and deep residual complementary multifocus image fusion network. In the feature extraction stage, the V-shaped connection module captures the main objects and contours of the image. The feature thinning extraction module uses extended convolution to learn image details and refine textures at multiple scales. The advanced feature texture enhancement module targets boundary blurring regions, enhancing texture details and improving fusion quality. Asymmetric convolution reduces the network's computational burden, improving feature learning efficiency. The fusion strategy uses a compound loss function to ensure image quality and prevent color distortion. The image reconstruction module uses residual connections with different-sized convolution kernels to maintain feature consistency and improve image quality. The network utilizes a dual-path Pseudo-Siamese structure, which handles image focus and defocus regions separately. Experimental results demonstrate the algorithm's effectiveness. On the Lytro dataset, it achieves AG and EI metric values of 6.9 and 72.5, respectively, outperforming other methods. Fusion metrics SD = 61.80, SF = 19.63, and VIF = 0.94 surpass existing algorithms, effectively resolving the boundary blurring problem and providing better visual perception and broader applicability.
引用
收藏
页数:22
相关论文
共 50 条
  • [21] MSIMCNN: Multi-scale inception module convolutional neural network for multi-focus image fusion
    Wenchang Gao
    Lei Yu
    Yao Tan
    Pengna Yang
    Applied Intelligence, 2022, 52 : 14085 - 14100
  • [22] MSIMCNN: Multi-scale inception module convolutional neural network for multi-focus image fusion
    Gao, Wenchang
    Yu, Lei
    Tan, Yao
    Yang, Pengna
    APPLIED INTELLIGENCE, 2022, 52 (12) : 14085 - 14100
  • [23] Hyperspectral Image Classification Based on Multi-Scale Feature Fusion Residual Network
    Deng Ziqing
    Wang Yang
    Zhang Bing
    Ding Zhao
    Bian Lifeng
    Yang Chen
    LASER & OPTOELECTRONICS PROGRESS, 2022, 59 (18)
  • [24] Multi-focus image fusion using multi-scale image decomposition and saliency detection
    Bavirisetti, Durga Prasad
    Dhuli, Ravindra
    AIN SHAMS ENGINEERING JOURNAL, 2018, 9 (04) : 1103 - 1117
  • [25] Multi-Focus Image Region Fusion and Registration Algorithm with Multi-Scale Wavelet
    Liu, Hai
    Zhou, Xiangchao
    INTELLIGENT AUTOMATION AND SOFT COMPUTING, 2020, 26 (06): : 1493 - 1501
  • [26] Multi-focus: Focused region finding and multi-scale transform for image fusion
    He, Kangjian
    Zhou, Dongming
    Zhang, Xuejie
    Nie, Rencan
    NEUROCOMPUTING, 2018, 320 : 157 - 170
  • [27] Multi-Focus Image Fusion with Multi-Scale Transform Optimized by Metaheuristic Algorithms
    Abas, Asan Ihsan
    Baykan, Nurdan Akhan
    TRAITEMENT DU SIGNAL, 2021, 38 (02) : 247 - 259
  • [28] Multi-Focus Color Image Fusion Based on Quaternion Multi-Scale Singular Value Decomposition
    Wan, Hui
    Tang, Xianlun
    Zhu, Zhiqin
    Xiao, Bin
    Li, Weisheng
    FRONTIERS IN NEUROROBOTICS, 2021, 15
  • [29] A multi-focus image fusion framework based on multi-scale sparse representation in gradient domain
    Wang, Yu
    Li, Xiongfei
    Zhu, Rui
    Wang, Zeyu
    Feng, Yuncong
    Zhang, Xiaoli
    SIGNAL PROCESSING, 2021, 189
  • [30] A novel image fusion method for multi-focus image fusion based on the Nonsubsampled Contourlet Transform and multi-scale statistic
    You, Chunyan
    Yang, Shizhong
    Zhao, Bo
    Liu, Yong
    Journal of Information and Computational Science, 2014, 11 (06): : 1715 - 1722