MSDCNet: Multi-stage and deep residual complementary multi-focus image fusion network based on multi-scale feature learning

被引:0
|
作者
Hu, Gang [1 ,2 ]
Jiang, Jinlin [1 ]
Sheng, Guanglei [1 ]
Wei, Guo [3 ]
机构
[1] Xian Univ Technol, Sch Comp Sci & Engn, Xian 710048, Shaanxi, Peoples R China
[2] Xian Univ Technol, Dept Appl Math, Xian 710054, Shaanxi, Peoples R China
[3] Univ North Carolina Pembroke, Pembroke, NC 28372 USA
基金
中国国家自然科学基金;
关键词
Multi-focus; Image fusion; Deep learning; Multi-scale feature extraction; Residual complementary;
D O I
10.1007/s10489-024-05983-0
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Addressing the boundary blurring problem in focus and out-of-focus regions is a key area of research in multifocus image fusion. Effective utilization of multi-scale modules is essential for enhancing performance. Therefore, this paper proposes a multi-stage feature extraction and deep residual complementary multifocus image fusion network. In the feature extraction stage, the V-shaped connection module captures the main objects and contours of the image. The feature thinning extraction module uses extended convolution to learn image details and refine textures at multiple scales. The advanced feature texture enhancement module targets boundary blurring regions, enhancing texture details and improving fusion quality. Asymmetric convolution reduces the network's computational burden, improving feature learning efficiency. The fusion strategy uses a compound loss function to ensure image quality and prevent color distortion. The image reconstruction module uses residual connections with different-sized convolution kernels to maintain feature consistency and improve image quality. The network utilizes a dual-path Pseudo-Siamese structure, which handles image focus and defocus regions separately. Experimental results demonstrate the algorithm's effectiveness. On the Lytro dataset, it achieves AG and EI metric values of 6.9 and 72.5, respectively, outperforming other methods. Fusion metrics SD = 61.80, SF = 19.63, and VIF = 0.94 surpass existing algorithms, effectively resolving the boundary blurring problem and providing better visual perception and broader applicability.
引用
收藏
页数:22
相关论文
共 50 条
  • [1] MSDCNet: Multi-stage and deep residual complementary multi-focus image fusion network based on multi-scale feature learningMSDCNet: Multi-stage and deep residual complementary multi-focus image fusion network based on multi-scale feature learningG. Hu et al.
    Gang Hu
    Jinlin Jiang
    Guanglei Sheng
    Guo Wei
    Applied Intelligence, 2025, 55 (3)
  • [2] Multi-Focus Image Fusion Method Based on Multi-Scale Decomposition of Information Complementary
    Wan, Hui
    Tang, Xianlun
    Zhu, Zhiqin
    Li, Weisheng
    ENTROPY, 2021, 23 (10)
  • [3] Multi-Focus Image Fusion Based on Multi-Scale Generative Adversarial Network
    Ma, Xiaole
    Wang, Zhihai
    Hu, Shaohai
    Kan, Shichao
    ENTROPY, 2022, 24 (05)
  • [4] Multi-scale convolutional neural network for multi-focus image fusion
    Mustafa, Hafiz Tayyab
    Yang, Jie
    Zareapoor, Masoumeh
    IMAGE AND VISION COMPUTING, 2019, 85 : 26 - 35
  • [5] Multi-Scale Visual Attention Deep Convolutional Neural Network for Multi-Focus Image Fusion
    Lai, Rui
    Li, Yongxue
    Guan, Juntao
    Xiong, Ai
    IEEE ACCESS, 2019, 7 : 114385 - 114399
  • [6] Multi-focus image fusion based on multi-scale sparse representation
    Ma, Xiaole
    Wang, Zhihai
    Hu, Shaohai
    JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2021, 81
  • [7] Multi-Focus Image Fusion Based on Multi-Scale Gradients and Image Matting
    Chen, Jun
    Li, Xuejiao
    Luo, Linbo
    Ma, Jiayi
    IEEE TRANSACTIONS ON MULTIMEDIA, 2022, 24 : 655 - 667
  • [8] Multi-scale siamese networks for multi-focus image fusion
    Wu, Pan
    Hua, Zhen
    Li, Jinjiang
    MULTIMEDIA TOOLS AND APPLICATIONS, 2023, 82 (10) : 15651 - 15672
  • [9] Multi-scale siamese networks for multi-focus image fusion
    Pan Wu
    Zhen Hua
    Jinjiang Li
    Multimedia Tools and Applications, 2023, 82 : 15651 - 15672
  • [10] A new multi-focus image fusion method based on multi-classification focus learning and multi-scale decomposition
    Ma, Lifeng
    Hu, Yanxiang
    Zhang, Bo
    Li, Jiaqi
    Chen, Zhijie
    Sun, Wenhao
    APPLIED INTELLIGENCE, 2023, 53 (02) : 1452 - 1468