MSDCNet: Multi-stage and deep residual complementary multi-focus image fusion network based on multi-scale feature learning

被引:0
|
作者
Hu, Gang [1 ,2 ]
Jiang, Jinlin [1 ]
Sheng, Guanglei [1 ]
Wei, Guo [3 ]
机构
[1] Xian Univ Technol, Sch Comp Sci & Engn, Xian 710048, Shaanxi, Peoples R China
[2] Xian Univ Technol, Dept Appl Math, Xian 710054, Shaanxi, Peoples R China
[3] Univ North Carolina Pembroke, Pembroke, NC 28372 USA
基金
中国国家自然科学基金;
关键词
Multi-focus; Image fusion; Deep learning; Multi-scale feature extraction; Residual complementary;
D O I
10.1007/s10489-024-05983-0
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Addressing the boundary blurring problem in focus and out-of-focus regions is a key area of research in multifocus image fusion. Effective utilization of multi-scale modules is essential for enhancing performance. Therefore, this paper proposes a multi-stage feature extraction and deep residual complementary multifocus image fusion network. In the feature extraction stage, the V-shaped connection module captures the main objects and contours of the image. The feature thinning extraction module uses extended convolution to learn image details and refine textures at multiple scales. The advanced feature texture enhancement module targets boundary blurring regions, enhancing texture details and improving fusion quality. Asymmetric convolution reduces the network's computational burden, improving feature learning efficiency. The fusion strategy uses a compound loss function to ensure image quality and prevent color distortion. The image reconstruction module uses residual connections with different-sized convolution kernels to maintain feature consistency and improve image quality. The network utilizes a dual-path Pseudo-Siamese structure, which handles image focus and defocus regions separately. Experimental results demonstrate the algorithm's effectiveness. On the Lytro dataset, it achieves AG and EI metric values of 6.9 and 72.5, respectively, outperforming other methods. Fusion metrics SD = 61.80, SF = 19.63, and VIF = 0.94 surpass existing algorithms, effectively resolving the boundary blurring problem and providing better visual perception and broader applicability.
引用
收藏
页数:22
相关论文
共 50 条
  • [41] 3M: A Multi-Scale and Multi-Directional Method for Multi-Focus Image Fusion
    Wei, Bingzhe
    Feng, Xiangchu
    Wang, Weiwei
    IEEE ACCESS, 2021, 9 : 48531 - 48543
  • [42] Multi-Stage Multi-Scale Local Feature Fusion for Infrared Small Target Detection
    Wang, Yahui
    Tian, Yan
    Liu, Jijun
    Xu, Yiping
    REMOTE SENSING, 2023, 15 (18)
  • [43] Fast Multi-Focus Fusion Based on Deep Learning for Early-Stage Embryo Image Enhancement
    Raudonis, Vidas
    Paulauskaite-Taraseviciene, Agne
    Sutiene, Kristina
    SENSORS, 2021, 21 (03) : 1 - 15
  • [44] SFPN: segmentation-based feature pyramid network for multi-focus image fusion
    Pan Wu
    Limai Jiang
    Ying Li
    Hui Fan
    Jinjiang Li
    Multimedia Tools and Applications, 2024, 83 : 20055 - 20082
  • [45] DFANet: A Dual-Stream Deep Feature Aware Network for Multi-focus Image Fusion
    Dong, Yuye
    Zhao, Libo
    Li, Xiongfei
    Zhang, Xiaoli
    PATTERN RECOGNITION AND COMPUTER VISION, PRCV 2024, PT XV, 2025, 15045 : 319 - 333
  • [46] Convolutional Neural Network Based Multi-Focus Image Fusion
    Li, Huaguang
    Nie, Rencan
    Zhou, Dongming
    Gou, Xiaopeng
    PROCEEDINGS OF THE 2018 2ND INTERNATIONAL CONFERENCE ON ALGORITHMS, COMPUTING AND SYSTEMS (ICACS 2018), 2018, : 148 - 154
  • [47] SFPN: segmentation-based feature pyramid network for multi-focus image fusion
    Wu, Pan
    Jiang, Limai
    Li, Ying
    Fan, Hui
    Li, Jinjiang
    MULTIMEDIA TOOLS AND APPLICATIONS, 2024, 83 (07) : 20055 - 20082
  • [48] Multi-Focus Image Fusion Based on Generative Adversarial Network
    Jiang L.
    Zhang D.
    Pan B.
    Zheng P.
    Che L.
    Jisuanji Fuzhu Sheji Yu Tuxingxue Xuebao/Journal of Computer-Aided Design and Computer Graphics, 2021, 33 (11): : 1715 - 1725
  • [49] Color multi-focus image fusion based on transfer learning
    Wang, Yun
    Jin, Xin
    Yang, Jie
    Jiang, Qian
    Tang, Yue
    Wang, Puming
    Lee, Shin-Jye
    JOURNAL OF INTELLIGENT & FUZZY SYSTEMS, 2022, 42 (03) : 2083 - 2102
  • [50] A Multi-Focus Image Fusion Algorithm Based on Depth Learning
    Chen Qingjiang
    Li Yi
    Chai Yuzhou
    LASER & OPTOELECTRONICS PROGRESS, 2018, 55 (07)