Multifocus image fusion using convolutional neural network

被引:13
|
作者
Wen, Yu [1 ]
Yang, Xiaomin [1 ]
Celik, Turgay [2 ]
Sushkova, Olga [3 ]
Albertini, Marcelo Keese [4 ]
机构
[1] Sichuan Univ, Coll Elect & Informat Engn, Chengdu 610064, Sichuan, Peoples R China
[2] Univ Witwatersrand, Sch Comp Sci & Appl Math, Johannesburg, South Africa
[3] Kotelnikov Inst Radio Engn & Elect, Moscow, Russia
[4] Univ Fed Uberlandia, Dept Comp Sci, Uberlandia, MG, Brazil
基金
中国国家自然科学基金;
关键词
Image fusion; Multi-focus; Convolutional neural network; Morphological filtering; PERFORMANCE;
D O I
10.1007/s11042-020-08945-z
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Acquiring all-in-focus images is significant in the multi-media era. Limited by the depth-of-field of the optical lens, it is hard to acquire an image with all targets are clear. One possible solution is to merge the information of a few complementary images in the same scene. In this article, we employ a two-channel convolutional network to derive the clarity map of source images. Then, the clarity map is smoothed by using morphological filtering. Finally, the fusion image is constructed via merging the clear parts of source images. Experimental results prove that our approach has a better performance on both visual quality and quantitative evaluations than many previous fusion approaches.
引用
收藏
页码:34531 / 34543
页数:13
相关论文
共 50 条
  • [31] Infrared and Visible Image Fusion with Convolutional Neural Network and Transformer
    Yang, Yang
    Ren, Zhennan
    Li, Beichen
    LASER & OPTOELECTRONICS PROGRESS, 2023, 60 (16)
  • [32] Technique for Image Fusion Based on PCNN and Convolutional Neural Network
    Kong, Weiwei
    Lei, Yang
    Ma, Jing
    ADVANCES IN INTERNETWORKING, DATA & WEB TECHNOLOGIES, EIDWT-2017, 2018, 6 : 378 - 389
  • [33] Infrared and visible image fusion with supervised convolutional neural network
    An, Wen-Bo
    Wang, Hong-Mei
    OPTIK, 2020, 219
  • [34] Infrared and visible image fusion of convolutional neural network and NSST
    Huan K.
    Li X.
    Cao Y.
    Chen X.
    Hongwai yu Jiguang Gongcheng/Infrared and Laser Engineering, 2022, 51 (03):
  • [35] HCNNet: A Hybrid Convolutional Neural Network for Spatiotemporal Image Fusion
    Zhu, Zhuangshan
    Tao, Yuxiang
    Luo, Xiaobo
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [36] Image Fusion and Super-Resolution with Convolutional Neural Network
    Zhong, Jinying
    Yang, Bin
    Li, Yuehua
    Zhong, Fei
    Chen, Zhongze
    PATTERN RECOGNITION (CCPR 2016), PT II, 2016, 663 : 78 - 88
  • [37] Remote Sensing Image Fusion With Deep Convolutional Neural Network
    Shao, Zhenfeng
    Cai, Jiajun
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2018, 11 (05) : 1656 - 1669
  • [38] Image fusion and enhancement based on energy of the pixel using Deep Convolutional Neural Network
    Rajesh, M.
    Sitharthan, R.
    MULTIMEDIA TOOLS AND APPLICATIONS, 2022, 81 (01) : 873 - 885
  • [39] Image Synthesis using Convolutional Neural Network
    Bhat, Ganesh
    Dharwadkar, Shrikant
    Reddy, N. V. Subba
    Shivaprasad, G.
    2017 2ND IEEE INTERNATIONAL CONFERENCE ON RECENT TRENDS IN ELECTRONICS, INFORMATION & COMMUNICATION TECHNOLOGY (RTEICT), 2017, : 689 - 691
  • [40] Multimodal medical image fusion using convolutional neural network and extreme learning machine
    Kong, Weiwei
    Li, Chi
    Lei, Yang
    FRONTIERS IN NEUROROBOTICS, 2022, 16