An autoencoder deep residual network model for multi focus image fusion

被引:0
|
作者
Shihabudeen H
Rajeesh J
机构
[1] APJ Abdul Kalam Technological University,College of Engineering Thalassery
[2] College of Engineering Kidangoor,Department of Electronics
来源
关键词
Deep Learning; Deep CNN; Image fusion; Decoder; Multifocus; Depth of field;
D O I
暂无
中图分类号
学科分类号
摘要
Image fusion technology consolidates data from various source images of a similar objective and performs extremely effective data complementation, which is commonly used in the transportation, medication, and surveillance fields. Because of the imaging instrument’s depth of field limitations, it is very hard to catch all the details of the scene and miss some important features. To solve this problem, this study provides a competent multi-focus image fusing technique based on deep learning. The algorithm collect features from the source input and feed these feature vectors into the convolutional neural network (CNN) to create feature maps. As a result, the focus map collects critical data for the image fusion. Focusmaps collected by the encoder is combined by using L2 norm and nuclear norm methods. Combined focusmaps are then given to Deep CNN to have the source images transformed effectively to the focus image. The proposed nuclear norm-based fusion model provides good evaluation metrics for Entropy, Mutual Information, normalized MI, Qabf\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$Q_{abf}$$\end{document}, and Structural Similarity Index Measure with values 7.6855, 8.7312, 1.1168, 0.7579, and 0.8669, respectively. The L2 norm strategy also provides good computational and experimental efficiency over other approaches. According to the experimental analysis of different approaches, the proposed research outperforms many other existing systems on a variety of performance parameters.
引用
收藏
页码:34773 / 34794
页数:21
相关论文
共 50 条
  • [1] An autoencoder deep residual network model for multi focus image fusion
    Shihabudeen, H.
    Rajeesh, J.
    MULTIMEDIA TOOLS AND APPLICATIONS, 2023, 83 (12) : 34773 - 34794
  • [2] Multi-focus image fusion with deep residual learning and focus property detection
    Liu, Yu
    Wang, Lei
    Li, Huafeng
    Chen, Xun
    INFORMATION FUSION, 2022, 86-87 : 1 - 16
  • [3] Multi-focus image fusion with a deep convolutional neural network
    Liu, Yu
    Chen, Xun
    Peng, Hu
    Wang, Zengfu
    INFORMATION FUSION, 2017, 36 : 191 - 207
  • [4] Multi-focus Image Fusion Using Deep Belief Network
    Deshmukh, Vaidehi
    Khaparde, Arti
    Shaikh, Sana
    INFORMATION AND COMMUNICATION TECHNOLOGY FOR INTELLIGENT SYSTEMS (ICTIS 2017) - VOL 1, 2018, 83 : 233 - 241
  • [5] DMDN: Degradation model-based deep network for multi-focus image fusion
    Xiao, Yifan
    Guo, Zhixin
    Veelaert, Peter
    Philips, Wilfried
    SIGNAL PROCESSING-IMAGE COMMUNICATION, 2022, 101
  • [6] Dense Multi-focus Fusion Net: A Deep Unsupervised Convolutional Network for Multi-focus Image Fusion
    Mustafa, Hafiz Tayyab
    Liu, Fanghui
    Yang, Jie
    Khan, Zubair
    Huang, Qiao
    ARTIFICIAL INTELLIGENCEAND SOFT COMPUTING, PT I, 2019, 11508 : 153 - 163
  • [7] Focus-aware and deep restoration network with transformer for multi-focus image fusion
    Wang, Changcheng
    Yan, Kaixiang
    Zang, Yongsheng
    Zhou, Dongming
    Nie, Rencan
    DIGITAL SIGNAL PROCESSING, 2024, 149
  • [8] Multi focus and multi-source image fusion based on deep learning model
    Fu, Jie
    Gao, Xin-Ran
    Xu, Min
    Wang, Wenju
    2019 2ND WORLD CONFERENCE ON MECHANICAL ENGINEERING AND INTELLIGENT MANUFACTURING (WCMEIM 2019), 2019, : 512 - 515
  • [9] A multi-channel neural network model for multi-focus image fusion
    Qi, Yunliang
    Yang, Zhen
    Lu, Xiangyu
    Li, Shouliang
    Ma, Yide
    EXPERT SYSTEMS WITH APPLICATIONS, 2024, 247
  • [10] A Deep and Supervised Atrous Convolutional Model for Multi-Focus Image Fusion
    Wang, Changcheng
    Zhou, Dongming
    Zang, Yongsheng
    Nie, Rencan
    Guo, Yanbu
    IEEE SENSORS JOURNAL, 2021, 21 (20) : 23069 - 23084