An autoencoder deep residual network model for multi focus image fusion

被引:0
|
作者
Shihabudeen H
Rajeesh J
机构
[1] APJ Abdul Kalam Technological University,College of Engineering Thalassery
[2] College of Engineering Kidangoor,Department of Electronics
来源
关键词
Deep Learning; Deep CNN; Image fusion; Decoder; Multifocus; Depth of field;
D O I
暂无
中图分类号
学科分类号
摘要
Image fusion technology consolidates data from various source images of a similar objective and performs extremely effective data complementation, which is commonly used in the transportation, medication, and surveillance fields. Because of the imaging instrument’s depth of field limitations, it is very hard to catch all the details of the scene and miss some important features. To solve this problem, this study provides a competent multi-focus image fusing technique based on deep learning. The algorithm collect features from the source input and feed these feature vectors into the convolutional neural network (CNN) to create feature maps. As a result, the focus map collects critical data for the image fusion. Focusmaps collected by the encoder is combined by using L2 norm and nuclear norm methods. Combined focusmaps are then given to Deep CNN to have the source images transformed effectively to the focus image. The proposed nuclear norm-based fusion model provides good evaluation metrics for Entropy, Mutual Information, normalized MI, Qabf\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$Q_{abf}$$\end{document}, and Structural Similarity Index Measure with values 7.6855, 8.7312, 1.1168, 0.7579, and 0.8669, respectively. The L2 norm strategy also provides good computational and experimental efficiency over other approaches. According to the experimental analysis of different approaches, the proposed research outperforms many other existing systems on a variety of performance parameters.
引用
收藏
页码:34773 / 34794
页数:21
相关论文
共 50 条
  • [31] Multi Spectral Image Fusion with Deep Convolutional Network
    Eghbalian, Sajjad
    Ghassemian, Hassan
    2018 9TH INTERNATIONAL SYMPOSIUM ON TELECOMMUNICATIONS (IST), 2018, : 173 - 177
  • [32] Robust multi-focus image fusion using focus property detection and deep image matting
    Wang, Changcheng
    Zang, Yongsheng
    Zhou, Dongming
    Mei, Jiatian
    Nie, Rencan
    Zhou, Lifen
    EXPERT SYSTEMS WITH APPLICATIONS, 2024, 237
  • [33] DFANet: A Dual-Stream Deep Feature Aware Network for Multi-focus Image Fusion
    Dong, Yuye
    Zhao, Libo
    Li, Xiongfei
    Zhang, Xiaoli
    PATTERN RECOGNITION AND COMPUTER VISION, PRCV 2024, PT XV, 2025, 15045 : 319 - 333
  • [34] Multi-focus image fusion using pixel level deep learning convolutional neural network
    Rout, Manmay
    Nahak, Siddheswar
    Priyadarshinee, Subhashree
    Santoshroy, Prasanti
    Sa, Kodanda Dhar
    Dash, Dillip
    PROCEEDINGS OF THE 2019 INTERNATIONAL CONFERENCE ON INTELLIGENT COMPUTING AND CONTROL SYSTEMS (ICCS), 2019, : 582 - 586
  • [35] Incrementally Adapting Pretrained Model Using Network Prior for Multi-Focus Image Fusion
    Hu, Xingyu
    Jiang, Junjun
    Wang, Chenyang
    Liu, Xianming
    Ma, Jiayi
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2024, 33 : 3950 - 3963
  • [36] A review on multi-focus image fusion using deep learning
    Luo, Fei
    Zhao, Baojun
    Fuentes, Joel
    Zhang, Xueqin
    Ding, Weichao
    Gu, Chunhua
    Pino, Luis Rojas
    NEUROCOMPUTING, 2025, 618
  • [37] A Combination of Deep Autoencoder and Multi-Scale Residual Network for Landslide Susceptibility Evaluation
    Wang, Zhuolu
    Xu, Shenghua
    Liu, Jiping
    Wang, Yong
    Ma, Xinrui
    Jiang, Tao
    He, Xuan
    Han, Zeya
    REMOTE SENSING, 2023, 15 (03)
  • [38] DRSNFuse: Deep Residual Shrinkage Network for Infrared and Visible Image Fusion
    Wang, Hongfeng
    Wang, Jianzhong
    Xu, Haonan
    Sun, Yong
    Yu, Zibo
    SENSORS, 2022, 22 (14)
  • [39] Hyperspectral Image Fusion Algorithm Based on Improved Deep Residual Network
    Li, Yuxuan
    Fu, Min
    Zhang, Hanfeng
    Xu, Han
    Zhang, Qi
    SIGNAL PROCESSING, 2023, 210
  • [40] Sentinel-2 Image Fusion Using a Deep Residual Network
    Palsson, Frosti
    Sveinsson, Johannes R.
    Ulfarsson, Magnus O.
    REMOTE SENSING, 2018, 10 (08)